You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2017/10/01 12:24:12 UTC
[JENKINS] Lucene-Solr-Tests-master - Build # 2110 - Still Unstable
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2110/
16 tests failed.
FAILED: org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithSourceCluster
Error Message:
Captured an uncaught exception in thread: Thread[id=22358, name=Thread-8273, state=RUNNABLE, group=TGRP-CdcrBootstrapTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=22358, name=Thread-8273, state=RUNNABLE, group=TGRP-CdcrBootstrapTest]
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:D81D97F721A468D0]:0)
Caused by: java.lang.AssertionError: 1
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A]:0)
at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:192)
at org.apache.solr.core.SolrCore.close(SolrCore.java:1613)
at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:864)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1262)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrBootstrapTest
Error Message:
ObjectTracker found 3 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1019) at org.apache.solr.core.SolrCore.reload(SolrCore.java:636) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1261) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:741) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:934) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:843) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1028) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:942) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1019)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:636)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1261)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:741)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:934)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:843)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1028)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:942)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:294)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testAsyncRequests
Error Message:
Could not find a healthy node to handle the request.
Stack Trace:
org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:E50FFA8484683545]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1115)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:106)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:71)
at org.apache.solr.cloud.CollectionsAPIAsyncDistributedZkTest.testAsyncRequests(CollectionsAPIAsyncDistributedZkTest.java:95)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Didn't see all replicas for shard shard1 in c8n_1x3 come up within 90000 ms! ClusterState: { "collMinRf_1x3":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"collMinRf_1x3_shard1_replica_n1", "base_url":"http://127.0.0.1:58410", "node_name":"127.0.0.1:58410_", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"collMinRf_1x3_shard1_replica_n2", "base_url":"http://127.0.0.1:51620", "node_name":"127.0.0.1:51620_", "state":"active", "type":"NRT"}, "core_node6":{ "core":"collMinRf_1x3_shard1_replica_n4", "base_url":"http://127.0.0.1:47821", "node_name":"127.0.0.1:47821_", "state":"active", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}, "collection1":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{"core_node44":{ "core":"collection1_shard1_replica_n43", "base_url":"http://127.0.0.1:47821", "node_name":"127.0.0.1:47821_", "state":"active", "type":"NRT", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node42":{ "core":"collection1_shard2_replica_n41", "base_url":"http://127.0.0.1:51620", "node_name":"127.0.0.1:51620_", "state":"active", "type":"NRT", "leader":"true"}, "core_node46":{ "core":"collection1_shard2_replica_n45", "base_url":"http://127.0.0.1:58410", "node_name":"127.0.0.1:58410_", "state":"active", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"}, "control_collection":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{"core_node2":{ "core":"control_collection_shard1_replica_n1", "base_url":"http://127.0.0.1:60935", "node_name":"127.0.0.1:60935_", "state":"active", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"}, "c8n_1x3":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "core":"c8n_1x3_shard1_replica_n1", "base_url":"http://127.0.0.1:51620", "node_name":"127.0.0.1:51620_", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "state":"down", "base_url":"http://127.0.0.1:58410", "core":"c8n_1x3_shard1_replica_n2", "node_name":"127.0.0.1:58410_", "type":"NRT"}, "core_node6":{ "core":"c8n_1x3_shard1_replica_n3", "base_url":"http://127.0.0.1:47821", "node_name":"127.0.0.1:47821_", "state":"active", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}}
Stack Trace:
java.lang.AssertionError: Didn't see all replicas for shard shard1 in c8n_1x3 come up within 90000 ms! ClusterState: {
"collMinRf_1x3":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"collMinRf_1x3_shard1_replica_n1",
"base_url":"http://127.0.0.1:58410",
"node_name":"127.0.0.1:58410_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"collMinRf_1x3_shard1_replica_n2",
"base_url":"http://127.0.0.1:51620",
"node_name":"127.0.0.1:51620_",
"state":"active",
"type":"NRT"},
"core_node6":{
"core":"collMinRf_1x3_shard1_replica_n4",
"base_url":"http://127.0.0.1:47821",
"node_name":"127.0.0.1:47821_",
"state":"active",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"},
"collection1":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node44":{
"core":"collection1_shard1_replica_n43",
"base_url":"http://127.0.0.1:47821",
"node_name":"127.0.0.1:47821_",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node42":{
"core":"collection1_shard2_replica_n41",
"base_url":"http://127.0.0.1:51620",
"node_name":"127.0.0.1:51620_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node46":{
"core":"collection1_shard2_replica_n45",
"base_url":"http://127.0.0.1:58410",
"node_name":"127.0.0.1:58410_",
"state":"active",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"},
"control_collection":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{"core_node2":{
"core":"control_collection_shard1_replica_n1",
"base_url":"http://127.0.0.1:60935",
"node_name":"127.0.0.1:60935_",
"state":"active",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"},
"c8n_1x3":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"c8n_1x3_shard1_replica_n1",
"base_url":"http://127.0.0.1:51620",
"node_name":"127.0.0.1:51620_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"state":"down",
"base_url":"http://127.0.0.1:58410",
"core":"c8n_1x3_shard1_replica_n2",
"node_name":"127.0.0.1:58410_",
"type":"NRT"},
"core_node6":{
"core":"c8n_1x3_shard1_replica_n3",
"base_url":"http://127.0.0.1:47821",
"node_name":"127.0.0.1:47821_",
"state":"active",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}}
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:891FF9E98C3C1662]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.ensureAllReplicasAreActive(AbstractFullDistribZkTestBase.java:1996)
at org.apache.solr.cloud.HttpPartitionTest.testRf3(HttpPartitionTest.java:427)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:138)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.LeaderElectionContextKeyTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:891FF9E98C3C1662]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.LeaderElectionContextKeyTest.test(LeaderElectionContextKeyTest.java:88)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n2","base_url":"http://127.0.0.1:58404","node_name":"127.0.0.1:58404_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "state":"down", "base_url":"http://127.0.0.1:57072", "core":"c8n_1x3_lf_shard1_replica_n3", "node_name":"127.0.0.1:57072_", "type":"NRT"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_n2", "base_url":"http://127.0.0.1:58404", "node_name":"127.0.0.1:58404_", "state":"active", "type":"NRT", "leader":"true"}, "core_node6":{ "core":"c8n_1x3_lf_shard1_replica_n1", "base_url":"http://127.0.0.1:32860", "node_name":"127.0.0.1:32860_", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n2","base_url":"http://127.0.0.1:58404","node_name":"127.0.0.1:58404_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"state":"down",
"base_url":"http://127.0.0.1:57072",
"core":"c8n_1x3_lf_shard1_replica_n3",
"node_name":"127.0.0.1:57072_",
"type":"NRT"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_n2",
"base_url":"http://127.0.0.1:58404",
"node_name":"127.0.0.1:58404_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node6":{
"core":"c8n_1x3_lf_shard1_replica_n1",
"base_url":"http://127.0.0.1:32860",
"node_name":"127.0.0.1:32860_",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:891FF9E98C3C1662]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.PeerSyncReplicationTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:57745/exn/ow
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:57745/exn/ow
at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:891FF9E98C3C1662]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:638)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:418)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
... 44 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.PeerSyncReplicationTest
Error Message:
85 threads leaked from SUITE scope at org.apache.solr.cloud.PeerSyncReplicationTest: 1) Thread[id=24829, name=updateExecutor-4390-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=24766, name=org.eclipse.jetty.server.session.HashSessionManager@5d29459bTimer, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=24880, name=zkCallback-4393-thread-2, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=24823, name=watches-4394-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=24819, name=Scheduler-1775598348, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=24892, name=zkCallback-4387-thread-6-processing-n:127.0.0.1:58498_exn%2Fow-SendThread(127.0.0.1:33704), state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 7) Thread[id=24758, name=qtp1687676774-24758, state=RUNNABLE, group=TGRP-PeerSyncReplicationTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=24881, name=zkCallback-4393-thread-3, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=24857, name=zkCallback-4400-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=24792, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=24796, name=qtp2109264707-24796-acceptor-0@c80834b-ServerConnector@7b41367e{HTTP/1.1,[http/1.1]}{127.0.0.1:57745}, state=RUNNABLE, group=TGRP-PeerSyncReplicationTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:371) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=24802, name=org.eclipse.jetty.server.session.HashSessionManager@600a1c11Timer, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=24832, name=recoveryExecutor-4391-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 14) Thread[id=24831, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=24842, name=qtp2021971224-24842, state=RUNNABLE, group=TGRP-PeerSyncReplicationTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=24964, name=OverseerStateUpdate-98753333131739153-127.0.0.1:58498_exn%2Fow-n_0000000004, state=TIMED_WAITING, group=Overseer state updater.] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.apache.solr.cloud.ZkDistributedQueue.peek(ZkDistributedQueue.java:169) at org.apache.solr.cloud.ZkDistributedQueue.peek(ZkDistributedQueue.java:142) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:184) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=24894, name=coreZkRegister-7243-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=24798, name=qtp2109264707-24798, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Object.wait(Native Method) at org.apache.solr.cloud.OverseerTaskQueue$LatchWatcher.await(OverseerTaskQueue.java:149) at org.apache.solr.cloud.OverseerTaskQueue.offer(OverseerTaskQueue.java:199) at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:288) at org.apache.solr.handler.admin.CollectionsHandler.invokeAction(CollectionsHandler.java:232) at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:210) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 19) Thread[id=24844, name=qtp2021971224-24844, state=RUNNABLE, group=TGRP-PeerSyncReplicationTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 20) Thread[id=24763, name=qtp1687676774-24763, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 21) Thread[id=24765, name=qtp1687676774-24765, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 22) Thread[id=24779, name=Thread-9164, state=WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:502) at org.apache.solr.core.CloserThread.run(CoreContainer.java:1655) 23) Thread[id=24814, name=zkCallback-4393-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 24) Thread[id=24863, name=Scheduler-1567401416, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 25) Thread[id=24924, name=coreZkRegister-7254-thread-2, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 26) Thread[id=24893, name=zkCallback-4387-thread-6-processing-n:127.0.0.1:58498_exn%2Fow-EventThread, state=WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 27) Thread[id=24794, name=qtp2109264707-24794, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 28) Thread[id=24972, name=zkCallback-4393-thread-8, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 29) Thread[id=24851, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 30) Thread[id=24923, name=coreZkRegister-7254-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 31) Thread[id=24770, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 32) Thread[id=24800, name=qtp2109264707-24800, state=RUNNABLE, group=TGRP-PeerSyncReplicationTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 33) Thread[id=24845, name=qtp2021971224-24845, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 34) Thread[id=24850, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 35) Thread[id=24799, name=qtp2109264707-24799, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 36) Thread[id=24899, name=zkCallback-4400-thread-5, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 37) Thread[id=24900, name=zkCallback-4400-thread-6, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 38) Thread[id=24789, name=searcherExecutor-7249-thread-1, state=WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 39) Thread[id=24843, name=qtp2021971224-24843, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 40) Thread[id=24966, name=OverseerHdfsCoreFailoverThread-98753333131739153-127.0.0.1:58498_exn%2Fow-n_0000000004, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:748) 41) Thread[id=24891, name=zkCallback-4387-thread-6, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 42) Thread[id=24807, name=Connection evictor, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 43) Thread[id=24784, name=watches-4388-thread-1, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 44) Thread[id=24846, name=org.eclipse.jetty.server.session.HashSessionManager@ae3a2b2Timer, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 45) Thread[id=24878, name=zkCallback-4387-thread-3, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 46) Thread[id=24906, name=zkCallback-4400-thread-4-processing-n:127.0.0.1:33809_exn%2Fow-EventThread, state=WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 47) Thread[id=24759, name=qtp1687676774-24759, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 48) Thread[id=24879, name=zkCallback-4387-thread-4, state=TIMED_WAITING, group=TGRP-PeerSyncReplicationTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPo
[...truncated too long message...]
loud.ZkController.getLeaderProps(ZkController.java:1143)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeaderProps(ZkController.java:1110)
[junit4] 2> at org.apache.solr.cloud.ZkController.getLeader(ZkController.java:1066)
[junit4] 2> at org.apache.solr.cloud.ZkController.register(ZkController.java:971)
[junit4] 2> at org.apache.solr.cloud.ZkController$RegisterCoreAsync.call(ZkController.java:248)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 8001985 WARN (zkCallback-2185-thread-4-processing-n:127.0.0.1:38381_) [n:127.0.0.1:38381_ ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 8002058 INFO (TEST-TestLeaderInitiatedRecoveryThread.testPublishDownState-seed#[14BC63322C07B9A]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@56dbb348{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 8002058 INFO (TEST-TestLeaderInitiatedRecoveryThread.testPublishDownState-seed#[14BC63322C07B9A]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3b1b01a9{/,null,UNAVAILABLE}
[junit4] 2> 8002065 INFO (TEST-TestLeaderInitiatedRecoveryThread.testPublishDownState-seed#[14BC63322C07B9A]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 51738
[junit4] 2> 8002066 ERROR (TEST-TestLeaderInitiatedRecoveryThread.testPublishDownState-seed#[14BC63322C07B9A]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 8002066 INFO (TEST-TestLeaderInitiatedRecoveryThread.testPublishDownState-seed#[14BC63322C07B9A]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48462 48462
[junit4] 2> 8002301 INFO (Thread-3692) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48462 48462
[junit4] 2> 8002326 WARN (Thread-3692) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2> 3 /solr/collections/collection1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 2 /solr/collections/control_collection/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/collections
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestLeaderInitiatedRecoveryThread -Dtests.method=testPublishDownState -Dtests.seed=14BC63322C07B9A -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ga -Dtests.timezone=Africa/Casablanca -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 81.2s J0 | TestLeaderInitiatedRecoveryThread.testPublishDownState <<<
[junit4] > Throwable #1: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
[junit4] > at __randomizedtesting.SeedInfo.seed([14BC63322C07B9A:5F3664CD86DD3267]:0)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] > at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] > at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1532)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:340)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:337)
[junit4] > at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:337)
[junit4] > at org.apache.solr.cloud.TestLeaderInitiatedRecoveryThread.testPublishDownState(TestLeaderInitiatedRecoveryThread.java:103)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestLeaderInitiatedRecoveryThread_14BC63322C07B9A-001
[junit4] 2> Oct 01, 2017 11:14:58 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=2008, maxMBSortInHeap=7.708407137568259, sim=RandomSimilarity(queryNorm=true): {}, locale=ga, timezone=Africa/Casablanca
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=286342160,total=514326528
[junit4] 2> NOTE: All tests run in this JVM: [TestSlowCompositeReaderWrapper, TestSolrCloudWithHadoopAuthPlugin, GraphQueryTest, TestQuerySenderNoQuery, TestFastOutputStream, DefaultValueUpdateProcessorTest, CloudMLTQParserTest, LargeFieldTest, EchoParamsTest, TestAnalyzeInfixSuggestions, TestOrdValues, LeaderInitiatedRecoveryOnShardRestartTest, TestConfigSetsAPI, TestHttpShardHandlerFactory, TestConfigOverlay, SynonymTokenizerTest, InfoHandlerTest, UpdateParamsTest, TestOnReconnectListenerSupport, TestRangeQuery, TestHashQParserPlugin, IndexBasedSpellCheckerTest, TestDocSet, TestLuceneIndexBackCompat, TestFunctionQuery, HdfsRecoveryZkTest, TestMaxTokenLenTokenizer, TestDynamicFieldCollectionResource, OutputWriterTest, TestCloudManagedSchema, DistributedSpellCheckComponentTest, RuleEngineTest, SecurityConfHandlerTest, TestReloadDeadlock, LeaderElectionIntegrationTest, AutoScalingHandlerTest, DistributedFacetPivotSmallAdvancedTest, TestFaceting, SolrCoreMetricManagerTest, PluginInfoTest, TestSQLHandlerNonCloud, BitVectorTest, BasicDistributedZkTest, TestPhraseSuggestions, TestRawTransformer, TestRebalanceLeaders, TestNoOpRegenerator, SpellCheckCollatorTest, TestMacroExpander, MoveReplicaHDFSTest, BinaryUpdateRequestHandlerTest, TestHalfAndHalfDocValues, TestSolrCloudWithKerberosAlt, TestDownShardTolerantSearch, TestEmbeddedSolrServerSchemaAPI, SolrXmlInZkTest, TestShortCircuitedRequests, TestRequestStatusCollectionAPI, SimpleCollectionCreateDeleteTest, BlockDirectoryTest, RequestHandlersTest, ShufflingReplicaListTransformerTest, DebugComponentTest, DistribDocExpirationUpdateProcessorTest, SolrIndexConfigTest, DistributedVersionInfoTest, RequestLoggingTest, TestBinaryField, CloudExitableDirectoryReaderTest, DistributedFacetExistsSmallTest, TestScoreJoinQPNoScore, SolrMetricsIntegrationTest, TestSchemaNameResource, TestNumericTerms32, TestClusterProperties, VersionInfoTest, TestJavabinTupleStreamParser, TestShardHandlerFactory, TestLocalFSCloudBackupRestore, TestExactSharedStatsCache, SolrCoreTest, QueryElevationComponentTest, TestConfigSets, TestIndexingPerformance, TestFieldResource, DataDrivenBlockJoinTest, TestCollationField, TestFieldCacheReopen, CoreSorterTest, FacetPivotSmallTest, TestSolrCLIRunExample, DeleteLastCustomShardedReplicaTest, TestSchemalessBufferedUpdates, SolrIndexSplitterTest, ExternalFileFieldSortTest, SolrJmxReporterCloudTest, ConcurrentDeleteAndCreateCollectionTest, TestMaxScoreQueryParser, ReplaceNodeTest, ChaosMonkeyNothingIsSafeTest, TestWriterPerf, DistributedQueryComponentCustomSortTest, TestStressLucene, TestSmileRequest, SolrRequestParserTest, DocumentAnalysisRequestHandlerTest, TestTrieFacet, TestManagedSchemaThreadSafety, JavabinLoaderTest, AtomicUpdatesTest, ClassificationUpdateProcessorTest, RAMDirectoryFactoryTest, SuggestComponentTest, TestCloudInspectUtil, TestWordDelimiterFilterFactory, TolerantUpdateProcessorTest, TestSha256AuthenticationProvider, TestFieldCacheVsDocValues, CollectionsAPIDistributedZkTest, SyncSliceTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, TestReload, StatsComponentTest, TestBadConfig, TestCoreDiscovery, TestCSVLoader, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, QueryEqualityTest, TestRemoteStreaming, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, TestOmitPositions, XmlUpdateRequestHandlerTest, TestValueSourceCache, RequiredFieldsTest, TestSolrQueryParser, LoggingHandlerTest, SolrPluginUtilsTest, UpdateRequestProcessorFactoryTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestComponentsName, TestLFUCache, CleanupOldIndexTest, CollectionsAPISolrJTest, DistribCursorPagingTest, MigrateRouteKeyTest, NodeMutatorTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, RemoteQueryErrorTest, ReplicationFactorTest, RestartWhileUpdatingTest, RollingRestartTest, TestLeaderInitiatedRecoveryThread]
[junit4] Completed [645/734 (12!)] on J0 in 84.99s, 1 test, 1 error <<< FAILURES!
[...truncated 47071 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2141 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2141/
All tests passed
Build Log:
[...truncated 4745 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:495: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2262: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:409: impossible to resolve dependencies:
resolve failed - see output for details
Total time: 114 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2140 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2140/
All tests passed
Build Log:
[...truncated 4768 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:495: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2262: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:409: impossible to resolve dependencies:
resolve failed - see output for details
Total time: 118 minutes 37 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2139 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2139/
8 tests failed.
FAILED: org.apache.solr.cloud.TestCloudRecovery.corruptedLogTest
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([F153CCAE402B6938:7225935C96526799]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.common.cloud.ClusterStateUtil.waitForAllActiveAndLiveReplicas(ClusterStateUtil.java:70)
at org.apache.solr.cloud.TestCloudRecovery.corruptedLogTest(TestCloudRecovery.java:184)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 44 more
FAILED: org.apache.solr.cloud.TestRandomRequestDistribution.test
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([F153CCAE402B6938:7907F374EED704C0]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test
Error Message:
wrong number of events added to .system expected:<9> but was:<10>
Stack Trace:
java.lang.AssertionError: wrong number of events added to .system expected:<9> but was:<10>
at __randomizedtesting.SeedInfo.seed([F153CCAE402B6938:7907F374EED704C0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index: 0, Size: 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at __randomizedtesting.SeedInfo.seed([F153CCAE402B6938:E51B97FB632CD426]:0)
at java.util.ArrayList.rangeCheck(ArrayList.java:657)
at java.util.ArrayList.get(ArrayList.java:433)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.graph.GraphTest.testShortestPathStream
Error Message:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
Stack Trace:
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE:793523DBDFF33BA5]:0)
at org.apache.solr.client.solrj.io.graph.ShortestPathStream.open(ShortestPathStream.java:365)
at org.apache.solr.client.solrj.io.graph.GraphTest.getTuples(GraphTest.java:232)
at org.apache.solr.client.solrj.io.graph.GraphTest.testShortestPathStream(GraphTest.java:219)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.util.concurrent.FutureTask.get(FutureTask.java:192)
at org.apache.solr.client.solrj.io.graph.ShortestPathStream.open(ShortestPathStream.java:337)
... 41 more
Caused by: java.lang.RuntimeException: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at org.apache.solr.client.solrj.io.graph.ShortestPathStream$JoinRunner.call(ShortestPathStream.java:461)
at org.apache.solr.client.solrj.io.graph.ShortestPathStream$JoinRunner.call(ShortestPathStream.java:417)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Caused by: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.constructStreams(CloudSolrStream.java:378)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:274)
at org.apache.solr.client.solrj.io.stream.PushBackStream.open(PushBackStream.java:71)
at org.apache.solr.client.solrj.io.stream.ReducerStream.open(ReducerStream.java:200)
at org.apache.solr.client.solrj.io.stream.UniqueStream.open(UniqueStream.java:151)
at org.apache.solr.client.solrj.io.graph.ShortestPathStream$JoinRunner.call(ShortestPathStream.java:448)
... 6 more
Caused by: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:146)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.getSlices(CloudSolrStream.java:331)
at org.apache.solr.client.solrj.io.stream.TupleStream.getShards(TupleStream.java:141)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.constructStreams(CloudSolrStream.java:363)
... 11 more
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 16 more
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.graph.GraphTest
Error Message:
10 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.graph.GraphTest: 1) Thread[id=772, name=zkCallback-176-thread-4-SendThread(127.0.0.1:42213), state=TIMED_WAITING, group=TGRP-GraphTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 2) Thread[id=710, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=764, name=zkCallback-176-thread-2, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=713, name=zkCallback-176-thread-1, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=765, name=zkCallback-176-thread-3, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=773, name=zkCallback-176-thread-4-EventThread, state=WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 7) Thread[id=716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=717, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 10 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.graph.GraphTest:
1) Thread[id=772, name=zkCallback-176-thread-4-SendThread(127.0.0.1:42213), state=TIMED_WAITING, group=TGRP-GraphTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
2) Thread[id=710, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=764, name=zkCallback-176-thread-2, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=713, name=zkCallback-176-thread-1, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=765, name=zkCallback-176-thread-3, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=773, name=zkCallback-176-thread-4-EventThread, state=WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
7) Thread[id=716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=717, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.graph.GraphTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=772, name=zkCallback-176-thread-4-SendThread(127.0.0.1:42213), state=TIMED_WAITING, group=TGRP-GraphTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2) Thread[id=764, name=zkCallback-176-thread-2, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=713, name=zkCallback-176-thread-1, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=765, name=zkCallback-176-thread-3, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=772, name=zkCallback-176-thread-4-SendThread(127.0.0.1:42213), state=TIMED_WAITING, group=TGRP-GraphTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
2) Thread[id=764, name=zkCallback-176-thread-2, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=713, name=zkCallback-176-thread-1, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=765, name=zkCallback-176-thread-3, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE]:0)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
Error Message:
Did not see a fully active cluster after 30 seconds
Stack Trace:
java.lang.AssertionError: Did not see a fully active cluster after 30 seconds
at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE:A0F67B546714EFEC]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure(TestCollectionStateWatchers.java:250)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11694 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.SystemLogListenerTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/init-core-data-001
[junit4] 2> 237229 WARN (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
[junit4] 2> 237229 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 237231 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 237231 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 237231 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001
[junit4] 2> 237232 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 237244 INFO (Thread-87) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 237244 INFO (Thread-87) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 237318 ERROR (Thread-87) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 237354 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43826
[junit4] 2> 237485 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f7372bf5a0000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 237612 INFO (jetty-launcher-65-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 237623 INFO (jetty-launcher-65-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 237637 INFO (jetty-launcher-65-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 237729 INFO (jetty-launcher-65-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@166da26f{/solr,null,AVAILABLE}
[junit4] 2> 237730 INFO (jetty-launcher-65-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f845d1b{SSL,[ssl, http/1.1]}{127.0.0.1:41300}
[junit4] 2> 237730 INFO (jetty-launcher-65-thread-1) [ ] o.e.j.s.Server Started @253004ms
[junit4] 2> 237730 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41300}
[junit4] 2> 237731 ERROR (jetty-launcher-65-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 237731 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 237731 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 237731 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 237731 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-31T17:20:21.292Z
[junit4] 2> 237855 INFO (jetty-launcher-65-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a36799b{/solr,null,AVAILABLE}
[junit4] 2> 237855 INFO (jetty-launcher-65-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@25f0f894{SSL,[ssl, http/1.1]}{127.0.0.1:44916}
[junit4] 2> 237855 INFO (jetty-launcher-65-thread-2) [ ] o.e.j.s.Server Started @253129ms
[junit4] 2> 237856 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44916}
[junit4] 2> 237864 ERROR (jetty-launcher-65-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 237864 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 237865 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 237865 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 237865 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-31T17:20:21.426Z
[junit4] 2> 237949 INFO (jetty-launcher-65-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@ff380c6{/solr,null,AVAILABLE}
[junit4] 2> 237949 INFO (jetty-launcher-65-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3f478ccf{SSL,[ssl, http/1.1]}{127.0.0.1:35005}
[junit4] 2> 237949 INFO (jetty-launcher-65-thread-3) [ ] o.e.j.s.Server Started @253223ms
[junit4] 2> 237949 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35005}
[junit4] 2> 237950 ERROR (jetty-launcher-65-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 237950 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 237950 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 237950 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 237950 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-31T17:20:21.511Z
[junit4] 2> 238014 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 238123 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 238123 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 238168 INFO (jetty-launcher-65-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43826/solr
[junit4] 2> 238343 INFO (jetty-launcher-65-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43826/solr
[junit4] 2> 238400 INFO (jetty-launcher-65-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43826/solr
[junit4] 2> 238491 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f7372bf5a0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 238657 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f7372bf5a0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 239347 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 239360 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41300_solr
[junit4] 2> 239362 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.Overseer Overseer (id=98924653499252743-127.0.0.1:41300_solr-n_0000000000) starting
[junit4] 2> 239530 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41300_solr
[junit4] 2> 239531 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 239680 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 239714 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: []
[junit4] 2> 239714 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 239714 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 239714 INFO (OverseerStateUpdate-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 239803 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 240161 DEBUG (OverseerAutoScalingTriggerThread-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 240181 DEBUG (ScheduledTrigger-252-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41300_solr]
[junit4] 2> 240456 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 240527 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 240529 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44916_solr
[junit4] 2> 240547 INFO (zkCallback-80-thread-1-processing-n:127.0.0.1:41300_solr) [n:127.0.0.1:41300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 240770 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41300.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 240779 INFO (zkCallback-81-thread-1-processing-n:127.0.0.1:44916_solr) [n:127.0.0.1:44916_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 240860 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41300.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 240860 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41300.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 240909 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 240932 INFO (jetty-launcher-65-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node1/.
[junit4] 2> 241165 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 241202 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44916.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 241202 DEBUG (ScheduledTrigger-252-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41300_solr, 127.0.0.1:44916_solr]
[junit4] 2> 241238 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44916.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 241255 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44916.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 241257 INFO (jetty-launcher-65-thread-2) [n:127.0.0.1:44916_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node2/.
[junit4] 2> 241560 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35005_solr
[junit4] 2> 241662 INFO (zkCallback-81-thread-1-processing-n:127.0.0.1:44916_solr) [n:127.0.0.1:44916_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 241735 INFO (zkCallback-82-thread-1-processing-n:127.0.0.1:35005_solr) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 241776 INFO (zkCallback-80-thread-1-processing-n:127.0.0.1:41300_solr) [n:127.0.0.1:41300_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 242086 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35005.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 242125 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35005.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 242140 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35005.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 242141 INFO (jetty-launcher-65-thread-3) [n:127.0.0.1:35005_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node3/.
[junit4] 2> 242399 DEBUG (ScheduledTrigger-252-thread-2) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:35005_solr, 127.0.0.1:41300_solr, 127.0.0.1:44916_solr]
[junit4] 2> 242441 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 242441 INFO (SUITE-SystemLogListenerTest-seed#[F153CCAE402B6938]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43826/solr ready
[junit4] 2> 243041 INFO (qtp1347008770-441) [n:127.0.0.1:35005_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=.system&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 243135 INFO (OverseerThreadFactory-254-thread-1-processing-n:127.0.0.1:41300_solr) [n:127.0.0.1:41300_solr ] o.a.s.c.CreateCollectionCmd Create collection .system
[junit4] 2> 243263 INFO (OverseerStateUpdate-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35005/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 243337 INFO (OverseerStateUpdate-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44916/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 243372 INFO (OverseerStateUpdate-98924653499252743-127.0.0.1:41300_solr-n_0000000000) [n:127.0.0.1:41300_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41300/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 243407 DEBUG (ScheduledTrigger-252-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:35005_solr, 127.0.0.1:41300_solr, 127.0.0.1:44916_solr]
[junit4] 2> 243766 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 243766 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 244082 INFO (zkCallback-82-thread-1-processing-n:127.0.0.1:35005_solr) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244098 INFO (zkCallback-82-thread-2-processing-n:127.0.0.1:35005_solr) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244137 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n2&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 244137 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 244228 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n4&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 244262 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 244407 DEBUG (ScheduledTrigger-252-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:35005_solr, 127.0.0.1:41300_solr, 127.0.0.1:44916_solr]
[junit4] 2> 244408 INFO (zkCallback-82-thread-2-processing-n:127.0.0.1:35005_solr) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244408 INFO (zkCallback-81-thread-1-processing-n:127.0.0.1:44916_solr) [n:127.0.0.1:44916_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244408 INFO (zkCallback-82-thread-1-processing-n:127.0.0.1:35005_solr) [n:127.0.0.1:35005_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244408 INFO (zkCallback-80-thread-1-processing-n:127.0.0.1:41300_solr) [n:127.0.0.1:41300_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244428 INFO (zkCallback-81-thread-2-processing-n:127.0.0.1:44916_solr) [n:127.0.0.1:44916_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244428 INFO (zkCallback-80-thread-2-processing-n:127.0.0.1:41300_solr) [n:127.0.0.1:41300_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 244933 WARN (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
[junit4] 2> 244936 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 245064 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 245090 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 245140 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 245179 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 245271 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 245271 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
[junit4] 2> 245271 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35005.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 245271 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 245271 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node3/.system_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node3/./.system_shard1_replica_n1/data/]
[junit4] 2> 245393 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 245432 DEBUG (ScheduledTrigger-252-thread-1) [n:127.0.0.1:41300_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:35005_solr, 127.0.0.1:41300_solr, 127.0.0.1:44916_solr]
[junit4] 2> 245484 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema [.system_shard1_replica_n2] Schema name=_system collection or core
[junit4] 2> 245520 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 245557 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 245557 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n2' using configuration from collection .system, trusted=true
[junit4] 2> 245591 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44916.solr.core..system.shard1.replica_n2' (registry 'solr.core..system.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 245591 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 245592 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.c.SolrCore [[.system_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node2/.system_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node2/./.system_shard1_replica_n2/data/]
[junit4] 2> 245710 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.IndexSchema [.system_shard1_replica_n4] Schema name=_system collection or core
[junit4] 2> 245768 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 245768 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n4' using configuration from collection .system, trusted=true
[junit4] 2> 245768 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41300.solr.core..system.shard1.replica_n4' (registry 'solr.core..system.shard1.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@281e16f
[junit4] 2> 245768 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 245768 INFO (qtp293601186-421) [n:127.0.0.1:41300_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n4] o.a.s.c.SolrCore [[.system_shard1_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node1/.system_shard1_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_F153CCAE402B6938-001/tempDir-001/node1/./.system_shard1_replica_n4/data/]
[junit4] 2> 245990 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 245990 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 245991 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 245991 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 246091 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3e708e3b[.system_shard1_replica_n1] main]
[junit4] 2> 246092 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 246093 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 246109 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 246254 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 246255 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 246255 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582794465414742016
[junit4] 2> 246273 INFO (qtp1347008770-438) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=3 found=1 timeoutin=9999ms
[junit4] 2> 246287 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 246287 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 246288 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 246288 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 246289 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@299e78db[.system_shard1_replica_n2] main]
[junit4] 2> 246309 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 246309 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 246309 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 246320 INFO (searcherExecutor-261-thread-1-processing-n:127.0.0.1:35005_solr x:.system_shard1_replica_n1 s:shard1 c:.system r:core_node3) [n:127.0.0.1:35005_solr c:.system s:shard1 r:core_node3 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [.system_shard1_replica_n1] Registered new searcher Searcher@3e708e3b[.system_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 246344 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 246345 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 246345 INFO (qtp1787769937-432) [n:127.0.0.1:44916_solr c:.system s:shard1 r:core_node5 x:.system_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or r
[...truncated too long message...]
t java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=773, name=zkCallback-176-thread-4-EventThread, state=WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > 7) Thread[id=716, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 9) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 10) Thread[id=717, name=Connection evictor, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=772, name=zkCallback-176-thread-4-SendThread(127.0.0.1:42213), state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 2) Thread[id=764, name=zkCallback-176-thread-2, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 3) Thread[id=713, name=zkCallback-176-thread-1, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=765, name=zkCallback-176-thread-3, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 5) Thread[id=770, name=zkCallback-176-thread-4, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=771, name=zkCallback-176-thread-5, state=TIMED_WAITING, group=TGRP-GraphTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([28C0D907BFBB07FE]:0)
[junit4] Completed [44/146 (2!)] on J1 in 63.44s, 1 test, 3 errors <<< FAILURES!
[...truncated 46572 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2138 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2138/
All tests passed
Build Log:
[...truncated 1794 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2478891515106087960845.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 20971520 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1/hs_err_pid6959.log
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2474570365342939563780.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000ecd80000, 20971520, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J1: EOF ----
[...truncated 46 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=6A7022F4D9C0A95F -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2473881324034772610233.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2472460337648445358659.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2478891515106087960845.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2474570365342939563780.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1494: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1021: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2478891515106087960845.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_050437_2474570365342939563780.syserr
Total time: 54 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-master #2136 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2137 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2137/
All tests passed
Build Log:
[...truncated 224 lines...]
[junit4] JVM J2: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1394535635647974001236.sysout
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 66060288 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J2/hs_err_pid15445.log
[junit4] <<< JVM J2: EOF ----
[junit4] JVM J2: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1398266228173309876036.syserr
[junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00000000fa980000, 66060288, 0) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J2: EOF ----
[...truncated 3 lines...]
[junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1397781273232471248489.sysout
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] #
[junit4] # There is insufficient memory for the Java Runtime Environment to continue.
[junit4] # Native memory allocation (mmap) failed to map 65536 bytes for committing reserved memory.
[junit4] # An error report file with more information is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1/hs_err_pid15446.log
[junit4] #
[junit4] # Compiler replay data is saved as:
[junit4] # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1/replay_pid15446.log
[junit4] <<< JVM J1: EOF ----
[junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1394273289362843267134.syserr
[junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
[junit4] Java HotSpot(TM) 64-Bit Server VM warning: INFO: os::commit_memory(0x00007f2280d47000, 65536, 1) failed; error='Cannot allocate memory' (errno=12)
[junit4] <<< JVM J1: EOF ----
[...truncated 1037 lines...]
[junit4] ERROR: JVM J1 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=4D260B1F82F82316 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J1 -Djunit4.childvm.id=1 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1391715827338704050571.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1392690269098450993514.suites -stdin
[junit4] ERROR: JVM J1 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1397781273232471248489.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1394273289362843267134.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
[junit4] ERROR: JVM J2 ended with an exception, command line: /usr/local/asfpackages/java/jdk1.8.0_144/jre/bin/java -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/heapdumps -ea -esa -Dtests.prefix=tests -Dtests.seed=4D260B1F82F82316 -Xmx512M -Dtests.iters= -Dtests.verbose=false -Dtests.infostream=false -Dtests.codec=random -Dtests.postingsformat=random -Dtests.docvaluesformat=random -Dtests.locale=random -Dtests.timezone=random -Dtests.directory=random -Dtests.linedocsfile=europarl.lines.txt.gz -Dtests.luceneMatchVersion=8.0.0 -Dtests.cleanthreads=perMethod -Djava.util.logging.config.file=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/logging.properties -Dtests.nightly=false -Dtests.weekly=false -Dtests.monster=false -Dtests.slow=true -Dtests.asserts=true -Dtests.multiplier=2 -DtempDir=./temp -Djava.io.tmpdir=./temp -Djunit4.tempDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp -Dcommon.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene -Dclover.db.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/clover/db -Djava.security.policy=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/tools/junit4/tests.policy -Dtests.LUCENE_VERSION=8.0.0 -Djetty.testMode=1 -Djetty.insecurerandom=1 -Dsolr.directoryFactory=org.apache.solr.core.MockDirectoryFactory -Djava.awt.headless=true -Djdk.map.althashing.threshold=0 -Dtests.src.home=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master -Djava.security.egd=file:/dev/./urandom -Djunit4.childvm.cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/J2 -Djunit4.childvm.id=2 -Djunit4.childvm.count=3 -Dtests.leaveTemporary=false -Dtests.filterstacks=true -Djava.security.manager=org.apache.lucene.util.TestSecurityManager -Dfile.encoding=UTF-8 -classpath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/codecs/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/test-framework/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/junit-4.10.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/test-framework/lib/randomizedtesting-runner-2.5.3.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/classes/test:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1396454527026519969161.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1393805144788092040099.suites -stdin
[junit4] ERROR: JVM J2 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1394535635647974001236.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J2-20171031_003234_1398266228173309876036.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:50: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1494: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1021: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1397781273232471248489.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/core/test/temp/junit4-J1-20171031_003234_1394273289362843267134.syserr
Total time: 33 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-master #2136 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2136 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2136/
5 tests failed.
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
KeeperErrorCode = Session expired for /overseer_elect/leader
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
at __randomizedtesting.SeedInfo.seed([3A7EC04E2CD5E5BE:B22AFF9482298846]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderId(OverseerTaskProcessor.java:374)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderNode(OverseerTaskProcessor.java:365)
at org.apache.solr.cloud.RollingRestartTest.waitUntilOverseerDesignateIsLeader(RollingRestartTest.java:137)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([3A7EC04E2CD5E5BE:C33353E110A0A834]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.SyncSliceTest.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([3A7EC04E2CD5E5BE:B22AFF9482298846]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getTotalReplicas(AbstractFullDistribZkTestBase.java:488)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:441)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 38 more
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
expected:<{shard1=0, shard2=1}> but was:<{shard1=0, shard2=0}>
Stack Trace:
java.lang.AssertionError: expected:<{shard1=0, shard2=1}> but was:<{shard1=0, shard2=0}>
at __randomizedtesting.SeedInfo.seed([3A7EC04E2CD5E5BE:B22AFF9482298846]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:285)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestRebalanceLeaders.test
Error Message:
KeeperErrorCode = Session expired for /collections/testcollection/leader_elect/shard2/election
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testcollection/leader_elect/shard2/election
at __randomizedtesting.SeedInfo.seed([3A7EC04E2CD5E5BE:B22AFF9482298846]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1532)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:320)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:320)
at org.apache.solr.cloud.TestRebalanceLeaders.checkAppearOnce(TestRebalanceLeaders.java:144)
at org.apache.solr.cloud.TestRebalanceLeaders.checkConsistency(TestRebalanceLeaders.java:126)
at org.apache.solr.cloud.TestRebalanceLeaders.rebalanceLeaderTest(TestRebalanceLeaders.java:112)
at org.apache.solr.cloud.TestRebalanceLeaders.test(TestRebalanceLeaders.java:77)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12131 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/init-core-data-001
[junit4] 2> 1621110 INFO (SUITE-SyncSliceTest-seed#[3A7EC04E2CD5E5BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1621110 INFO (SUITE-SyncSliceTest-seed#[3A7EC04E2CD5E5BE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 1621111 INFO (SUITE-SyncSliceTest-seed#[3A7EC04E2CD5E5BE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1621111 INFO (SUITE-SyncSliceTest-seed#[3A7EC04E2CD5E5BE]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /jq_qp/m
[junit4] 2> 1621219 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1621219 INFO (Thread-2197) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1621219 INFO (Thread-2197) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1621263 ERROR (Thread-2197) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1621328 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkTestServer start zk server on port:43249
[junit4] 2> 1621643 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1621644 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1621657 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1621658 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1621659 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1621659 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1621660 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1621677 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1621677 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1621678 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1621679 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1621714 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f6e1151930001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1621940 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1624317 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1624408 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5798ec51{/jq_qp/m,null,AVAILABLE}
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@39fb2736{SSL,[ssl, http/1.1]}{127.0.0.1:32772}
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server Started @1649458ms
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/tempDir-001/control/data, hostContext=/jq_qp/m, hostPort=32772, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/control-001/cores}
[junit4] 2> 1624425 ERROR (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1624425 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-30T16:15:52.837Z
[junit4] 2> 1624643 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1624643 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/control-001/solr.xml
[junit4] 2> 1624646 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1624646 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1624660 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1624733 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43249/solr
[junit4] 2> 1625495 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1625496 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32772_jq_qp%2Fm
[junit4] 2> 1625496 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.Overseer Overseer (id=98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) starting
[junit4] 2> 1625604 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32772_jq_qp%2Fm
[junit4] 2> 1625771 INFO (OverseerStateUpdate-98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1626250 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1626323 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1626323 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1626324 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/control-001/cores
[junit4] 2> 1626644 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1626680 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43249/solr ready
[junit4] 2> 1627232 INFO (qtp993705880-6942) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32772_jq_qp%252Fm&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1627287 INFO (OverseerThreadFactory-2547-thread-1-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1627719 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1627719 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1627863 INFO (zkCallback-1060-thread-1-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1629121 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1629430 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1630031 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1631029 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1631030 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1631030 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1631030 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1631032 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=46.9384765625, floorSegmentMB=0.224609375, forceMergeDeletesPctAllowed=22.71549992634375, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1631047 WARN (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1631338 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1631338 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1631339 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1631339 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1631340 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8093318474821862]
[junit4] 2> 1631340 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e86da91[control_collection_shard1_replica_n1] main]
[junit4] 2> 1631359 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1631359 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1631360 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1631360 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582699810413084672
[junit4] 2> 1631371 INFO (searcherExecutor-2550-thread-1-processing-n:127.0.0.1:32772_jq_qp%2Fm x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2e86da91[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:32772/jq_qp/m/control_collection_shard1_replica_n1/
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:32772/jq_qp/m/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1631398 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1631412 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:32772/jq_qp/m/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1631413 INFO (zkCallback-1060-thread-2-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1631468 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1631469 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3750
[junit4] 2> 1631471 INFO (qtp993705880-6942) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1631578 INFO (zkCallback-1060-thread-2-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1632487 INFO (qtp993705880-6942) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:32772_jq_qp%252Fm&wt=javabin&version=2} status=0 QTime=5255
[junit4] 2> 1632717 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1632717 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43249/solr ready
[junit4] 2> 1632717 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1632732 INFO (qtp993705880-6943) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1632788 INFO (OverseerCollectionConfigSetProcessor-98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1632789 INFO (OverseerThreadFactory-2547-thread-2-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1632789 WARN (OverseerThreadFactory-2547-thread-2-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1633150 INFO (qtp993705880-6943) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1633150 INFO (qtp993705880-6943) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=417
[junit4] 2> 1634155 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001 of type NRT
[junit4] 2> 1634181 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1634182 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@154befc6{/jq_qp/m,null,AVAILABLE}
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1dd9bd24{SSL,[ssl, http/1.1]}{127.0.0.1:34873}
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server Started @1659216ms
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/jq_qp/m, hostPort=34873, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001/cores}
[junit4] 2> 1634183 ERROR (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1634183 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-30T16:16:02.595Z
[junit4] 2> 1634409 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1634409 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001/solr.xml
[junit4] 2> 1634429 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1634429 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1634430 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1634466 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43249/solr
[junit4] 2> 1634799 INFO (OverseerCollectionConfigSetProcessor-98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1634998 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1634999 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1635001 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34873_jq_qp%2Fm
[junit4] 2> 1635205 INFO (zkCallback-1060-thread-1-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1635209 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1635213 INFO (zkCallback-1068-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1635443 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1635517 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1635517 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1635551 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001/cores
[junit4] 2> 1635750 INFO (qtp993705880-6938) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:34873_jq_qp%252Fm&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1635884 INFO (OverseerThreadFactory-2547-thread-3-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:34873_jq_qp%2Fm for creating new replica
[junit4] 2> 1636435 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1636436 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1636454 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1637570 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1637731 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema [collection1_shard1_replica_n21] Schema name=test
[junit4] 2> 1638963 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1639123 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n21' using configuration from collection collection1, trusted=true
[junit4] 2> 1639124 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n21' (registry 'solr.core.collection1.shard1.replica_n21') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1639124 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1639124 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [[collection1_shard1_replica_n21] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001/cores/collection1_shard1_replica_n21], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-1-001/cores/collection1_shard1_replica_n21/data/]
[junit4] 2> 1639139 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=46.9384765625, floorSegmentMB=0.224609375, forceMergeDeletesPctAllowed=22.71549992634375, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1639144 WARN (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1639458 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1639458 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1639459 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1639459 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1639508 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8093318474821862]
[junit4] 2> 1639509 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.SolrIndexSearcher Opening [Searcher@383e9179[collection1_shard1_replica_n21] main]
[junit4] 2> 1639510 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1639510 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1639510 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1639511 INFO (searcherExecutor-2561-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm x:collection1_shard1_replica_n21 s:shard1 c:collection1) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SolrCore [collection1_shard1_replica_n21] Registered new searcher Searcher@383e9179[collection1_shard1_replica_n21] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1639511 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582699818960027648
[junit4] 2> 1639549 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1639582 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1639582 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:34873/jq_qp/m/collection1_shard1_replica_n21/
[junit4] 2> 1639582 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1639582 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.SyncStrategy https://127.0.0.1:34873/jq_qp/m/collection1_shard1_replica_n21/ has no replicas
[junit4] 2> 1639582 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1639585 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:34873/jq_qp/m/collection1_shard1_replica_n21/ shard1
[junit4] 2> 1639598 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1639639 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1639640 INFO (qtp1232459850-6989) [n:127.0.0.1:34873_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n21] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n21&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3205
[junit4] 2> 1639677 INFO (qtp993705880-6938) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:34873_jq_qp%252Fm&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=3926
[junit4] 2> 1639749 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1639825 INFO (OverseerCollectionConfigSetProcessor-98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1640729 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001 of type NRT
[junit4] 2> 1640732 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1640859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2a082e39{/jq_qp/m,null,AVAILABLE}
[junit4] 2> 1640859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2940a90c{SSL,[ssl, http/1.1]}{127.0.0.1:46771}
[junit4] 2> 1640859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server Started @1665892ms
[junit4] 2> 1640859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/jq_qp/m, hostPort=46771, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001/cores}
[junit4] 2> 1640859 ERROR (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1640875 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1640875 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1640875 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1640875 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-30T16:16:09.287Z
[junit4] 2> 1641044 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1641044 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001/solr.xml
[junit4] 2> 1641062 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1641062 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1641131 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1641156 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43249/solr
[junit4] 2> 1641337 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1641338 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1641352 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46771_jq_qp%2Fm
[junit4] 2> 1641407 INFO (zkCallback-1079-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1641647 INFO (zkCallback-1068-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1641680 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1641683 INFO (zkCallback-1060-thread-2-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1642215 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1642288 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1642288 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1642306 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001/cores
[junit4] 2> 1642508 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46771_jq_qp%252Fm&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1642599 INFO (OverseerThreadFactory-2547-thread-4-processing-n:127.0.0.1:32772_jq_qp%2Fm) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46771_jq_qp%2Fm for creating new replica
[junit4] 2> 1642778 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1642778 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1642835 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1643143 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1643273 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.IndexSchema [collection1_shard1_replica_n23] Schema name=test
[junit4] 2> 1645754 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 1645885 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n23' using configuration from collection collection1, trusted=true
[junit4] 2> 1645885 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n23' (registry 'solr.core.collection1.shard1.replica_n23') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@71f578af
[junit4] 2> 1645885 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1645885 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore [[collection1_shard1_replica_n23] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001/cores/collection1_shard1_replica_n23], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-2-001/cores/collection1_shard1_replica_n23/data/]
[junit4] 2> 1645992 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=46.9384765625, floorSegmentMB=0.224609375, forceMergeDeletesPctAllowed=22.71549992634375, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1645994 WARN (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1646667 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1646667 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1646668 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1646668 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1646687 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8093318474821862]
[junit4] 2> 1646687 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.SolrIndexSearcher Opening [Searcher@8a03169[collection1_shard1_replica_n23] main]
[junit4] 2> 1646688 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1646688 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1646689 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1646690 INFO (searcherExecutor-2572-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.SolrCore [collection1_shard1_replica_n23] Registered new searcher Searcher@8a03169[collection1_shard1_replica_n23] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1646690 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582699826487754752
[junit4] 2> 1646783 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.c.ZkController Core needs to recover:collection1_shard1_replica_n23
[junit4] 2> 1646797 INFO (qtp886197962-7019) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 x:collection1_shard1_replica_n23] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n23&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4019
[junit4] 2> 1646797 INFO (updateExecutor-1076-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 1646798 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 1646798 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 1646798 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard1_replica_n23]
[junit4] 2> 1646798 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 1646798 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard1_replica_n23] as recovering, leader is [https://127.0.0.1:34873/jq_qp/m/collection1_shard1_replica_n21/] and I am [https://127.0.0.1:46771/jq_qp/m/collection1_shard1_replica_n23/]
[junit4] 2> 1646799 INFO (qtp993705880-6937) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46771_jq_qp%252Fm&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=4291
[junit4] 2> 1646907 INFO (recoveryExecutor-1077-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm x:collection1_shard1_replica_n23 s:shard1 c:collection1 r:core_node24) [n:127.0.0.1:46771_jq_qp%2Fm c:collection1 s:shard1 r:core_node24 x:collection1_shard1_replica_n23] o.a.s.c.RecoveryStrategy Sending prep recovery command to [https://127.0.0.1:34873/jq_qp/m]; [WaitForState: action=PREPRECOVERY&core=collection1_shard1_replica_n21&nodeName=127.0.0.1:46771_jq_qp%252Fm&coreNodeName=core_node24&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 1646927 INFO (qtp1232459850-6984) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 1646960 INFO (qtp1232459850-6984) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:46771_jq_qp%2Fm, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_n23","base_url":"https://127.0.0.1:46771/jq_qp/m","node_name":"127.0.0.1:46771_jq_qp%2Fm","state":"down","type":"NRT"}
[junit4] 2> 1646960 INFO (zkCallback-1073-thread-1-processing-n:127.0.0.1:34873_jq_qp%2Fm) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1646960 INFO (zkCallback-1079-thread-1-processing-n:127.0.0.1:46771_jq_qp%2Fm) [n:127.0.0.1:46771_jq_qp%2Fm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1647200 INFO (OverseerCollectionConfigSetProcessor-98918737487527941-127.0.0.1:32772_jq_qp%2Fm-n_0000000000) [n:127.0.0.1:32772_jq_qp%2Fm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1647729 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-3-001 of type NRT
[junit4] 2> 1647731 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1647858 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4431649f{/jq_qp/m,null,AVAILABLE}
[junit4] 2> 1647858 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@51627a2b{SSL,[ssl, http/1.1]}{127.0.0.1:40232}
[junit4] 2> 1647859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.Server Started @1672892ms
[junit4] 2> 1647859 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/jq_qp/m, hostPort=40232, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.SyncSliceTest_3A7EC04E2CD5E5BE-001/shard-3-001/cores}
[junit4] 2> 1647859 ERROR (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1647947 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1647947 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1647947 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1647947 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-30T16:16:16.359Z
[junit4] 2> 1648000 INFO (qtp1232459850-6984) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard1, thisCore=collection1_shard1_replica_n21, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:46771_jq_qp%2Fm, coreNodeName=core_node24, onlyIfActiveCheckResult=false, nodeProps: core_node24:{"core":"collection1_shard1_replica_n23","base_url":"https://127.0.0.1:46771/jq_qp/m","node_name":"127.0.0.1:46771_jq_qp%2Fm","state":"recovering","type":"NRT"}
[junit4] 2> 1648000 INFO (qtp1232459850-6984) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node24, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 1648000 INFO (qtp1232459850-6984) [n:127.0.0.1:34873_jq_qp%2Fm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:46771_jq_qp%252Fm&onlyIfLeaderActive=true&core=collection1_shard1_replica_n21&coreNodeName=core_node24&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1073
[junit4] 2> 1648054 INFO (TEST-SyncSliceTest.test-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1648054 INFO (TEST-SyncSliceTest.test-seed
[...truncated too long message...]
loseExecutor-8378-thread-1) [n:127.0.0.1:35590_r%2Fr c:collection1 s:shard1 r:core_node48 x:collection1_shard1_replica_t47] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=1100901239
[junit4] 2> 5368391 INFO (coreCloseExecutor-8378-thread-2) [n:127.0.0.1:35590_r%2Fr c:collection1 s:shard1_0 r:core_node53 x:collection1_shard1_0_replica0] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1_0.replica0, tag=567991971
[junit4] 2> 5368391 INFO (coreCloseExecutor-8378-thread-2) [n:127.0.0.1:35590_r%2Fr c:collection1 s:shard1_0 r:core_node53 x:collection1_shard1_0_replica0] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61f26790: rootName = null, domain = solr.core.collection1.shard1_0.replica0, service url = null, agent id = null] for registry solr.core.collection1.shard1_0.replica0 / com.codahale.metrics.MetricRegistry@13a8b791
[junit4] 2> 5368411 INFO (coreCloseExecutor-8378-thread-2) [n:127.0.0.1:35590_r%2Fr c:collection1 s:shard1_0 r:core_node53 x:collection1_shard1_0_replica0] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1_0.leader, tag=567991971
[junit4] 2> 5368480 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.Overseer Overseer (id=98918975346114578-127.0.0.1:35590_r%2Fr-n_0000000004) closing
[junit4] 2> 5368481 INFO (OverseerStateUpdate-98918975346114578-127.0.0.1:35590_r%2Fr-n_0000000004) [n:127.0.0.1:35590_r%2Fr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35590_r%2Fr
[junit4] 2> 5368489 WARN (OverseerAutoScalingTriggerThread-98918975346114578-127.0.0.1:35590_r%2Fr-n_0000000004) [n:127.0.0.1:35590_r%2Fr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 5368631 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@90fe02f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 5368631 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2e1e2679{/r/r,null,UNAVAILABLE}
[junit4] 2> 5368633 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 43058
[junit4] 2> 5368633 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 5368643 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[3A7EC04E2CD5E5BE]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40635 40635
[junit4] 2> 5368725 INFO (Thread-4605) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:40635 40635
[junit4] 2> 5368727 WARN (Thread-4605) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/collection1/state.json
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/98918975346114569-127.0.0.1:35998_r%2Fr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/overseer/queue-work
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_3A7EC04E2CD5E5BE-001
[junit4] 2> Oct 30, 2017 5:18:17 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {shard_s=Lucene50(blocksize=128), rnd_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_t=Lucene50(blocksize=128), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{shard_s=DocValuesFormat(name=Lucene70), rnd_b=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene70), n_ti=DocValuesFormat(name=Lucene70), a_t=DocValuesFormat(name=Lucene70), a_i=DocValuesFormat(name=Asserting), id=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1104, maxMBSortInHeap=5.456224312864892, sim=RandomSimilarity(queryNorm=false): {}, locale=sq, timezone=US/Arizona
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=72824168,total=515375104
[junit4] 2> NOTE: All tests run in this JVM: [TestUninvertingReader, TestCollationFieldDocValues, DistribCursorPagingTest, DeleteReplicaTest, SpellCheckCollatorTest, SolrInfoBeanTest, TestBadConfig, TestCrossCoreJoin, QueryParsingTest, TestInitParams, TestConfigReload, UpdateParamsTest, TestLegacyNumericRangeQueryBuilder, TestStressCloudBlindAtomicUpdates, OverseerTaskQueueTest, SearchHandlerTest, TestIndexingPerformance, RAMDirectoryFactoryTest, CleanupOldIndexTest, BlockJoinFacetSimpleTest, BigEndianAscendingWordDeserializerTest, TestComponentsName, ReplicaListTransformerTest, TestSubQueryTransformerCrossCore, MoveReplicaTest, NodeLostTriggerTest, TestMultiWordSynonyms, TestDynamicLoading, BJQParserTest, TestRequestStatusCollectionAPI, JsonLoaderTest, TlogReplayBufferedWhileIndexingTest, IndexSchemaRuntimeFieldTest, StatelessScriptUpdateProcessorFactoryTest, SolrMetricReporterTest, TestFieldTypeResource, HdfsRecoveryZkTest, BasicFunctionalityTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestFoldingMultitermQuery, TestDownShardTolerantSearch, TestTrackingShardHandlerFactory, TestSuggestSpellingConverter, SimpleCollectionCreateDeleteTest, TestManagedSchemaAPI, TestLRUStatsCache, TestTlogReplica, AnalysisAfterCoreReloadTest, BlockCacheTest, SpellCheckCollatorWithCollapseTest, TestRecovery, OutOfBoxZkACLAndCredentialsProvidersTest, SyncSliceTest, TestGraphTermsQParserPlugin, UpdateLogTest, DateFieldTest, TestMergePolicyConfig, TestBinaryField, CollectionStateFormat2Test, MissingSegmentRecoveryTest, TestEmbeddedSolrServerSchemaAPI, TestCustomSort, DistributedFacetPivotWhiteBoxTest, PreAnalyzedFieldManagedSchemaCloudTest, TestMultiValuedNumericRangeQuery, ChangedSchemaMergeTest, TestFieldCache, MetricsConfigTest, TestDistributedSearch, TestSolrDeletionPolicy1, ExternalFileFieldSortTest, DocValuesTest, CacheHeaderTest, DistributedSuggestComponentTest, TestPHPSerializedResponseWriter, DistributedFacetPivotLongTailTest, WrapperMergePolicyFactoryTest, SliceStateTest, TestSolrJ, TestTestInjection, TestLuceneIndexBackCompat, TestCloudInspectUtil, TestRawResponseWriter, HLLUtilTest, ActionThrottleTest, TestUnifiedSolrHighlighter, TestShardHandlerFactory, CollectionsAPISolrJTest, TestHdfsUpdateLog, HdfsCollectionsAPIDistributedZkTest, SpellCheckComponentTest, TestConfigSets, StatsReloadRaceTest, TestImpersonationWithHadoopAuth, TestRebalanceLeaders, TestCSVLoader, TestConfig, HttpSolrCallGetCoreTest, DistributedQueryElevationComponentTest, TestRandomCollapseQParserPlugin, RuleEngineTest, HdfsWriteToMultipleCollectionsTest, UpdateRequestProcessorFactoryTest, TestReqParamsAPI, TestCloudPseudoReturnFields, TestGraphMLResponseWriter, TestSchemaManager, TestJsonRequest, URLClassifyProcessorTest, TestSolrXml, ForceLeaderTest, RequestLoggingTest, DirectUpdateHandlerOptimizeTest, TestCryptoKeys, TestConfigsApi, TestRandomFaceting, TestLeaderElectionWithEmptyReplica, TestPayloadCheckQParserPlugin, ZkStateReaderTest, HdfsBasicDistributedZkTest, OverseerModifyCollectionTest, TestDistribIDF, TestPhraseSuggestions, DistanceUnitsTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, ClusterStateUpdateTest, TestRandomDVFaceting, TestHashPartitioner, ZkControllerTest, TestJoin, DistributedTermsComponentTest, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestLazyCores, HighlighterTest, ShowFileRequestHandlerTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, CoreAdminHandlerTest, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, TestWordDelimiterFilterFactory, QueryEqualityTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DistanceFunctionTest, LukeRequestHandlerTest, TestQueryUtils, TestWriterPerf, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, PathHierarchyTokenizerFactoryTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, SolrPluginUtilsTest, ReturnFieldsTest, PingRequestHandlerTest, CSVRequestHandlerTest, TestLFUCache, TestHighlightDedupGrouping, TestEmbeddedSolrServerAdminHandler, AddReplicaTest, AssignTest, CollectionReloadTest, ConfigSetsAPITest, ConnectionManagerTest, CustomCollectionTest, LeaderElectionContextKeyTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MultiThreadedOCPTest, ShardSplitTest]
[junit4] Completed [562/746 (5!)] on J0 in 622.82s, 5 tests, 1 failure <<< FAILURES!
[...truncated 47853 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2135 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2135/
1 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:36415_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:36415_solr wasn't created
at __randomizedtesting.SeedInfo.seed([4440D3A576D2CAEE:5CFA5BA978E70701]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12615 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 2186818 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/init-core-data-001
[junit4] 2> 2186819 WARN (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 2186819 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2186821 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2186821 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/tempDir-001
[junit4] 2> 2186821 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2186821 INFO (Thread-2133) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2186821 INFO (Thread-2133) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2186839 ERROR (Thread-2133) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2186922 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:34297
[junit4] 2> 2186980 INFO (jetty-launcher-2580-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2186998 INFO (jetty-launcher-2580-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51a4617e{/solr,null,AVAILABLE}
[junit4] 2> 2186999 INFO (jetty-launcher-2580-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@229df5a7{SSL,[ssl, http/1.1]}{127.0.0.1:33156}
[junit4] 2> 2186999 INFO (jetty-launcher-2580-thread-1) [ ] o.e.j.s.Server Started @2198769ms
[junit4] 2> 2186999 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33156}
[junit4] 2> 2186999 ERROR (jetty-launcher-2580-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2187000 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2187000 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2187000 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2187000 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:11:28.446Z
[junit4] 2> 2187035 INFO (jetty-launcher-2580-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2187036 INFO (jetty-launcher-2580-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5afe193e{/solr,null,AVAILABLE}
[junit4] 2> 2187036 INFO (jetty-launcher-2580-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@69ac9a84{SSL,[ssl, http/1.1]}{127.0.0.1:33368}
[junit4] 2> 2187036 INFO (jetty-launcher-2580-thread-2) [ ] o.e.j.s.Server Started @2198806ms
[junit4] 2> 2187036 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33368}
[junit4] 2> 2187037 ERROR (jetty-launcher-2580-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2187037 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2187037 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2187037 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2187037 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:11:28.483Z
[junit4] 2> 2187084 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2187087 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2187160 INFO (jetty-launcher-2580-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34297/solr
[junit4] 2> 2187163 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f691de71c0001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2187200 INFO (jetty-launcher-2580-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34297/solr
[junit4] 2> 2188506 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2188540 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33156_solr
[junit4] 2> 2188542 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.Overseer Overseer (id=98913293977780230-127.0.0.1:33156_solr-n_0000000000) starting
[junit4] 2> 2188576 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2188637 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33156_solr
[junit4] 2> 2188637 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 2188650 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33368_solr
[junit4] 2> 2188698 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2188698 INFO (OverseerStateUpdate-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2188698 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr]
[junit4] 2> 2188698 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 2188698 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2188714 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2188714 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2188844 INFO (zkCallback-2591-thread-1-processing-n:127.0.0.1:33368_solr) [n:127.0.0.1:33368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2188715 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr]
[junit4] 2> 2189152 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33156.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189171 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33368.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189225 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33368.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189226 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33368.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189244 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33156.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189244 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33156.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2189245 INFO (jetty-launcher-2580-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/tempDir-001/node1/.
[junit4] 2> 2189245 INFO (jetty-launcher-2580-thread-2) [n:127.0.0.1:33368_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/tempDir-001/node2/.
[junit4] 2> 2189434 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2189434 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2189579 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testNodeAddedTriggerRestoreState
[junit4] 2> 2189579 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 2189579 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 2189589 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 2189626 WARN (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers Failed to remove state for removed trigger /autoscaling/triggerState/.auto_add_replicas
[junit4] 2> java.util.NoSuchElementException: /autoscaling/triggerState/.auto_add_replicas
[junit4] 2> at org.apache.solr.client.solrj.impl.ZkDistribStateManager.removeData(ZkDistribStateManager.java:114)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.removeTriggerZKData(ScheduledTriggers.java:366)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.remove(ScheduledTriggers.java:358)
[junit4] 2> at org.apache.solr.cloud.autoscaling.OverseerTriggerThread.run(OverseerTriggerThread.java:202)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2189644 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2189644 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2189644 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 2189825 INFO (qtp908744980-11290) [n:127.0.0.1:33368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2189825 INFO (qtp908744980-11290) [n:127.0.0.1:33368_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2189955 INFO (qtp646291536-11280) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2189957 INFO (qtp908744980-11286) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2189958 DEBUG (qtp908744980-11290) [n:127.0.0.1:33368_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2189972 INFO (qtp908744980-11290) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=219
[junit4] 2> 2189973 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2189984 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2f21724{/solr,null,AVAILABLE}
[junit4] 2> 2189984 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4bbdb22d{SSL,[ssl, http/1.1]}{127.0.0.1:44672}
[junit4] 2> 2189984 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.Server Started @2201754ms
[junit4] 2> 2189984 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44672}
[junit4] 2> 2189985 ERROR (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2190000 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2190000 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2190000 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2190000 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:11:31.446Z
[junit4] 2> 2190001 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 2190085 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr]
[junit4] 2> 2190085 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_restore_trigger instantiated with properties: {event=nodeAdded, waitFor=5, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 2190085 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2190101 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 2190114 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2190219 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2190219 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 2190247 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_restore_trigger
[junit4] 2> 2190265 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr]
[junit4] 2> 2190284 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34297/solr
[junit4] 2> 2190636 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2190637 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2190651 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44672_solr
[junit4] 2> 2190652 INFO (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2190653 INFO (zkCallback-2599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2190704 INFO (zkCallback-2607-thread-1-processing-n:127.0.0.1:44672_solr) [n:127.0.0.1:44672_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2190707 INFO (zkCallback-2591-thread-2-processing-n:127.0.0.1:33368_solr) [n:127.0.0.1:33368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2190861 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44672.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2190911 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44672.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2190911 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44672.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2190912 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:44672_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/tempDir-001/node3/.
[junit4] 2> 2191321 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_restore_trigger
[junit4] 2> 2191321 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2191322 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:44672_solr at time 1509297092768000000
[junit4] 2> 2192379 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_restore_trigger
[junit4] 2> 2192380 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2192742 INFO (qtp646291536-11277) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2192758 INFO (qtp646291536-11277) [n:127.0.0.1:33156_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2192771 INFO (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2192788 INFO (qtp908744980-11292) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2192903 INFO (qtp667399567-11344) [n:127.0.0.1:44672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2192903 DEBUG (qtp646291536-11277) [n:127.0.0.1:33156_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2192921 INFO (qtp646291536-11277) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=278
[junit4] 2> 2192933 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 2192933 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2192933 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_restore_trigger instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 2192941 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 2192961 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2192977 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Adding node from marker path: 127.0.0.1:44672_solr
[junit4] 2> 2193014 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2193022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_restore_trigger
[junit4] 2> 2193022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_restore_trigger firing registered processor for nodes: [127.0.0.1:44672_solr] added at times [1509297094424000000], now=1509297094468000000
[junit4] 2> 2193023 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"14f219b5f5abf600T40du85bhuugim1l4kcty5ab10",
[junit4] 2> "source":"node_added_restore_trigger",
[junit4] 2> "eventTime":1509297094424000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297094424000000],
[junit4] 2> "nodeNames":["127.0.0.1:44672_solr"]}}
[junit4] 2> 2193023 INFO (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2193034 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 2193046 DEBUG (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"14f219b5f5abf600T40du85bhuugim1l4kcty5ab10",
[junit4] 2> "source":"node_added_restore_trigger",
[junit4] 2> "eventTime":1509297094424000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297094424000000],
[junit4] 2> "_enqueue_time_":1509297094469000000,
[junit4] 2> "nodeNames":["127.0.0.1:44672_solr"]}}
[junit4] 2> 2193059 INFO (TEST-TriggerIntegrationTest.testNodeAddedTriggerRestoreState-seed#[4440D3A576D2CAEE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testNodeAddedTriggerRestoreState
[junit4] 2> 2193207 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTriggerThrottling
[junit4] 2> 2193207 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 5
[junit4] 2> 2193207 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 5
[junit4] 2> 2193207 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 5
[junit4] 2> 2193242 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2193242 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2193243 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 5, lastZnodeVersion 5
[junit4] 2> 2193279 INFO (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2193280 INFO (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2193319 INFO (qtp646291536-11275) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193352 INFO (qtp908744980-11285) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193354 INFO (qtp667399567-11345) [n:127.0.0.1:44672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193355 DEBUG (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2193405 INFO (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=183
[junit4] 2> 2193425 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 6
[junit4] 2> 2193426 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193426 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2193426 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 6
[junit4] 2> 2193427 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2193427 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2193427 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 6, lastZnodeVersion 6
[junit4] 2> 2193427 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2193427 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193450 INFO (qtp646291536-11274) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2193450 INFO (qtp646291536-11274) [n:127.0.0.1:33156_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2193450 INFO (qtp646291536-11279) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193451 INFO (qtp908744980-11285) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193478 INFO (qtp667399567-11338) [n:127.0.0.1:44672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2193486 DEBUG (qtp646291536-11274) [n:127.0.0.1:33156_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2193523 INFO (qtp646291536-11274) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=117
[junit4] 2> 2193555 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 7
[junit4] 2> 2193571 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193571 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2193592 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193592 DEBUG (zkCallback-2592-thread-2-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2193592 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 7
[junit4] 2> 2193718 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2193727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2193754 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 2193771 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a8c28af{/solr,null,AVAILABLE}
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@702d8fc3{SSL,[ssl, http/1.1]}{127.0.0.1:43977}
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.Server Started @2205542ms
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43977}
[junit4] 2> 2193772 ERROR (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2193772 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-29T17:11:35.218Z
[junit4] 2> 2193775 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 7, lastZnodeVersion 7
[junit4] 2> 2193775 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2193775 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2193852 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2193997 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34297/solr
[junit4] 2> 2194144 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2194145 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2194180 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43977_solr
[junit4] 2> 2194181 INFO (zkCallback-2607-thread-1-processing-n:127.0.0.1:44672_solr) [n:127.0.0.1:44672_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2194267 INFO (zkCallback-2591-thread-2-processing-n:127.0.0.1:33368_solr) [n:127.0.0.1:33368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2194268 INFO (zkCallback-2599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2194268 INFO (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2194389 INFO (zkCallback-2622-thread-1-processing-n:127.0.0.1:43977_solr) [n:127.0.0.1:43977_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2194434 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2194434 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2194434 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:43977_solr at time 1509297095880000000
[junit4] 2> 2194434 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297095880000000], now=1509297095880000000
[junit4] 2> 2194434 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab12",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2194434 INFO (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2194889 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2194890 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2194890 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:43977_solr at time 1509297096336000000
[junit4] 2> 2194890 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297096336000000
[junit4] 2> 2194890 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab14",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2194890 INFO (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2195146 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43977.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2195257 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43977.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2195257 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43977.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@271c863a
[junit4] 2> 2195259 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [n:127.0.0.1:43977_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001/tempDir-001/node4/.
[junit4] 2> 2195768 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2195768 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2195768 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297095880000000], now=1509297097214000000
[junit4] 2> 2195769 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab16",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2195935 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2195935 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2195935 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297097381000000
[junit4] 2> 2195935 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab17",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2196778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2196778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2196778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297095880000000], now=1509297098224000000
[junit4] 2> 2196778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab18",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2196944 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2196944 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2196945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297098391000000
[junit4] 2> 2196945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab19",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2197778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2197778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2197778 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297095880000000], now=1509297099224000000
[junit4] 2> 2197779 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab1a",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2197945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2197945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2197945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297099391000000
[junit4] 2> 2197945 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1b",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2198800 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2198800 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2198800 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297095880000000], now=1509297100246000000
[junit4] 2> 2198800 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab1c",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2198801 DEBUG (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"14f219b64c74c200T40du85bhuugim1l4kcty5ab1c",
[junit4] 2> "source":"node_added_trigger1",
[junit4] 2> "eventTime":1509297095880000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297095880000000],
[junit4] 2> "_enqueue_time_":1509297100246000000,
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2198802 INFO (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.ActionThrottle The last action attempt started 5755ms ago.
[junit4] 2> 2198802 INFO (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger1
[junit4] 2> 2198983 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2198983 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2198983 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297100429000000
[junit4] 2> 2198983 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1d",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2199804 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2199805 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2200008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2200008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2200008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297101454000000
[junit4] 2> 2200008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1e",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2200809 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2200809 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2201008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2201008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2201008 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297102454000000
[junit4] 2> 2201009 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1f",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2201814 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2201814 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2202013 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2202013 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2202013 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297103459000000
[junit4] 2> 2202013 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1g",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2202818 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2202818 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2203022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2203022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2203022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297104468000000
[junit4] 2> 2203022 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1h",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2203828 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2203828 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204031 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2204031 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204031 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 firing registered processor for nodes: [127.0.0.1:43977_solr] added at times [1509297096336000000], now=1509297105477000000
[junit4] 2> 2204031 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers ++++++++ Cooldown inactive - processing event: {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1i",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2204032 DEBUG (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for {
[junit4] 2> "id":"14f219b667a2c400T40du85bhuugim1l4kcty5ab1i",
[junit4] 2> "source":"node_added_trigger2",
[junit4] 2> "eventTime":1509297096336000000,
[junit4] 2> "eventType":"NODEADDED",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297096336000000],
[junit4] 2> "_enqueue_time_":1509297105477000000,
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2204032 INFO (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.ActionThrottle The last action attempt started 5230ms ago.
[junit4] 2> 2204032 INFO (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest last action at 1509297100248000000 time = 1509297105478000000
[junit4] 2> 2204032 INFO (AutoscalingActionExecutor-3857-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest action executed from node_added_trigger2
[junit4] 2> 2204122 INFO (qtp646291536-11279) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2204122 INFO (qtp646291536-11279) [n:127.0.0.1:33156_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2204157 INFO (qtp646291536-11277) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204483 INFO (qtp1449952345-11378) [n:127.0.0.1:43977_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204503 INFO (qtp908744980-11285) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204505 INFO (qtp667399567-11338) [n:127.0.0.1:44672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204505 DEBUG (qtp646291536-11279) [n:127.0.0.1:33156_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2204540 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 8
[junit4] 2> 2204540 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204540 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2204543 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204543 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204543 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2204543 INFO (qtp646291536-11279) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=495
[junit4] 2> 2204544 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 8
[junit4] 2> 2204545 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2204545 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 8, lastZnodeVersion 8
[junit4] 2> 2204545 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204634 INFO (qtp646291536-11275) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2204634 INFO (qtp646291536-11275) [n:127.0.0.1:33156_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34297/solr ready
[junit4] 2> 2204637 INFO (qtp646291536-11278) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204639 INFO (qtp1449952345-11379) [n:127.0.0.1:43977_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204640 INFO (qtp908744980-11285) [n:127.0.0.1:33368_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204640 INFO (qtp667399567-11338) [n:127.0.0.1:44672_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 2204640 DEBUG (qtp646291536-11275) [n:127.0.0.1:33156_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 2204654 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 9
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger2 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger1 instantiated with properties: {event=nodeAdded, waitFor=0, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$ThrottlingTesterAction}], enabled=true}
[junit4] 2> 2204655 DEBUG (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204655 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 9
[junit4] 2> 2204655 INFO (qtp646291536-11275) [n:127.0.0.1:33156_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=91
[junit4] 2> 2204691 INFO (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 2204692 DEBUG (OverseerAutoScalingTriggerThread-98913293977780230-127.0.0.1:33156_solr-n_0000000000) [n:127.0.0.1:33156_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 9, lastZnodeVersion 9
[junit4] 2> 2204727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@702d8fc3{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 2204727 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=573206908
[junit4] 2> 2204739 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204780 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2204780 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f933c6: rootName = solr_43977, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@60bdecc3
[junit4] 2> 2204818 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2204818 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@774288de: rootName = solr_43977, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@50c3ebad
[junit4] 2> 2204828 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2204828 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:43977_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2204855 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2204855 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@64521740: rootName = solr_43977, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@47cfd084
[junit4] 2> 2204870 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:43977_solr
[junit4] 2> 2204871 INFO (zkCallback-2599-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2204871 INFO (zkCallback-2592-thread-1-processing-n:127.0.0.1:33156_solr) [n:127.0.0.1:33156_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2204871 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2204906 INFO (zkCallback-2607-thread-1-processing-n:127.0.0.1:44672_solr) [n:127.0.0.1:44672_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2204906 INFO (zkCallback-2622-thread-1-processing-n:127.0.0.1:43977_solr) [n:127.0.0.1:43977_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2204906 INFO (zkCallback-2591-thread-2-processing-n:127.0.0.1:33368_solr) [n:127.0.0.1:33368_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 2204907 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2204908 INFO (TEST-TriggerIntegrationTest.testTriggerThrottling-seed#[4440D3A576D2CAEE]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4a8c28af{/solr,null,UNAVAILABLE}
[junit4] 2> 2205034 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2205034 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2205546 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2205546 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:43977_solr
[junit4] 2> 2205546 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:43977_solr]
[junit4] 2> 2205546 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b8e2c86c00T40du85bhuugim1l4kcty5ab1j",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":1509297106992000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297106992000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2205546 INFO (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2205546 DEBUG (ScheduledTrigger-3856-thread-1) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger listener for lost nodes: [127.0.0.1:43977_solr] is not ready, will try later
[junit4] 2> 2205780 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2205780 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Tracking lost node: 127.0.0.1:43977_solr
[junit4] 2> 2205780 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:43977_solr]
[junit4] 2> 2205780 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b8f0bafa80T40du85bhuugim1l4kcty5ab1l",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":1509297107226000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297107226000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2205780 INFO (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 2205780 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger listener for lost nodes: [127.0.0.1:43977_solr] is not ready, will try later
[junit4] 2> 2205836 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2205836 DEBUG (ScheduledTrigger-3856-thread-2) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2206072 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[junit4] 2> 2206072 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2206549 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger1 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2206549 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:43977_solr]
[junit4] 2> 2206549 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b8e2c86c00T40du85bhuugim1l4kcty5ab1n",
[junit4] 2> "source":"node_lost_trigger1",
[junit4] 2> "eventTime":1509297106992000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297106992000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2206549 DEBUG (ScheduledTrigger-3856-thread-4) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger listener for lost nodes: [127.0.0.1:43977_solr] is not ready, will try later
[junit4] 2> 2206804 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger2 with currently live nodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2206804 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger firing registered processor for lost nodes: [127.0.0.1:43977_solr]
[junit4] 2> 2206805 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.ScheduledTriggers -------- Cooldown period - rejecting event: {
[junit4] 2> "id":"14f219b8f0bafa80T40du85bhuugim1l4kcty5ab1o",
[junit4] 2> "source":"node_lost_trigger2",
[junit4] 2> "eventTime":1509297107226000000,
[junit4] 2> "eventType":"NODELOST",
[junit4] 2> "properties":{
[junit4] 2> "eventTimes":[1509297107226000000],
[junit4] 2> "nodeNames":["127.0.0.1:43977_solr"]}}
[junit4] 2> 2206805 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeLostTrigger NodeLostTrigger listener for lost nodes: [127.0.0.1:43977_solr] is not ready, will try later
[junit4] 2> 2206841 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger1
[junit4] 2> 2206841 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:33156_solr, 127.0.0.1:33368_solr, 127.0.0.1:44672_solr]
[junit4] 2> 2207081 DEBUG (ScheduledTrigger-3856-thread-3) [n:127.0.0.1:33156_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger2
[
[...truncated too long message...]
2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$0(SolrZkClient.java:262)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2317569 WARN (zkCallback-2707-thread-1-processing-n:127.0.0.1:43249_solr) [n:127.0.0.1:43249_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:43524_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:43524_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$create$7(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$1.lambda$process$0(SolrZkClient.java:262)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2317574 INFO (jetty-closer-2581-thread-6) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@448e4eef{/solr,null,UNAVAILABLE}
[junit4] 2> 2317715 WARN (zkCallback-2689-thread-1-processing-n:127.0.0.1:44134_solr) [n:127.0.0.1:44134_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2317732 INFO (jetty-closer-2581-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b016c46{/solr,null,UNAVAILABLE}
[junit4] 2> 2317756 ERROR (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2317777 INFO (SUITE-TriggerIntegrationTest-seed#[4440D3A576D2CAEE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34297 34297
[junit4] 2> 2317919 INFO (Thread-2133) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34297 34297
[junit4] 2> 2317920 WARN (Thread-2133) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/aliases.json
[junit4] 2> 16 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/clusterprops.json
[junit4] 2> 39 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/98913293977780236-127.0.0.1:44672_solr-n_0000000002
[junit4] 2> 2 /solr/overseer_elect/election/98913293977780255-127.0.0.1:32830_solr-n_0000000006
[junit4] 2> 2 /solr/overseer_elect/election/98913293977780251-127.0.0.1:37086_solr-n_0000000005
[junit4] 2> 2 /solr/overseer_elect/election/98913293977780278-127.0.0.1:43249_solr-n_0000000011
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/live_nodes
[junit4] 2> 39 /solr/collections
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/queue
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 3 /solr/autoscaling/events/node_added_trigger
[junit4] 2> 2 /solr/autoscaling/events/node_lost_trigger
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_4440D3A576D2CAEE-001
[junit4] 2> Oct 29, 2017 5:13:39 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=4513, maxDocsPerChunk=667, blockSize=858), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=4513, blockSize=858)), sim=RandomSimilarity(queryNorm=true): {}, locale=ar-LB, timezone=SystemV/YST9
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_152 (64-bit)/cpus=4,threads=1,free=245696152,total=528482304
[junit4] 2> NOTE: All tests run in this JVM: [TestConfigSetsAPIExclusivity, SolrCmdDistributorTest, TestFastLRUCache, QueryResultKeyTest, HighlighterConfigTest, SuggesterFSTTest, TestPerFieldSimilarity, LeaderFailoverAfterPartitionTest, TestFastWriter, ZkStateWriterTest, TestSolrConfigHandlerCloud, LukeRequestHandlerTest, TestOrdValues, TestHttpShardHandlerFactory, TestFaceting, MultiThreadedOCPTest, TestSolr4Spatial, TestSolrCloudSnapshots, SolrCoreMetricManagerTest, NumberUtilsTest, SparseHLLTest, TestStressLucene, OpenExchangeRatesOrgProviderTest, TestCoreAdminApis, TestLockTree, TestJavabinTupleStreamParser, DebugComponentTest, TestAuthorizationFramework, TestSizeLimitedDistributedMap, TestSmileRequest, BigEndianAscendingWordSerializerTest, BlockJoinFacetDistribTest, TestJmxIntegration, VersionInfoTest, TestSimpleTextCodec, ShowFileRequestHandlerTest, PathHierarchyTokenizerFactoryTest, TestNRTOpen, TestNumericTerms32, NumericFieldsTest, ChaosMonkeySafeLeaderWithPullReplicasTest, RequestHandlersTest, TestExportWriter, TestAuthenticationFramework, TestSolrQueryParser, TestComplexPhraseLeadingWildcard, ClassificationUpdateProcessorTest, CircularListTest, TestRestoreCore, ZkSolrClientTest, TestCollationField, ShardRoutingCustomTest, StressHdfsTest, TolerantUpdateProcessorTest, FullHLLTest, TestLuceneMatchVersion, ReplaceNodeTest, TestSchemaNameResource, SOLR749Test, TestPseudoReturnFields, TestPrepRecovery, OpenCloseCoreStressTest, TestSha256AuthenticationProvider, SuggestComponentTest, TestQuerySenderNoQuery, NotRequiredUniqueKeyTest, SynonymTokenizerTest, SpellingQueryConverterTest, DistributedIntervalFacetingTest, TestWriterPerf, BasicAuthIntegrationTest, GraphQueryTest, AnalyticsMergeStrategyTest, CloudMLTQParserTest, SolrCloudReportersTest, TestDocumentBuilder, DistributedTermsComponentTest, SolrIndexSplitterTest, RulesTest, DirectUpdateHandlerTest, TestCursorMarkWithoutUniqueKey, QueryEqualityTest, TestReplicaProperties, TestFreeTextSuggestions, PeerSyncReplicationTest, DistributedFacetExistsSmallTest, InfoHandlerTest, ResponseHeaderTest, CurrencyFieldTypeTest, TestLazyCores, TestAtomicUpdateErrorCases, SmileWriterTest, ZkCLITest, TestReloadDeadlock, PrimUtilsTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DeleteShardTest, TriggerIntegrationTest]
[junit4] Completed [278/746 (1!)] on J1 in 132.13s, 11 tests, 1 failure <<< FAILURES!
[...truncated 48736 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2134 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2134/
11 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:AB5434FC8D0783B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestLocalFSCloudBackupRestore.test
Error Message:
Could not load collection from ZK: backuprestore
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: backuprestore
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:7BACEF3A5A595849]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:218)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/backuprestore/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 44 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates
Error Message:
Expect new leader null Live Nodes: [127.0.0.1:52587_solr] Last available state: DocCollection(tlog_replica_test_out_of_order_db_qwith_in_place_updates//collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json/8)={ "pullReplicas":"0", "replicationFactor":"0", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1", "base_url":"https://127.0.0.1:52587/solr", "node_name":"127.0.0.1:52587_solr", "state":"active", "type":"TLOG"}, "core_node4":{ "core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2", "base_url":"https://127.0.0.1:48784/solr", "node_name":"127.0.0.1:48784_solr", "state":"down", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"100", "autoAddReplicas":"false", "nrtReplicas":"0", "tlogReplicas":"2"}
Stack Trace:
java.lang.AssertionError: Expect new leader
null
Live Nodes: [127.0.0.1:52587_solr]
Last available state: DocCollection(tlog_replica_test_out_of_order_db_qwith_in_place_updates//collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json/8)={
"pullReplicas":"0",
"replicationFactor":"0",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1",
"base_url":"https://127.0.0.1:52587/solr",
"node_name":"127.0.0.1:52587_solr",
"state":"active",
"type":"TLOG"},
"core_node4":{
"core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2",
"base_url":"https://127.0.0.1:48784/solr",
"node_name":"127.0.0.1:48784_solr",
"state":"down",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"100",
"autoAddReplicas":"false",
"nrtReplicas":"0",
"tlogReplicas":"2"}
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:7539280DABF4E351]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates(TestTlogReplica.java:679)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud
Error Message:
Error from server at http://127.0.0.1:58017/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58017/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1094)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.TestTolerantUpdateProcessorRandomCloud.createMiniSolrCloudCluster(TestTolerantUpdateProcessorRandomCloud.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TriLevelCompositeIdRoutingTest.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:7BACEF3A5A595849]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getTotalReplicas(AbstractFullDistribZkTestBase.java:488)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:441)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 38 more
FAILED: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:A4D12B552F57D7AA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testReadApi(AutoScalingHandlerTest.java:711)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.testSuspendTrigger
Error Message:
KeeperErrorCode = Session expired for /autoscaling.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling.json
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:31FEE99BB60D7410]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1327)
at org.apache.solr.common.cloud.SolrZkClient.lambda$setData$6(SolrZkClient.java:344)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:344)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:532)
at org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest.beforeTest(AutoScalingHandlerTest.java:98)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test
Error Message:
Trigger was not fired
Stack Trace:
java.lang.AssertionError: Trigger was not fired
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:7BACEF3A5A595849]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:151)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.rule.RulesTest.testPortRule
Error Message:
Error from server at http://127.0.0.1:40242/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000008
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40242/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000008
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:CB58C57D55F5CDCF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1094)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:875)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:444)
at org.apache.solr.cloud.rule.RulesTest.removeCollections(RulesTest.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds
Error Message:
searcher529 wasn't soon enough after soft529: Took 882ms, >= acceptable 816ms (fudge)
Stack Trace:
java.lang.AssertionError: searcher529 wasn't soon enough after soft529: Took 882ms, >= acceptable 816ms (fudge)
at __randomizedtesting.SeedInfo.seed([F3F8D0E0F4A535B1:A22C296045D60516]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.update.SoftAutoCommitTest.doTestSoftAndHardCommitMaxTimeMixedAdds(SoftAutoCommitTest.java:240)
at org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeMixedAdds(SoftAutoCommitTest.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.stream.JDBCStreamTest.testJDBCSolrInnerJoinExpression
Error Message:
Could not load collection from ZK: jdbc_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: jdbc_collection
at __randomizedtesting.SeedInfo.seed([EC61B0EEC2A508C1:A25C96BF396C28BD]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1196)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:840)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:808)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.io.stream.JDBCStreamTest.cleanIndex(JDBCStreamTest.java:118)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/jdbc_collection/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 45 more
Build Log:
[...truncated 11905 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.AutoScalingHandlerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/init-core-data-001
[junit4] 2> 1713345 WARN (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 1713345 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1713347 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1713348 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1713348 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/tempDir-001
[junit4] 2> 1713349 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1713383 INFO (Thread-369) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1713383 INFO (Thread-369) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1713481 ERROR (Thread-369) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1713500 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:43073
[junit4] 2> 1713782 INFO (jetty-launcher-395-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1713783 INFO (jetty-launcher-395-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1713784 INFO (jetty-launcher-395-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7075ce8a{/solr,null,AVAILABLE}
[junit4] 2> 1713785 INFO (jetty-launcher-395-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6b6a34{SSL,[ssl, http/1.1]}{127.0.0.1:46964}
[junit4] 2> 1713785 INFO (jetty-launcher-395-thread-2) [ ] o.e.j.s.Server Started @1732363ms
[junit4] 2> 1713785 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46964}
[junit4] 2> 1713793 ERROR (jetty-launcher-395-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1713793 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1713793 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1713793 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1713793 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-27T18:38:46.361Z
[junit4] 2> 1714117 INFO (jetty-launcher-395-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f7839cf{/solr,null,AVAILABLE}
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4862a5cb{SSL,[ssl, http/1.1]}{127.0.0.1:53019}
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.e.j.s.Server Started @1732708ms
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=53019}
[junit4] 2> 1714131 ERROR (jetty-launcher-395-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1714131 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-27T18:38:46.699Z
[junit4] 2> 1714232 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1714264 INFO (jetty-launcher-395-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43073/solr
[junit4] 2> 1714281 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1715648 INFO (jetty-launcher-395-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43073/solr
[junit4] 2> 1715921 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1715921 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53019_solr
[junit4] 2> 1715928 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.c.Overseer Overseer (id=98902312617508870-127.0.0.1:53019_solr-n_0000000000) starting
[junit4] 2> 1716051 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53019_solr
[junit4] 2> 1716052 INFO (zkCallback-408-thread-1-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1716489 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1716490 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1716491 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46964_solr
[junit4] 2> 1717884 INFO (zkCallback-403-thread-1-processing-n:127.0.0.1:46964_solr) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1717913 INFO (zkCallback-408-thread-2-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1718306 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53019.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1718401 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53019.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1718402 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53019.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1718403 INFO (jetty-launcher-395-thread-1) [n:127.0.0.1:53019_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/tempDir-001/node1/.
[junit4] 2> 1719230 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46964.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1719241 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46964.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1719241 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46964.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1719242 INFO (jetty-launcher-395-thread-2) [n:127.0.0.1:46964_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/tempDir-001/node2/.
[junit4] 2> 1719459 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1719460 INFO (SUITE-AutoScalingHandlerTest-seed#[F3F8D0E0F4A535B1]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43073/solr ready
[junit4] 2> 1719558 INFO (TEST-AutoScalingHandlerTest.testErrorHandling-seed#[F3F8D0E0F4A535B1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testErrorHandling
[junit4] 2> 1719863 ERROR (qtp1559789312-2054) [n:127.0.0.1:46964_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{set-cluster-policy=[{cores=<10, node=#ANY}, {shard=#EACH, node=#ANY}, {nodeRole=overseer, replica=0}], errorMessages=[replica is required in {
[junit4] 2> "shard":"#EACH",
[junit4] 2> "node":"#ANY"}]}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.api.ApiBag$ReqHandlerToApi.call(ApiBag.java:242)
[junit4] 2> at org.apache.solr.api.V2HttpCall.handleAdmin(V2HttpCall.java:308)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1719863 INFO (qtp1559789312-2054) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=400 QTime=22
[junit4] 2> 1719869 INFO (TEST-AutoScalingHandlerTest.testErrorHandling-seed#[F3F8D0E0F4A535B1]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testErrorHandling
[junit4] 2> 1719938 INFO (TEST-AutoScalingHandlerTest.testDeleteUsedPolicy-seed#[F3F8D0E0F4A535B1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteUsedPolicy
[junit4] 2> 1720133 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1720133 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43073/solr ready
[junit4] 2> 1720237 INFO (qtp1559789312-2057) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1721196 INFO (qtp487298336-2064) [n:127.0.0.1:53019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1721268 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1247
[junit4] 2> 1721269 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=COLL1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2&policy=nodelete and sendToOCPQueue=true
[junit4] 2> 1721271 INFO (OverseerThreadFactory-814-thread-1-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.CreateCollectionCmd Create collection COLL1
[junit4] 2> 1721352 INFO (qtp1559789312-2057) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1721401 INFO (qtp487298336-2060) [n:127.0.0.1:53019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1721685 INFO (OverseerStateUpdate-98902312617508870-127.0.0.1:53019_solr-n_0000000000) [n:127.0.0.1:53019_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"COLL1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"COLL1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:53019/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 1722691 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=COLL1_shard1_replica_n1&action=CREATE&numShards=1&collection=COLL1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1722691 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1722829 INFO (zkCallback-408-thread-1-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1722829 INFO (zkCallback-408-thread-2-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1723896 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1723907 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.IndexSchema [COLL1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 1723914 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 1723914 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'COLL1_shard1_replica_n1' using configuration from collection COLL1, trusted=true
[junit4] 2> 1723915 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_53019.solr.core.COLL1.shard1.replica_n1' (registry 'solr.core.COLL1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6867c2a0
[junit4] 2> 1723915 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1723916 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore [[COLL1_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/tempDir-001/node1/COLL1_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.autoscaling.AutoScalingHandlerTest_F3F8D0E0F4A535B1-001/tempDir-001/node1/./COLL1_shard1_replica_n1/data/]
[junit4] 2> 1724311 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1724311 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1724312 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1724312 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1724340 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@274e42e3[COLL1_shard1_replica_n1] main]
[junit4] 2> 1724341 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 1724342 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 1724342 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1724343 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582437013295988736
[junit4] 2> 1724377 INFO (searcherExecutor-819-thread-1-processing-n:127.0.0.1:53019_solr x:COLL1_shard1_replica_n1 s:shard1 c:COLL1 r:core_node2) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SolrCore [COLL1_shard1_replica_n1] Registered new searcher Searcher@274e42e3[COLL1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53019/solr/COLL1_shard1_replica_n1/
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:53019/solr/COLL1_shard1_replica_n1/ has no replicas
[junit4] 2> 1724392 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1724410 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53019/solr/COLL1_shard1_replica_n1/ shard1
[junit4] 2> 1724511 INFO (zkCallback-408-thread-2-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1724511 INFO (zkCallback-408-thread-1-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1724519 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1724521 INFO (qtp487298336-2059) [n:127.0.0.1:53019_solr c:COLL1 s:shard1 r:core_node2 x:COLL1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=COLL1_shard1_replica_n1&action=CREATE&numShards=1&collection=COLL1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1829
[junit4] 2> 1724573 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1724770 INFO (zkCallback-408-thread-2-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1724770 INFO (zkCallback-408-thread-1-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/COLL1/state.json] for collection [COLL1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1725325 INFO (OverseerCollectionConfigSetProcessor-98902312617508870-127.0.0.1:53019_solr-n_0000000000) [n:127.0.0.1:53019_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1725585 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=COLL1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2&policy=nodelete} status=0 QTime=4315
[junit4] 2> 1725621 ERROR (qtp1559789312-2056) [n:127.0.0.1:46964_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.api.ApiBag$ExceptionWithErrObject: Error in command payload, errors: [{remove-policy=nodelete, errorMessages=[policy : nodelete is being used by collection COLL1]}],
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.processOps(AutoScalingHandler.java:211)
[junit4] 2> at org.apache.solr.cloud.autoscaling.AutoScalingHandler.handleRequestBody(AutoScalingHandler.java:145)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 1725621 INFO (qtp1559789312-2056) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=400 QTime=35
[junit4] 2> 1725622 INFO (qtp1559789312-2051) [n:127.0.0.1:46964_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=COLL1&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1725668 INFO (OverseerThreadFactory-814-thread-2-processing-n:127.0.0.1:53019_solr) [n:127.0.0.1:53019_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 1726357 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.COLL1.shard1.replica_n1, tag=null
[junit4] 2> 1726357 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c4200f1: rootName = solr_53019, domain = solr.core.COLL1.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.COLL1.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@d232a17
[junit4] 2> 1726445 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.c.SolrCore [COLL1_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@2e581cfc
[junit4] 2> 1726445 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.COLL1.shard1.replica_n1, tag=777526524
[junit4] 2> 1726445 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.COLL1.shard1.leader, tag=777526524
[junit4] 2> 1726498 INFO (qtp487298336-2062) [n:127.0.0.1:53019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=COLL1_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=145
[junit4] 2> 1727510 INFO (qtp1559789312-2051) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=COLL1&action=DELETE&wt=javabin&version=2} status=0 QTime=1887
[junit4] 2> 1727511 INFO (TEST-AutoScalingHandlerTest.testDeleteUsedPolicy-seed#[F3F8D0E0F4A535B1]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteUsedPolicy
[junit4] 2> 1727712 INFO (TEST-AutoScalingHandlerTest.testConcurrentUpdates-seed#[F3F8D0E0F4A535B1]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testConcurrentUpdates
[junit4] 2> 1727815 INFO (OverseerCollectionConfigSetProcessor-98902312617508870-127.0.0.1:53019_solr-n_0000000000) [n:127.0.0.1:53019_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1729407 INFO (qtp1559789312-2050) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1729407 INFO (qtp1559789312-2050) [n:127.0.0.1:46964_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43073/solr ready
[junit4] 2> 1729417 INFO (qtp1559789312-2054) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1729417 INFO (qtp1559789312-2054) [n:127.0.0.1:46964_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43073/solr ready
[junit4] 2> 1729445 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1729454 INFO (qtp1559789312-2056) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1729465 INFO (qtp487298336-2063) [n:127.0.0.1:53019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1729528 INFO (qtp487298336-2064) [n:127.0.0.1:53019_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1729533 INFO (qtp1559789312-2054) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/autoscaling params={wt=javabin&version=2} status=0 QTime=1431
[junit4] 2> 1729693 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1729694 INFO (qtp1559789312-2055) [n:127.0.0.1:46964_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43073/solr ready
[junit4] 2> 1729695 INFO (qtp1559789312-2056) [n:127.0.0.1:46964_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1730037
[...truncated too long message...]
, e);
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: 'client' is not closed at this location
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 11. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
[ecj-lint] Analyzer a1 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a1' is never closed
[ecj-lint] ----------
[ecj-lint] 12. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
[ecj-lint] OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'tots' is never closed
[ecj-lint] ----------
[ecj-lint] 13. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
[ecj-lint] Analyzer a2 = new WhitespaceAnalyzer();
[ecj-lint] ^^
[ecj-lint] Resource leak: 'a2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 14. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
[ecj-lint] JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'parser' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 15. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
[ecj-lint] return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 16. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
[ecj-lint] DocSet a = new BitDocSet(bs);
[ecj-lint] ^
[ecj-lint] Resource leak: 'a' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 17. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 76)
[ecj-lint] final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
[ecj-lint] ^^^^
[ecj-lint] Resource leak: 'mock' is never closed
[ecj-lint] ----------
[ecj-lint] 18. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 131)
[ecj-lint] MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
[ecj-lint] ^^^^^
[ecj-lint] Resource leak: 'mock1' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 19. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
[ecj-lint] RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
[ecj-lint] ^^^^^^
[ecj-lint] Resource leak: 'plugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 20. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
[ecj-lint] BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
[ecj-lint] ^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 21. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
[ecj-lint] WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
[ecj-lint] ^^^^^^^^
[ecj-lint] Resource leak: 'analyzer' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 22. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
[ecj-lint] IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
[ecj-lint] ^
[ecj-lint] Resource leak: 'w' is never closed
[ecj-lint] ----------
[ecj-lint] 23. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
[ecj-lint] throw iae;
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] 24. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
[ecj-lint] return;
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'w' is not closed at this location
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 25. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 26. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 27. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 28. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 29. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] 30. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
[ecj-lint] SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
[ecj-lint] ^^^^^^^^^^
[ecj-lint] Resource leak: 'cmdDistrib' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 31. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
[ecj-lint] EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server1' is never closed
[ecj-lint] ----------
[ecj-lint] 32. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
[ecj-lint] EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
[ecj-lint] ^^^^^^^
[ecj-lint] Resource leak: 'server2' is never closed
[ecj-lint] ----------
[ecj-lint] ----------
[ecj-lint] 33. WARNING in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
[ecj-lint] return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
[ecj-lint] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
[ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
[ecj-lint] ----------
[ecj-lint] 33 problems (1 error, 32 warnings)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:684: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2093: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2126: Compile failed; see the compiler error output for details.
Total time: 403 minutes 55 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2133 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2133/
5 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionReload
Error Message:
Could not load collection from ZK: reloaded_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: reloaded_collection
at __randomizedtesting.SeedInfo.seed([60D17321483DA793:61685F1F9DB2080C]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.collectStartTimes(CollectionsAPIDistributedZkTest.java:532)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.waitForReloads(CollectionsAPIDistributedZkTest.java:507)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionReload(CollectionsAPIDistributedZkTest.java:479)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/reloaded_collection/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 46 more
FAILED: org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost
Error Message:
Error from server at http://127.0.0.1:33614/solr:
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33614/solr:
at __randomizedtesting.SeedInfo.seed([60D17321483DA793:501192A3C04F46CF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.cloud.autoscaling.ComputePlanActionTest.testNodeWithMultipleReplicasLost(ComputePlanActionTest.java:245)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testWrongZkChrootTest
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([F704A6AAAA3E3002:FAEC4B268F925D64]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1188)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:832)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.cleanIndex(CloudSolrClientTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 46 more
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([60D17321483DA793:E8854CFBE6C1CA6B]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestSolrCloudWithKerberosAlt.testBasics
Error Message:
Could not load collection from ZK: testkerberoscollection
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: testkerberoscollection
at __randomizedtesting.SeedInfo.seed([60D17321483DA793:5D09DD0D70D3F9E3]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
at org.apache.solr.cloud.TestSolrCloudWithKerberosAlt.testCollectionCreateSearchDelete(TestSolrCloudWithKerberosAlt.java:136)
at org.apache.solr.cloud.TestSolrCloudWithKerberosAlt.testBasics(TestSolrCloudWithKerberosAlt.java:124)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testkerberoscollection/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$5(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:332)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 44 more
Build Log:
[...truncated 12203 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 2419756 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/init-core-data-001
[junit4] 2> 2419757 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 2419757 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2419758 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2419759 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001
[junit4] 2> 2419759 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2419829 INFO (Thread-1126) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2419829 INFO (Thread-1126) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2419830 ERROR (Thread-1126) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2419918 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:38891
[junit4] 2> 2420053 INFO (jetty-launcher-1096-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2420067 INFO (jetty-launcher-1096-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2420068 INFO (jetty-launcher-1096-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2420123 INFO (jetty-launcher-1096-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2420248 INFO (jetty-launcher-1096-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ed2218b{/solr,null,AVAILABLE}
[junit4] 2> 2420358 INFO (jetty-launcher-1096-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@63d4e3d9{/solr,null,AVAILABLE}
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@733dd192{SSL,[ssl, http/1.1]}{127.0.0.1:39390}
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.e.j.s.Server Started @2441314ms
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39390}
[junit4] 2> 2420360 ERROR (jetty-launcher-1096-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2420360 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T20:38:19.059Z
[junit4] 2> 2420361 INFO (jetty-launcher-1096-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@51e9a15e{/solr,null,AVAILABLE}
[junit4] 2> 2420361 INFO (jetty-launcher-1096-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@331ad8f2{SSL,[ssl, http/1.1]}{127.0.0.1:35788}
[junit4] 2> 2420361 INFO (jetty-launcher-1096-thread-4) [ ] o.e.j.s.Server Started @2441316ms
[junit4] 2> 2420361 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35788}
[junit4] 2> 2420361 ERROR (jetty-launcher-1096-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2420362 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2420362 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2420362 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2420362 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T20:38:19.061Z
[junit4] 2> 2420473 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2420476 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2420476 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2420476 INFO (jetty-launcher-1096-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ab6bf7e{SSL,[ssl, http/1.1]}{127.0.0.1:43589}
[junit4] 2> 2420476 INFO (jetty-launcher-1096-thread-3) [ ] o.e.j.s.Server Started @2441431ms
[junit4] 2> 2420476 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43589}
[junit4] 2> 2420477 ERROR (jetty-launcher-1096-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2420477 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2420477 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2420477 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2420477 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T20:38:19.176Z
[junit4] 2> 2420513 INFO (jetty-launcher-1096-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@55d0a3f1{/solr,null,AVAILABLE}
[junit4] 2> 2420513 INFO (jetty-launcher-1096-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@96a520a{SSL,[ssl, http/1.1]}{127.0.0.1:46342}
[junit4] 2> 2420513 INFO (jetty-launcher-1096-thread-2) [ ] o.e.j.s.Server Started @2441468ms
[junit4] 2> 2420513 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46342}
[junit4] 2> 2420514 ERROR (jetty-launcher-1096-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2420514 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2420514 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2420514 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2420514 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T20:38:19.213Z
[junit4] 2> 2420643 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2420661 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2420661 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2420694 INFO (jetty-launcher-1096-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38891/solr
[junit4] 2> 2420733 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2420753 INFO (jetty-launcher-1096-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38891/solr
[junit4] 2> 2420746 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2420756 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2420845 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2420881 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2420881 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2420947 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f5a6830a10006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2420973 INFO (jetty-launcher-1096-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38891/solr
[junit4] 2> 2421074 INFO (jetty-launcher-1096-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:38891/solr
[junit4] 2> 2421453 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f5a6830a10009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2421952 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2421997 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2422029 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43589_solr
[junit4] 2> 2422070 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35788_solr
[junit4] 2> 2422103 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.c.Overseer Overseer (id=98897120364396555-127.0.0.1:43589_solr-n_0000000000) starting
[junit4] 2> 2422180 INFO (zkCallback-1117-thread-1-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2422273 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2422662 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2422672 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43589_solr
[junit4] 2> 2422697 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2422699 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46342_solr
[junit4] 2> 2422773 INFO (zkCallback-1117-thread-2-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 2422846 INFO (zkCallback-1113-thread-1-processing-n:127.0.0.1:46342_solr) [n:127.0.0.1:46342_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2422892 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 2422912 INFO (zkCallback-1113-thread-2-processing-n:127.0.0.1:46342_solr) [n:127.0.0.1:46342_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2423718 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2423757 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2423757 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2423771 INFO (jetty-launcher-1096-thread-4) [n:127.0.0.1:35788_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node4
[junit4] 2> 2424090 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424100 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2424330 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424330 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424331 INFO (jetty-launcher-1096-thread-2) [n:127.0.0.1:46342_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node2
[junit4] 2> 2424552 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424579 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2424627 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424627 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2424698 INFO (jetty-launcher-1096-thread-3) [n:127.0.0.1:43589_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node3
[junit4] 2> 2424799 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39390_solr
[junit4] 2> 2424825 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2424844 INFO (zkCallback-1117-thread-2-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2424848 INFO (zkCallback-1113-thread-2-processing-n:127.0.0.1:46342_solr) [n:127.0.0.1:46342_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2424848 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2426244 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2426371 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2426371 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2426373 INFO (jetty-launcher-1096-thread-1) [n:127.0.0.1:39390_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node1
[junit4] 2> 2427231 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2427304 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[60D17321483DA793]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:38891/solr ready
[junit4] 2> 2427797 INFO (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[60D17321483DA793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBadActionNames
[junit4] 2> 2427797 INFO (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[60D17321483DA793]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2428069 ERROR (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Unknown action: BADACTION
[junit4] 2> at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:217)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:534)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
[junit4] 2> at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 2428070 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=badactioncollection&action=BADACTION&numShards=2&wt=javabin&version=2} status=400 QTime=1
[junit4] 2> 2428084 INFO (TEST-CollectionsAPIDistributedZkTest.testBadActionNames-seed#[60D17321483DA793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testBadActionNames
[junit4] 2> 2428361 INFO (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60D17321483DA793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting deleteCollectionOnlyInZk
[junit4] 2> 2428362 INFO (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60D17321483DA793]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2428450 INFO (qtp1448549049-5255) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2428607 INFO (qtp1448549049-5255) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=157
[junit4] 2> 2428612 INFO (qtp1448549049-5256) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2428612 INFO (qtp1448549049-5256) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2428613 INFO (qtp1448549049-5256) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=onlyinzk&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2428669 WARN (OverseerCollectionConfigSetProcessor-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.LockTree lock_is_leaked at[onlyinzk]
[junit4] 2> 2428669 INFO (OverseerCollectionConfigSetProcessor-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2428676 INFO (OverseerThreadFactory-1773-thread-1-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.LockTree Unlocked multiple times : onlyinzk
[junit4] 2> 2428735 INFO (OverseerThreadFactory-1773-thread-2-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.CreateCollectionCmd Create collection onlyinzk
[junit4] 2> 2429399 INFO (OverseerStateUpdate-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"onlyinzk",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"onlyinzk_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39390/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2429503 INFO (OverseerStateUpdate-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"onlyinzk",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"onlyinzk_shard2_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:35788/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2429847 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr ] o.a.s.u.TestInjection Inject random core creation delay of 9s
[junit4] 2> 2430286 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr ] o.a.s.u.TestInjection Inject random core creation delay of 9s
[junit4] 2> 2438919 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica_n3&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2438920 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2438931 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2438959 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2439287 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica_n1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2439287 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2439667 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2439687 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2439691 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2439691 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2440005 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2440314 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.s.IndexSchema [onlyinzk_shard2_replica_n3] Schema name=minimal
[junit4] 2> 2440369 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2440370 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'onlyinzk_shard2_replica_n3' using configuration from collection onlyinzk, trusted=true
[junit4] 2> 2440370 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.onlyinzk.shard2.replica_n3' (registry 'solr.core.onlyinzk.shard2.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2440370 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2440370 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SolrCore [[onlyinzk_shard2_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node4/onlyinzk_shard2_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node4/onlyinzk_shard2_replica_n3/data/]
[junit4] 2> 2440697 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2440804 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.s.IndexSchema [onlyinzk_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2440806 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2440806 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'onlyinzk_shard1_replica_n1' using configuration from collection onlyinzk, trusted=true
[junit4] 2> 2440819 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.onlyinzk.shard1.replica_n1' (registry 'solr.core.onlyinzk.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2440819 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2440819 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore [[onlyinzk_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node1/onlyinzk_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node1/onlyinzk_shard1_replica_n1/data/]
[junit4] 2> 2440941 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2440941 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2440942 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2440942 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2440943 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@23f762c0[onlyinzk_shard2_replica_n3] main]
[junit4] 2> 2440944 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2440961 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2440961 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2440977 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582353948004581376
[junit4] 2> 2441035 INFO (searcherExecutor-1782-thread-1-processing-n:127.0.0.1:35788_solr x:onlyinzk_shard2_replica_n3 s:shard2 c:onlyinzk r:core_node4) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SolrCore [onlyinzk_shard2_replica_n3] Registered new searcher Searcher@23f762c0[onlyinzk_shard2_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:35788/solr/onlyinzk_shard2_replica_n3/
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.SyncStrategy https://127.0.0.1:35788/solr/onlyinzk_shard2_replica_n3/ has no replicas
[junit4] 2> 2441036 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2441071 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:35788/solr/onlyinzk_shard2_replica_n3/ shard2
[junit4] 2> 2441305 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441309 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441310 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441310 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441358 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2441415 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr c:onlyinzk s:shard2 r:core_node4 x:onlyinzk_shard2_replica_n3] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=onlyinzk_shard2_replica_n3&action=CREATE&numShards=2&collection=onlyinzk&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=11568
[junit4] 2> 2441493 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441493 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441504 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441505 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441558 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2441558 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2441578 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2441578 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2441615 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17d0302a[onlyinzk_shard1_replica_n1] main]
[junit4] 2> 2441623 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 2441623 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 2441624 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2441624 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582353948683010048
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39390/solr/onlyinzk_shard1_replica_n1/
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:39390/solr/onlyinzk_shard1_replica_n1/ has no replicas
[junit4] 2> 2441661 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2441675 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39390/solr/onlyinzk_shard1_replica_n1/ shard1
[junit4] 2> 2441676 INFO (searcherExecutor-1784-thread-1-processing-n:127.0.0.1:39390_solr x:onlyinzk_shard1_replica_n1 s:shard1 c:onlyinzk r:core_node2) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.SolrCore [onlyinzk_shard1_replica_n1] Registered new searcher Searcher@17d0302a[onlyinzk_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2441806 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441806 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441813 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441813 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441841 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2441843 INFO (qtp106800518-5280) [n:127.0.0.1:39390_solr c:onlyinzk s:shard1 r:core_node2 x:onlyinzk_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=onlyinzk_shard1_replica_n1&action=CREATE&numShards=2&collection=onlyinzk&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=11556
[junit4] 2> 2441894 INFO (qtp1448549049-5256) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2441952 INFO (zkCallback-1121-thread-1-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441952 INFO (zkCallback-1121-thread-2-processing-n:127.0.0.1:35788_solr) [n:127.0.0.1:35788_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441959 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2441959 INFO (zkCallback-1109-thread-1-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/onlyinzk/state.json] for collection [onlyinzk] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2442771 INFO (OverseerCollectionConfigSetProcessor-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2442905 INFO (qtp1448549049-5256) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf&name=onlyinzk&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=14291
[junit4] 2> 2442909 INFO (qtp1448549049-5249) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2442909 INFO (qtp1448549049-5249) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2442909 INFO (TEST-CollectionsAPIDistributedZkTest.deleteCollectionOnlyInZk-seed#[60D17321483DA793]) [ ] o.a.s.SolrTestCaseJ4 ###Ending deleteCollectionOnlyInZk
[junit4] 2> 2443949 INFO (TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[60D17321483DA793]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteNonExistentCollection
[junit4] 2> 2443951 INFO (TEST-CollectionsAPIDistributedZkTest.testDeleteNonExistentCollection-seed#[60D17321483DA793]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2443952 INFO (qtp1448549049-5249) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=onlyinzk&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2443968 INFO (OverseerThreadFactory-1773-thread-3-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 2444034 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard2.replica_n3, tag=null
[junit4] 2> 2444034 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5b37c4eb: rootName = null, domain = solr.core.onlyinzk.shard2.replica_n3, service url = null, agent id = null] for registry solr.core.onlyinzk.shard2.replica_n3 / com.codahale.metrics.MetricRegistry@101efb5d
[junit4] 2> 2444107 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard1.replica_n1, tag=null
[junit4] 2> 2444107 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@513feae6: rootName = null, domain = solr.core.onlyinzk.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.onlyinzk.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@160b49b4
[junit4] 2> 2444241 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.c.SolrCore [onlyinzk_shard2_replica_n3] CLOSING SolrCore org.apache.solr.core.SolrCore@21081e75
[junit4] 2> 2444242 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard2.replica_n3, tag=554180213
[junit4] 2> 2444242 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.onlyinzk.shard2.leader, tag=554180213
[junit4] 2> 2444254 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.c.SolrCore [onlyinzk_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@60330614
[junit4] 2> 2444254 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.onlyinzk.shard1.replica_n1, tag=1613956628
[junit4] 2> 2444254 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.onlyinzk.shard1.leader, tag=1613956628
[junit4] 2> 2444514 INFO (qtp1448549049-5250) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=onlyinzk_shard2_replica_n3&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=528
[junit4] 2> 2444515 INFO (qtp106800518-5281) [n:127.0.0.1:39390_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=onlyinzk_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=481
[junit4] 2> 2445266 INFO (qtp1448549049-5249) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=onlyinzk&action=DELETE&wt=javabin&version=2} status=0 QTime=1314
[junit4] 2> 2445268 INFO (qtp1448549049-5251) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=unknown_collection&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2445282 INFO (OverseerCollectionConfigSetProcessor-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2445331 INFO (OverseerThreadFactory-1773-thread-4-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 2445351 ERROR (OverseerThreadFactory-1773-thread-4-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: unknown_collection operation: delete failed:org.apache.solr.common.SolrException: Could not find collection : unknown_collection
[junit4] 2> at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:111)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.collectionCmd(OverseerCollectionMessageHandler.java:800)
[junit4] 2> at org.apache.solr.cloud.DeleteCollectionCmd.call(DeleteCollectionCmd.java:91)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:232)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 2445449 INFO (qtp1448549049-5251) [n:127.0.0.1:35788_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=unknown_collection&action=DELETE&wt=javabin&version=2} status=400 QTime=181
[junit4] 2> 2445450 INFO (qtp1448549049-5252) [n:127.0.0.1:35788_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=acollectionafterbaddelete&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2445486 INFO (OverseerThreadFactory-1773-thread-5-processing-n:127.0.0.1:43589_solr) [n:127.0.0.1:43589_solr ] o.a.s.c.CreateCollectionCmd Create collection acollectionafterbaddelete
[junit4] 2> 2445486 INFO (OverseerCollectionConfigSetProcessor-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2445780 INFO (OverseerStateUpdate-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"acollectionafterbaddelete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"acollectionafterbaddelete_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:46342/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2445781 INFO (OverseerStateUpdate-98897120364396555-127.0.0.1:43589_solr-n_0000000000) [n:127.0.0.1:43589_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"acollectionafterbaddelete",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"acollectionafterbaddelete_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:39390/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2446000 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr ] o.a.s.u.TestInjection Inject random core creation delay of 9s
[junit4] 2> 2446615 INFO (qtp1067700273-5272) [n:127.0.0.1:46342_solr ] o.a.s.u.TestInjection Inject random core creation delay of 9s
[junit4] 2> 2455007 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=acollectionafterbaddelete_shard1_replica_n2&action=CREATE&numShards=1&collection=acollectionafterbaddelete&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2455060 INFO (zkCallback-1109-thread-2-processing-n:127.0.0.1:39390_solr) [n:127.0.0.1:39390_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/acollectionafterbaddelete/state.json] for collection [acollectionafterbaddelete] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2455140 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2455358 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.s.IndexSchema [acollectionafterbaddelete_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2455360 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2455360 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'acollectionafterbaddelete_shard1_replica_n2' using configuration from collection acollectionafterbaddelete, trusted=true
[junit4] 2> 2455360 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.acollectionafterbaddelete.shard1.replica_n2' (registry 'solr.core.acollectionafterbaddelete.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6278664a
[junit4] 2> 2455360 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2455360 INFO (qtp106800518-5274) [n:127.0.0.1:39390_solr c:acollectionafterbaddelete s:shard1 r:core_node4 x:acollectionafterbaddelete_shard1_replica_n2] o.a.s.c.SolrCore [[acollectionafterbaddelete_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_60D17321483DA793-001/tempDir-001/node1/acollectionafterbaddelete_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.c
[...truncated too long message...]
Changed path:/collections/multicollection2/state.json] for collection [multicollection2] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468176 INFO (zkCallback-144-thread-4-processing-n:127.0.0.1:39224_solr) [n:127.0.0.1:39224_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/multicollection2/state.json] for collection [multicollection2] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468184 INFO (coreCloseExecutor-487-thread-2) [n:127.0.0.1:35463_solr c:multicollection2 s:shard1 r:core_node2 x:multicollection2_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection2.shard1.leader, tag=677818005
[junit4] 2> 468200 INFO (zkCallback-140-thread-4-processing-n:127.0.0.1:35463_solr) [n:127.0.0.1:35463_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/multicollection2/state.json] for collection [multicollection2] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468200 INFO (zkCallback-140-thread-6-processing-n:127.0.0.1:35463_solr) [n:127.0.0.1:35463_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/multicollection2/state.json] for collection [multicollection2] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468205 INFO (coreCloseExecutor-487-thread-7) [n:127.0.0.1:35463_solr c:foo s:shard1 r:core_node3 x:foo_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=569196273
[junit4] 2> 468296 INFO (coreCloseExecutor-486-thread-7) [n:127.0.0.1:39224_solr c:localShardsTestColl s:shard2 r:core_node14 x:localShardsTestColl_shard2_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard2.leader, tag=887462485
[junit4] 2> 468310 INFO (coreCloseExecutor-486-thread-8) [n:127.0.0.1:39224_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.2nd_collection.shard2.replica_n2, tag=917025266
[junit4] 2> 468310 INFO (coreCloseExecutor-486-thread-8) [n:127.0.0.1:39224_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5f88237: rootName = solr_39224, domain = solr.core.2nd_collection.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.2nd_collection.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@2083652a
[junit4] 2> 468348 INFO (zkCallback-144-thread-4-processing-n:127.0.0.1:39224_solr) [n:127.0.0.1:39224_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468348 INFO (zkCallback-144-thread-5-processing-n:127.0.0.1:39224_solr) [n:127.0.0.1:39224_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/overwrite/state.json] for collection [overwrite] has occurred - updating... (live nodes size: [0])
[junit4] 2> 468363 INFO (coreCloseExecutor-486-thread-8) [n:127.0.0.1:39224_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.2nd_collection.shard2.leader, tag=917025266
[junit4] 2> 468364 INFO (coreCloseExecutor-486-thread-9) [n:127.0.0.1:39224_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.foo.shard1.replica_n2, tag=1753377743
[junit4] 2> 468364 INFO (coreCloseExecutor-486-thread-9) [n:127.0.0.1:39224_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6e5c47d0: rootName = solr_39224, domain = solr.core.foo.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.foo.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@7c537ed3
[junit4] 2> 468403 INFO (coreCloseExecutor-486-thread-9) [n:127.0.0.1:39224_solr c:foo s:shard1 r:core_node5 x:foo_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=1753377743
[junit4] 2> 468405 INFO (coreCloseExecutor-486-thread-1) [n:127.0.0.1:39224_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=1872380691
[junit4] 2> 468533 INFO (jetty-closer-129-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4fe6b630{/solr,null,UNAVAILABLE}
[junit4] 2> 468547 INFO (jetty-closer-129-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98897588478672902-127.0.0.1:35463_solr-n_0000000000) closing
[junit4] 2> 468549 INFO (OverseerStateUpdate-98897588478672902-127.0.0.1:35463_solr-n_0000000000) [n:127.0.0.1:35463_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:35463_solr
[junit4] 2> 468620 WARN (OverseerAutoScalingTriggerThread-98897588478672902-127.0.0.1:35463_solr-n_0000000000) [n:127.0.0.1:35463_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 468656 INFO (jetty-closer-129-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@22088d16{/solr,null,UNAVAILABLE}
[junit4] 2> 469190 WARN (zkCallback-145-thread-7-processing-n:127.0.0.1:42649_solr) [n:127.0.0.1:42649_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/localShardsTestColl/state.json]
[junit4] 2> 469206 INFO (jetty-closer-129-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@aedbbaa{/solr,null,UNAVAILABLE}
[junit4] 2> 469207 ERROR (SUITE-CloudSolrClientTest-seed#[F704A6AAAA3E3002]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 469207 INFO (SUITE-CloudSolrClientTest-seed#[F704A6AAAA3E3002]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42384 42384
[junit4] 2> 469318 INFO (Thread-111) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42384 42384
[junit4] 2> 469318 WARN (Thread-111) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 43 /solr/collections/localShardsTestColl/state.json
[junit4] 2> 27 /solr/collections/foo/state.json
[junit4] 2> 16 /solr/collections/multicollection2/state.json
[junit4] 2> 16 /solr/collections/multicollection1/state.json
[junit4] 2> 15 /solr/collections/collection1/state.json
[junit4] 2> 14 /solr/collections/2nd_collection/state.json
[junit4] 2> 14 /solr/collections/nemesis/state.json
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/overwrite/state.json
[junit4] 2> 2 /solr/collections/localShardsTestColl/leader_elect/shard2/election/98897588478672902-core_node15-n_0000000000
[junit4] 2> 2 /solr/collections/foo/leader_elect/shard1/election/98897588478672902-core_node3-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 8 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.impl.CloudSolrClientTest_F704A6AAAA3E3002-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=19866, maxDocsPerChunk=8, blockSize=8), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=19866, blockSize=8)), sim=RandomSimilarity(queryNorm=false): {}, locale=cs-CZ, timezone=Asia/Karachi
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=188807168,total=417857536
[junit4] 2> NOTE: All tests run in this JVM: [LessThanEqualToEvaluatorTest, SolrExampleEmbeddedTest, TestValidatingJsonMap, ArcCosineEvaluatorTest, TestJsonRecordReader, MergeIndexesEmbeddedTest, NormalizeEvaluatorTest, MultiplyEvaluatorTest, PowerEvaluatorTest, QueryResponseTest, TestUpdateRequestCodec, TestCollectionAdminRequest, CoalesceEvaluatorTest, CommonParamsTest, GreaterThanEqualToEvaluatorTest, TestSolrProperties, UuidEvaluatorTest, TestCollectionStateWatchers, SolrQueryTest, SineEvaluatorTest, TestFastInputStream, JdbcDriverTest, GetByIdTest, DivideEvaluatorTest, SolrExampleStreamingBinaryTest, SolrExampleXMLTest, TestSpellCheckResponse, TestEmbeddedSolrServer, TestHash, SolrDocumentTest, NamedListTest, CollectionAdminRequestRequiredParamsTest, TestPolicy, CloudSolrClientBuilderTest, CloudSolrClientMultiConstructorTest, CloudSolrClientTest]
[junit4] Completed [85/145 (1!)] on J1 in 119.17s, 15 tests, 1 error <<< FAILURES!
[...truncated 46431 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2132 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2132/
6 tests failed.
FAILED: org.apache.solr.cloud.ShardRoutingTest.test
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38331/solr within 10000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38331/solr within 10000 ms
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38:36CA22C9F20B91C0]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:179)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:116)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:106)
at org.apache.solr.common.cloud.ZkStateReader.<init>(ZkStateReader.java:277)
at org.apache.solr.client.solrj.impl.ZkClientClusterStateProvider.connect(ZkClientClusterStateProvider.java:155)
at org.apache.solr.client.solrj.impl.CloudSolrClient.connect(CloudSolrClient.java:385)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.initCloud(AbstractFullDistribZkTestBase.java:285)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:332)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38331/solr within 10000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:233)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:171)
... 40 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest: 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:
1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ShardRoutingTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38]:0)
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
expected:<COMPLETED> but was:<RUNNING>
Stack Trace:
java.lang.AssertionError: expected:<COMPLETED> but was:<RUNNING>
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38:36CA22C9F20B91C0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:277)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration
Error Message:
Timed out waiting for replicas of collection to be 2 again null Live Nodes: [127.0.0.1:53481_solr] Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/7)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testIntegration_shard1_replica_n1", "base_url":"http://127.0.0.1:47707/solr", "node_name":"127.0.0.1:47707_solr", "state":"down", "type":"NRT"}, "core_node4":{ "core":"testIntegration_shard1_replica_n2", "base_url":"http://127.0.0.1:53481/solr", "node_name":"127.0.0.1:53481_solr", "state":"active", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timed out waiting for replicas of collection to be 2 again
null
Live Nodes: [127.0.0.1:53481_solr]
Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/7)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testIntegration_shard1_replica_n1",
"base_url":"http://127.0.0.1:47707/solr",
"node_name":"127.0.0.1:47707_solr",
"state":"down",
"type":"NRT"},
"core_node4":{
"core":"testIntegration_shard1_replica_n2",
"base_url":"http://127.0.0.1:53481/solr",
"node_name":"127.0.0.1:53481_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38:EFF133F79C85D1D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
expected:<8> but was:<7>
Stack Trace:
java.lang.AssertionError: expected:<8> but was:<7>
at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38:D362B9EEE6BF033F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:271)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12246 lines...]
[junit4] Suite: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/init-core-data-001
[junit4] 2> 2196696 WARN (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 2196732 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2196734 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2196735 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2196735 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001
[junit4] 2> 2196735 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2196736 INFO (Thread-2055) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2196736 INFO (Thread-2055) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2196798 ERROR (Thread-2055) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2196840 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41761
[junit4] 2> 2196965 INFO (jetty-launcher-562-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2196973 INFO (jetty-launcher-562-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2197020 INFO (jetty-launcher-562-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2197088 INFO (jetty-launcher-562-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@34359ea8{/solr,null,AVAILABLE}
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@190442e1{SSL,[ssl, http/1.1]}{127.0.0.1:36317}
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.e.j.s.Server Started @2219592ms
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36317}
[junit4] 2> 2197089 ERROR (jetty-launcher-562-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2197089 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T08:29:50.055Z
[junit4] 2> 2197253 INFO (jetty-launcher-562-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@56373fa5{/solr,null,AVAILABLE}
[junit4] 2> 2197253 INFO (jetty-launcher-562-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@72610cb9{SSL,[ssl, http/1.1]}{127.0.0.1:47674}
[junit4] 2> 2197253 INFO (jetty-launcher-562-thread-2) [ ] o.e.j.s.Server Started @2219756ms
[junit4] 2> 2197253 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47674}
[junit4] 2> 2197253 ERROR (jetty-launcher-562-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2197253 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2197254 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2197254 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2197254 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T08:29:50.220Z
[junit4] 2> 2197568 INFO (jetty-launcher-562-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1381b9c5{/solr,null,AVAILABLE}
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6062c8cc{SSL,[ssl, http/1.1]}{127.0.0.1:44881}
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.e.j.s.Server Started @2220072ms
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44881}
[junit4] 2> 2197569 ERROR (jetty-launcher-562-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2197569 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-26T08:29:50.535Z
[junit4] 2> 2197786 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2197869 INFO (jetty-launcher-562-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41761/solr
[junit4] 2> 2198008 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2198016 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2198145 INFO (jetty-launcher-562-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41761/solr
[junit4] 2> 2198580 INFO (jetty-launcher-562-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41761/solr
[junit4] 2> 2199150 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2199168 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44881_solr
[junit4] 2> 2199169 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer Overseer (id=98894255862775816-127.0.0.1:44881_solr-n_0000000000) starting
[junit4] 2> 2199182 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2199183 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47674_solr
[junit4] 2> 2199453 INFO (zkCallback-578-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2199684 INFO (zkCallback-579-thread-1-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2199716 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer Starting to work on the main queue
[junit4] 2> 2199744 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 2199746 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 2199747 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44881_solr
[junit4] 2> 2199747 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:47674_solr]
[junit4] 2> 2199747 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 2199747 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 2199749 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:44881_solr"} current state version: 0
[junit4] 2> 2199749 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:44881_solr
[junit4] 2> 2199752 INFO (zkCallback-579-thread-1-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2199766 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2199767 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2199768 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36317_solr
[junit4] 2> 2199769 INFO (zkCallback-579-thread-1-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2199816 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 2199816 DEBUG (OverseerAutoScalingTriggerThread-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 2199817 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr]
[junit4] 2> 2199844 INFO (zkCallback-578-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 2199845 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 2, message = {
[junit4] 2> "operation":"downnode",
[junit4] 2> "node_name":"127.0.0.1:36317_solr"} current state version: 0
[junit4] 2> 2199845 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.NodeMutator DownNode state invoked for node: 127.0.0.1:36317_solr
[junit4] 2> 2199865 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:36317_solr) [n:127.0.0.1:36317_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2200402 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47674.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2200486 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47674.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2200486 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47674.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2200487 INFO (jetty-launcher-562-thread-2) [n:127.0.0.1:47674_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node2/.
[junit4] 2> 2201703 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2203873 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36317.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2203920 DEBUG (ScheduledTrigger-1898-thread-2) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2203923 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36317.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2203923 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36317.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2203924 INFO (jetty-launcher-562-thread-1) [n:127.0.0.1:36317_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node1/.
[junit4] 2> 2204399 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44881.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2204446 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44881.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2204446 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44881.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@27ca494b
[junit4] 2> 2204478 INFO (jetty-launcher-562-thread-3) [n:127.0.0.1:44881_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/.
[junit4] 2> 2204920 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2204941 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2204941 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[BE9E1D135CF7FC38]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41761/solr ready
[junit4] 2> 2205484 INFO (qtp1044512293-5428) [n:127.0.0.1:36317_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=AutoscalingHistoryHandlerTest_collection&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2205534 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.CreateCollectionCmd Create collection AutoscalingHistoryHandlerTest_collection
[junit4] 2> 2205534 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.CreateCollectionCmd Only _default config set found, using it.
[junit4] 2> 2205535 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/managed-schema to /configs/AutoscalingHistoryHandlerTest_collection/managed-schema
[junit4] 2> 2205552 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/protwords.txt to /configs/AutoscalingHistoryHandlerTest_collection/protwords.txt
[junit4] 2> 2205706 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/solrconfig.xml to /configs/AutoscalingHistoryHandlerTest_collection/solrconfig.xml
[junit4] 2> 2205707 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/synonyms.txt to /configs/AutoscalingHistoryHandlerTest_collection/synonyms.txt
[junit4] 2> 2205708 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/stopwords.txt to /configs/AutoscalingHistoryHandlerTest_collection/stopwords.txt
[junit4] 2> 2205710 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_it.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/contractions_it.txt
[junit4] 2> 2205711 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/contractions_ca.txt
[junit4] 2> 2205712 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stemdict_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stemdict_nl.txt
[junit4] 2> 2205714 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_no.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_no.txt
[junit4] 2> 2205715 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hy.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_hy.txt
[junit4] 2> 2205716 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_id.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_id.txt
[junit4] 2> 2205717 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hi.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_hi.txt
[junit4] 2> 2205718 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ga.txt
[junit4] 2> 2205719 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_da.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_da.txt
[junit4] 2> 2205720 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ja.txt
[junit4] 2> 2205721 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_pt.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_pt.txt
[junit4] 2> 2205724 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_hu.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_hu.txt
[junit4] 2> 2205725 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_el.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_el.txt
[junit4] 2> 2205726 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ru.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ru.txt
[junit4] 2> 2205727 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_tr.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_tr.txt
[junit4] 2> 2205728 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ar.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ar.txt
[junit4] 2> 2205728 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/userdict_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/userdict_ja.txt
[junit4] 2> 2205729 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_eu.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_eu.txt
[junit4] 2> 2205730 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_it.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_it.txt
[junit4] 2> 2205731 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_cz.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_cz.txt
[junit4] 2> 2205732 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stoptags_ja.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stoptags_ja.txt
[junit4] 2> 2205733 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/contractions_fr.txt
[junit4] 2> 2205733 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_de.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_de.txt
[junit4] 2> 2205734 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fa.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_fa.txt
[junit4] 2> 2205735 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/contractions_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/contractions_ga.txt
[junit4] 2> 2205756 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ca.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ca.txt
[junit4] 2> 2205757 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_nl.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_nl.txt
[junit4] 2> 2205758 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_bg.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_bg.txt
[junit4] 2> 2205776 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_en.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_en.txt
[junit4] 2> 2205778 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_es.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_es.txt
[junit4] 2> 2205779 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_lv.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_lv.txt
[junit4] 2> 2205797 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_ro.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_ro.txt
[junit4] 2> 2205797 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_th.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_th.txt
[junit4] 2> 2205798 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fr.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_fr.txt
[junit4] 2> 2205799 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_sv.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_sv.txt
[junit4] 2> 2205840 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_fi.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_fi.txt
[junit4] 2> 2205841 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/hyphenations_ga.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/hyphenations_ga.txt
[junit4] 2> 2205842 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/lang/stopwords_gl.txt to /configs/AutoscalingHistoryHandlerTest_collection/lang/stopwords_gl.txt
[junit4] 2> 2205860 INFO (OverseerThreadFactory-1900-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkConfigManager Copying zk node /configs/_default/params.json to /configs/AutoscalingHistoryHandlerTest_collection/params.json
[junit4] 2> 2205924 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "name":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "numShards":"1",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "stateFormat":"2",
[junit4] 2> "operation":"create"} current state version: 0
[junit4] 2> 2205924 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ClusterStateMutator building a new cName: AutoscalingHistoryHandlerTest_collection
[junit4] 2> 2205924 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json
[junit4] 2> 2205928 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2205983 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 2205983 INFO (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2205983 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{}}
[junit4] 2> 2205983 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2205983 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 2205984 INFO (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2205984 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{"core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2205984 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2205984 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 3, message = {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"} current state version: 0
[junit4] 2> 2205984 INFO (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2205988 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator Old Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2205988 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.SliceMutator New Slice: shard1:{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}
[junit4] 2> 2206103 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 0
[junit4] 2> 2206970 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2207182 INFO (qtp1044512293-5430) [n:127.0.0.1:36317_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=AutoscalingHistoryHandlerTest_collection&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n3&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2207182 INFO (qtp1044512293-5430) [n:127.0.0.1:36317_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2207218 INFO (qtp1640696451-5422) [n:127.0.0.1:44881_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=AutoscalingHistoryHandlerTest_collection&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n2&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2207218 INFO (qtp1640696451-5422) [n:127.0.0.1:44881_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2207219 INFO (qtp549060931-5439) [n:127.0.0.1:47674_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=AutoscalingHistoryHandlerTest_collection&newCollection=true&name=AutoscalingHistoryHandlerTest_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=AutoscalingHistoryHandlerTest_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2207219 INFO (qtp549060931-5439) [n:127.0.0.1:47674_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2207974 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2209051 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "node_name":"127.0.0.1:47674_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2209051 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "core_node_name":"core_node4",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "node_name":"127.0.0.1:47674_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 2209051 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node4:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1","base_url":"https://127.0.0.1:47674/solr","node_name":"127.0.0.1:47674_solr","state":"down","type":"NRT"}
[junit4] 2> 2209051 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/1)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "node_name":"127.0.0.1:47674_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 2209060 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 1
[junit4] 2> 2209060 INFO (zkCallback-579-thread-1-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209060 INFO (zkCallback-577-thread-1-processing-n:127.0.0.1:36317_solr) [n:127.0.0.1:36317_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209060 INFO (zkCallback-578-thread-2-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209073 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "node_name":"127.0.0.1:44881_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2209073 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "core_node_name":"core_node5",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "node_name":"127.0.0.1:44881_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 2209073 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node5:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2","base_url":"https://127.0.0.1:44881/solr","node_name":"127.0.0.1:44881_solr","state":"down","type":"NRT"}
[junit4] 2> 2209073 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/2)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "node_name":"127.0.0.1:47674_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "node_name":"127.0.0.1:44881_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "state":"down",
[junit4] 2> "node_name":null,
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 2209184 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 2
[junit4] 2> 2209185 INFO (zkCallback-578-thread-1-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209785 DEBUG (ScheduledTrigger-1898-thread-1) [n:127.0.0.1:44881_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:47674_solr, 127.0.0.1:36317_solr, 127.0.0.1:44881_solr]
[junit4] 2> 2209792 INFO (zkCallback-579-thread-2-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209793 INFO (zkCallback-579-thread-3-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209972 INFO (zkCallback-578-thread-3-processing-n:127.0.0.1:44881_solr) [n:127.0.0.1:44881_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2209972 INFO (zkCallback-577-thread-2-processing-n:127.0.0.1:36317_solr) [n:127.0.0.1:36317_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2210102 INFO (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams conf resource params.json loaded . version : 0
[junit4] 2> 2210102 INFO (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.RequestParams request params refreshed to version 0
[junit4] 2> 2210103 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/extraction/lib
[junit4] 2> 2210103 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-cell-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 2210104 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/clustering/lib
[junit4] 2> 2210104 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-clustering-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 2210105 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/langid/lib
[junit4] 2> 2210105 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-langid-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 2210105 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib filtered by .*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../contrib/velocity/lib
[junit4] 2> 2210106 WARN (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist filtered by solr-velocity-\d.*\.jar to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.handler.admin.AutoscalingHistoryHandlerTest_BE9E1D135CF7FC38-001/tempDir-001/node3/AutoscalingHistoryHandlerTest_collection_shard1_replica_n2/../../../../dist
[junit4] 2> 2210168 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "node_name":"127.0.0.1:36317_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 2210168 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "core_node_name":"core_node6",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "node_name":"127.0.0.1:36317_solr",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"AutoscalingHistoryHandlerTest_collection",
[junit4] 2> "type":"NRT",
[junit4] 2> "operation":"state"}
[junit4] 2> 2210168 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Will update state for replica: core_node6:{"core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3","base_url":"https://127.0.0.1:36317/solr","node_name":"127.0.0.1:36317_solr","state":"down","type":"NRT"}
[junit4] 2> 2210168 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ReplicaMutator Collection is now: DocCollection(AutoscalingHistoryHandlerTest_collection//collections/AutoscalingHistoryHandlerTest_collection/state.json/3)={
[junit4] 2> "pullReplicas":"0",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "router":{"name":"compositeId"},
[junit4] 2> "maxShardsPerNode":"1",
[junit4] 2> "autoAddReplicas":"false",
[junit4] 2> "nrtReplicas":"3",
[junit4] 2> "tlogReplicas":"0",
[junit4] 2> "shards":{"shard1":{
[junit4] 2> "range":"80000000-7fffffff",
[junit4] 2> "state":"active",
[junit4] 2> "replicas":{
[junit4] 2> "core_node4":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n1",
[junit4] 2> "base_url":"https://127.0.0.1:47674/solr",
[junit4] 2> "node_name":"127.0.0.1:47674_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node5":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n2",
[junit4] 2> "base_url":"https://127.0.0.1:44881/solr",
[junit4] 2> "node_name":"127.0.0.1:44881_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"},
[junit4] 2> "core_node6":{
[junit4] 2> "core":"AutoscalingHistoryHandlerTest_collection_shard1_replica_n3",
[junit4] 2> "base_url":"https://127.0.0.1:36317/solr",
[junit4] 2> "node_name":"127.0.0.1:36317_solr",
[junit4] 2> "state":"down",
[junit4] 2> "type":"NRT"}}}}}
[junit4] 2> 2210192 INFO (qtp1640696451-5422) [n:127.0.0.1:44881_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2210288 DEBUG (OverseerStateUpdate-98894255862775816-127.0.0.1:44881_solr-n_0000000000) [n:127.0.0.1:44881_solr ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/AutoscalingHistoryHandlerTest_collection/state.json version: 3
[junit4] 2> 2210292 INFO (zkCallback-579-thread-2-processing-n:127.0.0.1:47674_solr) [n:127.0.0.1:47674_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/AutoscalingHistoryHandlerTest_collection/state.json] for collection [AutoscalingHistoryHandlerTest_collection] has occurred - updating... (live
[...truncated too long message...]
nit4] > Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:38331/solr within 10000 ms
[junit4] > at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:233)
[junit4] > at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:171)
[junit4] > ... 40 more
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardRoutingTest_BE9E1D135CF7FC38-001
[junit4] 2> Oct 26, 2017 9:25:27 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Oct 26, 2017 9:25:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:
[junit4] 2> 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Oct 26, 2017 9:25:48 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4] 2> Oct 26, 2017 9:25:51 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] 2> at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] 2> at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=850, maxMBSortInHeap=5.071511109441691, sim=RandomSimilarity(queryNorm=false): {}, locale=ko, timezone=America/Yakutat
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=2,free=281938728,total=530579456
[junit4] 2> NOTE: All tests run in this JVM: [TestMinMaxOnMultiValuedField, OutOfBoxZkACLAndCredentialsProvidersTest, TestTrackingShardHandlerFactory, CdcrUpdateLogTest, TestManagedSynonymGraphFilterFactory, PKIAuthenticationIntegrationTest, SolrXmlInZkTest, BigEndianAscendingWordSerializerTest, TestSchemaSimilarityResource, PropertiesRequestHandlerTest, SolrIndexMetricsTest, SpatialFilterTest, JSONWriterTest, TestConfig, AssignBackwardCompatibilityTest, TestGraphTermsQParserPlugin, SliceStateTest, TestExpandComponent, TestConfigOverlay, ForceLeaderTest, HdfsRecoveryZkTest, TestFieldCacheSortRandom, OverseerModifyCollectionTest, RequestLoggingTest, TestTlogReplica, TestOnReconnectListenerSupport, TestConfigsApi, SoftAutoCommitTest, LeaderElectionIntegrationTest, FastVectorHighlighterTest, TestSubQueryTransformerCrossCore, DistributedQueueTest, SuggestComponentContextFilterQueryTest, MinimalSchemaTest, BaseCdcrDistributedZkTest, TermVectorComponentTest, RAMDirectoryFactoryTest, DirectUpdateHandlerOptimizeTest, TestMultiWordSynonyms, TestUseDocValuesAsStored2, TestStressVersions, TestEmbeddedSolrServerSchemaAPI, FileUtilsTest, TestManagedResourceStorage, ActionThrottleTest, CdcrReplicationHandlerTest, MetricsConfigTest, StatelessScriptUpdateProcessorFactoryTest, TestFieldCache, TestXmlQParserPlugin, TestLRUStatsCache, SimpleCollectionCreateDeleteTest, CursorMarkTest, SpellCheckCollatorTest, TestSolrIndexConfig, TestIndexingPerformance, AutoscalingHistoryHandlerTest, HdfsDirectoryTest, TestLuceneIndexBackCompat, DistributedQueryElevationComponentTest, SpellCheckComponentTest, TestLegacyNumericRangeQueryBuilder, TestUtils, HdfsBasicDistributedZkTest, JsonLoaderTest, TestQueryUtils, TestRandomFaceting, TestStressCloudBlindAtomicUpdates, FullHLLTest, TestCloudPseudoReturnFields, DistributedFacetPivotWhiteBoxTest, ZkStateReaderTest, BlockJoinFacetSimpleTest, NodeLostTriggerTest, TestRawResponseWriter, TestLocalFSCloudBackupRestore, ClassificationUpdateProcessorIntegrationTest, TestRequestStatusCollectionAPI, TestCustomSort, TestSolrQueryResponse, TestMultiValuedNumericRangeQuery, BasicZkTest, ResponseLogComponentTest, DistributedSuggestComponentTest, TestStressUserVersions, AnalysisAfterCoreReloadTest, DocumentBuilderTest, TestDistributedSearch, CollectionStateFormat2Test, TlogReplayBufferedWhileIndexingTest, TestCopyFieldCollectionResource, TestPHPSerializedResponseWriter, MissingSegmentRecoveryTest, RemoteQueryErrorTest, TestLegacyFieldReuse, TestCustomDocTransformer, LeaderElectionContextKeyTest, HdfsCollectionsAPIDistributedZkTest, TestNumericTokenStream, HdfsDirectoryFactoryTest, TestManagedSchemaAPI, CoreSorterTest, BlockCacheTest, TestShardHandlerFactory, ExternalFileFieldSortTest, TestSolrCloudWithDelegationTokens, AtomicUpdateProcessorFactoryTest, SparseHLLTest, TestHdfsUpdateLog, TestClusterProperties, DocValuesMissingTest, HdfsThreadLeakTest, CacheHeaderTest, TestMergePolicyConfig, RestartWhileUpdatingTest, SolrMetricReporterTest, CoreMergeIndexesAdminHandlerTest, NoCacheHeaderTest, TestHighlightDedupGrouping, BasicFunctionalityTest, TestStreamBody, TestNamedUpdateProcessors, TestIBSimilarityFactory, BasicDistributedZkTest, UnloadDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardRoutingTest -Dtests.seed=BE9E1D135CF7FC38 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=America/Yakutat -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | ShardRoutingTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ShardRoutingTest:
[junit4] > 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=13129, name=zkCallback-1808-thread-1, state=TIMED_WAITING, group=TGRP-ShardRoutingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([BE9E1D135CF7FC38]:0)
[junit4] Completed [361/745 (4!)] on J0 in 65.12s, 1 test, 3 errors <<< FAILURES!
[...truncated 48355 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2131 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2131/
5 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA:1007D8FADE069642]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getTotalReplicas(AbstractFullDistribZkTestBase.java:488)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:441)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 38 more
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node3:{"core":"c8n_1x3_lf_shard1_replica_n1","base_url":"http://127.0.0.1:41323","node_name":"127.0.0.1:41323_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"c8n_1x3_lf_shard1_replica_n1", "base_url":"http://127.0.0.1:41323", "node_name":"127.0.0.1:41323_", "state":"active", "type":"NRT", "leader":"true"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_n2", "base_url":"http://127.0.0.1:41647", "node_name":"127.0.0.1:41647_", "state":"down", "type":"NRT"}, "core_node6":{ "state":"down", "base_url":"http://127.0.0.1:42478", "core":"c8n_1x3_lf_shard1_replica_n4", "node_name":"127.0.0.1:42478_", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node3:{"core":"c8n_1x3_lf_shard1_replica_n1","base_url":"http://127.0.0.1:41323","node_name":"127.0.0.1:41323_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"c8n_1x3_lf_shard1_replica_n1",
"base_url":"http://127.0.0.1:41323",
"node_name":"127.0.0.1:41323_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_n2",
"base_url":"http://127.0.0.1:41647",
"node_name":"127.0.0.1:41647_",
"state":"down",
"type":"NRT"},
"core_node6":{
"state":"down",
"base_url":"http://127.0.0.1:42478",
"core":"c8n_1x3_lf_shard1_replica_n4",
"node_name":"127.0.0.1:42478_",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA:1007D8FADE069642]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration
Error Message:
Timed out waiting for replicas of collection to be 2 again null Live Nodes: [127.0.0.1:46308_solr] Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/6)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testIntegration_shard1_replica_n1", "base_url":"https://127.0.0.1:46308/solr", "node_name":"127.0.0.1:46308_solr", "state":"active", "type":"NRT", "leader":"true"}, "core_node4":{ "core":"testIntegration_shard1_replica_n2", "base_url":"https://127.0.0.1:33503/solr", "node_name":"127.0.0.1:33503_solr", "state":"down", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timed out waiting for replicas of collection to be 2 again
null
Live Nodes: [127.0.0.1:46308_solr]
Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/6)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testIntegration_shard1_replica_n1",
"base_url":"https://127.0.0.1:46308/solr",
"node_name":"127.0.0.1:46308_solr",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node4":{
"core":"testIntegration_shard1_replica_n2",
"base_url":"https://127.0.0.1:33503/solr",
"node_name":"127.0.0.1:33503_solr",
"state":"down",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA:2832E90C55C55A9F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.ExecutePlanActionTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest: 1) Thread[id=29474, name=AutoscalingActionExecutor-10086-thread-1-processing-n:127.0.0.1:46308_solr, state=TIMED_WAITING, group=TGRP-ExecutePlanActionTest] at java.lang.Thread.sleep(Native Method) at java.lang.Thread.sleep(Thread.java:340) at java.util.concurrent.TimeUnit.sleep(TimeUnit.java:386) at org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:155) at org.apache.solr.cloud.autoscaling.ScheduledTriggers.waitForPendingTasks(ScheduledTriggers.java:289) at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$2(ScheduledTriggers.java:221) at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$413/658744886.run(Unknown Source) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$118/353424776.run(Unknown Source) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest:
1) Thread[id=29474, name=AutoscalingActionExecutor-10086-thread-1-processing-n:127.0.0.1:46308_solr, state=TIMED_WAITING, group=TGRP-ExecutePlanActionTest]
at java.lang.Thread.sleep(Native Method)
at java.lang.Thread.sleep(Thread.java:340)
at java.util.concurrent.TimeUnit.sleep(TimeUnit.java:386)
at org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:155)
at org.apache.solr.cloud.autoscaling.ScheduledTriggers.waitForPendingTasks(ScheduledTriggers.java:289)
at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$2(ScheduledTriggers.java:221)
at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$413/658744886.run(Unknown Source)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$118/353424776.run(Unknown Source)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA]:0)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
action did not execute
Stack Trace:
java.lang.AssertionError: action did not execute
at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA:F5AF43DDCAB204BD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:260)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12441 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 2509610 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[9853E72070FAFBBA]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/init-core-data-001
[junit4] 2> 2509627 WARN (SUITE-ChaosMonkeySafeLeaderTest-seed#[9853E72070FAFBBA]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
[junit4] 2> 2509627 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[9853E72070FAFBBA]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2509627 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[9853E72070FAFBBA]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 2509628 INFO (SUITE-ChaosMonkeySafeLeaderTest-seed#[9853E72070FAFBBA]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_sw/cr
[junit4] 2> 2509629 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2509629 INFO (Thread-1912) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2509629 INFO (Thread-1912) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2509631 ERROR (Thread-1912) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2509730 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ZkTestServer start zk server on port:36858
[junit4] 2> 2509769 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 2509770 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 2509771 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 2509772 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 2509773 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 2509774 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 2509775 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 2509775 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 2509776 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 2509790 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 2509790 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 2509794 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 2510107 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2510204 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22cbfb6b{/_sw/cr,null,AVAILABLE}
[junit4] 2> 2510237 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5356dbaf{SSL,[ssl, http/1.1]}{127.0.0.1:37194}
[junit4] 2> 2510237 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server Started @2523191ms
[junit4] 2> 2510237 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/tempDir-001/control/data, replicaType=NRT, hostContext=/_sw/cr, hostPort=37194, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/control-001/cores}
[junit4] 2> 2510237 ERROR (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2510238 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2510238 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2510238 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2510238 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-24T20:05:47.736Z
[junit4] 2> 2510267 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2510267 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/control-001/solr.xml
[junit4] 2> 2510287 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2510287 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2510288 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2510303 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36858/solr
[junit4] 2> 2510620 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2510620 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37194__sw%2Fcr
[junit4] 2> 2510621 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.Overseer Overseer (id=98885667856580613-127.0.0.1:37194__sw%2Fcr-n_0000000000) starting
[junit4] 2> 2510753 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37194__sw%2Fcr
[junit4] 2> 2510887 INFO (zkCallback-1258-thread-1-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2511438 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2511476 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2511476 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2511493 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/control-001/cores
[junit4] 2> 2511568 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2511568 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36858/solr ready
[junit4] 2> 2511706 INFO (qtp1646894871-6901) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37194__sw%252Fcr&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2511724 INFO (OverseerThreadFactory-2441-thread-1-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 2511834 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2511862 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2511981 INFO (zkCallback-1258-thread-1-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2512931 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2512971 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 2513277 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 2513309 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 2513309 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2513309 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2513309 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 2513312 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=25.4580078125, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=17.34478029091233, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8730546188013666
[junit4] 2> 2513339 WARN (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2513513 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2513513 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2513514 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 2513514 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2513515 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7026133161578083]
[junit4] 2> 2513549 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6738ab9d[control_collection_shard1_replica_n1] main]
[junit4] 2> 2513622 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2513635 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2513635 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2513636 INFO (searcherExecutor-2444-thread-1-processing-n:127.0.0.1:37194__sw%2Fcr x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@6738ab9d[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2513637 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582170689906933760
[junit4] 2> 2513870 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2513870 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2513870 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:37194/_sw/cr/control_collection_shard1_replica_n1/
[junit4] 2> 2513871 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2513871 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:37194/_sw/cr/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 2513871 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2514062 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:37194/_sw/cr/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 2514118 INFO (zkCallback-1258-thread-2-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2514163 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2514164 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2329
[junit4] 2> 2514237 INFO (qtp1646894871-6901) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2514358 INFO (zkCallback-1258-thread-2-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2515249 INFO (qtp1646894871-6901) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37194__sw%252Fcr&wt=javabin&version=2} status=0 QTime=3542
[junit4] 2> 2515324 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2515325 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36858/solr ready
[junit4] 2> 2515325 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 2515398 INFO (qtp1646894871-6895) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2515448 INFO (OverseerThreadFactory-2441-thread-2-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 2515485 INFO (OverseerCollectionConfigSetProcessor-98885667856580613-127.0.0.1:37194__sw%2Fcr-n_0000000000) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2515505 WARN (OverseerThreadFactory-2441-thread-2-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 2516017 INFO (qtp1646894871-6895) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2516038 INFO (qtp1646894871-6895) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=639
[junit4] 2> 2517152 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001 of type NRT
[junit4] 2> 2517153 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2517262 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4708e14a{/_sw/cr,null,AVAILABLE}
[junit4] 2> 2517262 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4e116e5b{SSL,[ssl, http/1.1]}{127.0.0.1:38726}
[junit4] 2> 2517262 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server Started @2530216ms
[junit4] 2> 2517262 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/_sw/cr, hostPort=38726, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001/cores}
[junit4] 2> 2517262 ERROR (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2517262 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2517263 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2517263 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2517263 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-24T20:05:54.761Z
[junit4] 2> 2517335 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f4ffdb1f80008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2517336 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2517336 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001/solr.xml
[junit4] 2> 2517368 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2517368 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2517369 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2517388 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36858/solr
[junit4] 2> 2517555 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2517556 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2517557 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38726__sw%2Fcr
[junit4] 2> 2517579 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2517753 INFO (zkCallback-1258-thread-2-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2517754 INFO (OverseerCollectionConfigSetProcessor-98885667856580613-127.0.0.1:37194__sw%2Fcr-n_0000000000) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2517757 INFO (zkCallback-1266-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2517955 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2518010 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2518010 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2518011 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001/cores
[junit4] 2> 2518172 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38726__sw%252Fcr&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2518209 INFO (OverseerThreadFactory-2441-thread-3-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:38726__sw%2Fcr for creating new replica
[junit4] 2> 2518648 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2518648 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2518796 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2518890 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 2519392 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 2519431 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 2519432 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2519432 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2519432 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 2519447 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=25.4580078125, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=17.34478029091233, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8730546188013666
[junit4] 2> 2519471 WARN (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2519782 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2519782 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2519783 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 2519783 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2519784 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7026133161578083]
[junit4] 2> 2519871 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@36980d56[collection1_shard2_replica_n41] main]
[junit4] 2> 2519884 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2519884 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2519885 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2519885 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582170696458436608
[junit4] 2> 2519905 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2519905 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2519905 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:38726/_sw/cr/collection1_shard2_replica_n41/
[junit4] 2> 2519906 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2519906 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy https://127.0.0.1:38726/_sw/cr/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 2519906 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2519907 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:38726/_sw/cr/collection1_shard2_replica_n41/ shard2
[junit4] 2> 2519941 INFO (searcherExecutor-2455-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@36980d56[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2520054 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2520087 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2520088 INFO (qtp39236151-6947) [n:127.0.0.1:38726__sw%2Fcr c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1440
[junit4] 2> 2520105 INFO (qtp1646894871-6898) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38726__sw%252Fcr&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1932
[junit4] 2> 2520201 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2520213 INFO (OverseerCollectionConfigSetProcessor-98885667856580613-127.0.0.1:37194__sw%2Fcr-n_0000000000) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2520859 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001 of type NRT
[junit4] 2> 2520910 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2521043 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@357c1fe9{/_sw/cr,null,AVAILABLE}
[junit4] 2> 2521043 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@663f708f{SSL,[ssl, http/1.1]}{127.0.0.1:33244}
[junit4] 2> 2521043 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server Started @2533997ms
[junit4] 2> 2521043 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/_sw/cr, hostPort=33244, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001/cores}
[junit4] 2> 2521044 ERROR (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2521063 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2521063 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2521063 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2521063 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-24T20:05:58.561Z
[junit4] 2> 2521165 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2521165 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001/solr.xml
[junit4] 2> 2521168 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2521168 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 2521202 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 2521260 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36858/solr
[junit4] 2> 2521424 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2521437 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2521438 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33244__sw%2Fcr
[junit4] 2> 2521459 INFO (zkCallback-1277-thread-1-processing-n:127.0.0.1:33244__sw%2Fcr) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2521460 INFO (zkCallback-1258-thread-1-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2521465 INFO (zkCallback-1266-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2521466 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2522566 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2522673 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2522673 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2522675 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001/cores
[junit4] 2> 2523253 INFO (qtp693032452-6976) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33244__sw%252Fcr&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2523307 INFO (OverseerThreadFactory-2441-thread-4-processing-n:127.0.0.1:37194__sw%2Fcr) [n:127.0.0.1:37194__sw%2Fcr ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33244__sw%2Fcr for creating new replica
[junit4] 2> 2523488 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2523521 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 2523550 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2523669 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2523831 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 2524633 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 2524724 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 2524725 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@33431a
[junit4] 2> 2524725 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2524725 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 2524756 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=25.4580078125, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=17.34478029091233, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8730546188013666
[junit4] 2> 2524871 WARN (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 2525307 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2525307 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2525308 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms;
[junit4] 2> 2525308 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2525309 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=39, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7026133161578083]
[junit4] 2> 2525310 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e8cafb3[collection1_shard1_replica_n43] main]
[junit4] 2> 2525311 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2525329 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2525329 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2525330 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1582170702167932928
[junit4] 2> 2525383 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2525384 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2525384 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:33244/_sw/cr/collection1_shard1_replica_n43/
[junit4] 2> 2525384 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2525384 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy https://127.0.0.1:33244/_sw/cr/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 2525384 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2525404 INFO (searcherExecutor-2466-thread-1-processing-n:127.0.0.1:33244__sw%2Fcr x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@2e8cafb3[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2525419 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:33244/_sw/cr/collection1_shard1_replica_n43/ shard1
[junit4] 2> 2525535 INFO (zkCallback-1277-thread-1-processing-n:127.0.0.1:33244__sw%2Fcr) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2525539 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2525584 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2525585 INFO (qtp693032452-6978) [n:127.0.0.1:33244__sw%2Fcr c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2097
[junit4] 2> 2525601 INFO (qtp693032452-6976) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33244__sw%252Fcr&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=2348
[junit4] 2> 2525694 INFO (zkCallback-1277-thread-1-processing-n:127.0.0.1:33244__sw%2Fcr) [n:127.0.0.1:33244__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2525694 INFO (zkCallback-1271-thread-1-processing-n:127.0.0.1:38726__sw%2Fcr) [n:127.0.0.1:38726__sw%2Fcr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 2526736 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-3-001 of type NRT
[junit4] 2> 2526771 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2526900 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d1e9e4f{/_sw/cr,null,AVAILABLE}
[junit4] 2> 2526900 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@62a114fc{SSL,[ssl, http/1.1]}{127.0.0.1:32963}
[junit4] 2> 2526900 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.e.j.s.Server Started @2539854ms
[junit4] 2> 2526900 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/_sw/cr, hostPort=32963, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-3-001/cores}
[junit4] 2> 2526900 ERROR (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2526954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2526954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2526954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2526954 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-24T20:06:04.452Z
[junit4] 2> 2527018 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 2527018 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_9853E72070FAFBBA-001/shard-3-001/solr.xml
[junit4] 2> 2527211 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 2527211 INFO (TEST-ChaosMonkeySafeLeaderTest.test-seed#[9853E72070FAFBBA]) [ ] o.a.s.c.SolrXmlConfig Configuratio
[...truncated too long message...]
tsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest:
[junit4] 2> 1) Thread[id=29474, name=AutoscalingActionExecutor-10086-thread-1-processing-n:127.0.0.1:46308_solr, state=TIMED_WAITING, group=TGRP-ExecutePlanActionTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at java.lang.Thread.sleep(Thread.java:340)
[junit4] 2> at java.util.concurrent.TimeUnit.sleep(TimeUnit.java:386)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:155)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.waitForPendingTasks(ScheduledTriggers.java:289)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$2(ScheduledTriggers.java:221)
[junit4] 2> at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$413/658744886.run(Unknown Source)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$118/353424776.run(Unknown Source)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Oct 24, 2017 9:08:33 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=29474, name=AutoscalingActionExecutor-10086-thread-1-processing-n:127.0.0.1:46308_solr, state=TIMED_WAITING, group=TGRP-ExecutePlanActionTest]
[junit4] 2> Oct 24, 2017 9:08:33 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1642, maxMBSortInHeap=5.709851394059298, sim=RandomSimilarity(queryNorm=true): {}, locale=de, timezone=Etc/GMT+5
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=212993104,total=523763712
[junit4] 2> NOTE: All tests run in this JVM: [MetricsHandlerTest, TestIndexSearcher, BlobRepositoryCloudTest, TestSolr4Spatial2, TestInitQParser, TestExtendedDismaxParser, CdcrReplicationDistributedZkTest, SuggesterTest, ConnectionReuseTest, TestPivotHelperCode, HdfsBasicDistributedZk2Test, SolrGangliaReporterTest, ReturnFieldsTest, ChaosMonkeyNothingIsSafeTest, SystemInfoHandlerTest, HLLUtilTest, HighlighterMaxOffsetTest, SolrCloudExampleTest, TestCloudSearcherWarming, TestClusterStateMutator, DirectSolrConnectionTest, TestDocTermOrds, AnalysisErrorHandlingTest, TestStressLiveNodes, HdfsChaosMonkeySafeLeaderTest, TestComplexPhraseQParserPlugin, SpellPossibilityIteratorTest, TestCoreContainer, TestSegmentSorting, TestUseDocValuesAsStored, TestCoreDiscovery, ScriptEngineTest, TestScoreJoinQPScore, TestSQLHandler, TestXmlQParser, TestLMJelinekMercerSimilarityFactory, BufferStoreTest, TestPKIAuthenticationPlugin, PeerSyncWithIndexFingerprintCachingTest, DistributedFacetPivotSmallTest, TestMissingGroups, RequiredFieldsTest, CloneFieldUpdateProcessorFactoryTest, ClusterStateTest, SharedFSAutoReplicaFailoverTest, TestSolrDeletionPolicy2, JvmMetricsTest, TestConfigSetsAPIZkFailure, TestManagedResource, TestNonDefinedSimilarityFactory, DistributedSpellCheckComponentTest, InfixSuggestersTest, TestLFUCache, TestRandomRequestDistribution, SpatialRPTFieldTypeTest, TestDelegationWithHadoopAuth, TestSolrConfigHandler, TestHighFrequencyDictionaryFactory, DateRangeFieldTest, TestSortByMinMaxFunction, TestDistribDocBasedVersion, SortByFunctionTest, TestCharFilters, TestTrie, SpatialHeatmapFacetsTest, TestReRankQParserPlugin, VMParamsZkACLAndCredentialsProvidersTest, TestLMDirichletSimilarityFactory, CSVRequestHandlerTest, TestExceedMaxTermLength, MigrateRouteKeyTest, HttpPartitionTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestBlendedInfixSuggestions, HdfsRecoverLeaseTest, TimeZoneUtilsTest, TestFilteredDocIdSet, ConfigureRecoveryStrategyTest, SystemLogListenerTest, TestSchemaResource, TestOverriddenPrefixQueryForCustomFieldType, NodeMutatorTest, TestReplicationHandlerBackup, TestDistributedMissingSort, AutoAddReplicasPlanActionTest, DeleteNodeTest, TestTestInjection, EchoParamsTest, TestFunctionQuery, DistributedQueryComponentOptimizationTest, CollectionReloadTest, TemplateUpdateProcessorTest, ZkNodePropsTest, TestDynamicFieldResource, DeleteStatusTest, TestDistributedGrouping, BooleanFieldTest, ExplicitHLLTest, IndexBasedSpellCheckerTest, TestHashPartitioner, TestExactStatsCache, TestFuzzyAnalyzedSuggestions, IndexSchemaTest, NodeAddedTriggerTest, TestCloudNestedDocsSort, TestQuerySenderListener, SimplePostToolTest, TestCollectionsAPIViaSolrCloudCluster, DirectSolrSpellCheckerTest, QueryElevationComponentTest, XmlUpdateRequestHandlerTest, CustomCollectionTest, CdcrVersionReplicationTest, TestDistributedStatsComponentCardinality, SSLMigrationTest, TestZkAclsWithHadoopAuth, TestConfigSetProperties, TestHdfsCloudBackupRestore, SuggesterWFSTTest, TestSolrCloudWithSecureImpersonation, AlternateDirectoryTest, TestBlobHandler, TestManagedSynonymFilterFactory, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, LeaderElectionTest, ZkSolrClientTest, ZkCLITest, TestFaceting, ZkControllerTest, TestRealTimeGet, TestStressVersions, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, PeerSyncTest, TestLazyCores, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, QueryEqualityTest, SolrInfoBeanTest, TestSurroundQueryParser, FileBasedSpellCheckerTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, SolrPluginUtilsTest, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, BadComponentTest, MultiTermTest, TestDocSet, TestSearchPerf, OutputWriterTest, TestPhraseSuggestions, TestBM25SimilarityFactory, ResourceLoaderTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, PreAnalyzedFieldTest, CircularListTest, CursorPagingTest, TestTolerantSearch, TestLuceneIndexBackCompat, AssignTest, CloudExitableDirectoryReaderTest, CollectionsAPIAsyncDistributedZkTest, DeleteShardTest, DistribJoinFromCollectionTest, DistributedQueueTest, LeaderInitiatedRecoveryOnCommitTest, OverseerCollectionConfigSetProcessorTest, OverseerTaskQueueTest, SaslZkACLProviderTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudJSONFacetJoinDomain, TestCloudPseudoReturnFields, TestConfigSetsAPIExclusivity, TestCryptoKeys, TestLeaderInitiatedRecoveryThread, TestOnReconnectListenerSupport, TestPrepRecovery, TestReplicaProperties, TestSizeLimitedDistributedMap, TestTlogReplica, ExecutePlanActionTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ExecutePlanActionTest -Dtests.seed=9853E72070FAFBBA -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=de -Dtests.timezone=Etc/GMT+5 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J2 | ExecutePlanActionTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest:
[junit4] > 1) Thread[id=29474, name=AutoscalingActionExecutor-10086-thread-1-processing-n:127.0.0.1:46308_solr, state=TIMED_WAITING, group=TGRP-ExecutePlanActionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at java.lang.Thread.sleep(Thread.java:340)
[junit4] > at java.util.concurrent.TimeUnit.sleep(TimeUnit.java:386)
[junit4] > at org.apache.solr.cloud.autoscaling.ExecutePlanAction.waitForTaskToFinish(ExecutePlanAction.java:155)
[junit4] > at org.apache.solr.cloud.autoscaling.ScheduledTriggers.waitForPendingTasks(ScheduledTriggers.java:289)
[junit4] > at org.apache.solr.cloud.autoscaling.ScheduledTriggers.lambda$null$2(ScheduledTriggers.java:221)
[junit4] > at org.apache.solr.cloud.autoscaling.ScheduledTriggers$$Lambda$413/658744886.run(Unknown Source)
[junit4] > at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] > at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$$Lambda$118/353424776.run(Unknown Source)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([9853E72070FAFBBA]:0)
[junit4] Completed [659/745 (4!)] on J2 in 654.32s, 2 tests, 1 failure, 1 error <<< FAILURES!
[...truncated 47478 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2130 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2130/
15 tests failed.
FAILED: org.apache.solr.cloud.AssignBackwardCompatibilityTest.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.AssignBackwardCompatibilityTest.test(AssignBackwardCompatibilityTest.java:90)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 44 more
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
Error Message:
Error from server at https://127.0.0.1:36554/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000057
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:36554/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000057
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:CA106A79AB8F665E]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes(CollectionsAPIDistributedZkTest.java:334)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:40881/collection2]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:40881/collection2]
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:462)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:665)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40881/collection2: no servers hosting shard: shard3
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
... 49 more
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
The partitioned replica did not get marked down expected:<[down]> but was:<[active]>
Stack Trace:
org.junit.ComparisonFailure: The partitioned replica did not get marked down expected:<[down]> but was:<[active]>
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.junit.Assert.assertEquals(Assert.java:125)
at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:241)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.OverseerRolesTest.testOverseerRole
Error Message:
The old leader should have rejoined election
Stack Trace:
java.lang.AssertionError: The old leader should have rejoined election
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:4F9B42812BF2D89E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.OverseerRolesTest.testOverseerRole(OverseerRolesTest.java:145)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.RollingRestartTest.test
Error Message:
KeeperErrorCode = Session expired for /overseer_elect/leader
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderId(OverseerTaskProcessor.java:374)
at org.apache.solr.cloud.OverseerTaskProcessor.getLeaderNode(OverseerTaskProcessor.java:365)
at org.apache.solr.cloud.RollingRestartTest.waitUntilOverseerDesignateIsLeader(RollingRestartTest.java:137)
at org.apache.solr.cloud.RollingRestartTest.restartWithRolesTest(RollingRestartTest.java:104)
at org.apache.solr.cloud.RollingRestartTest.test(RollingRestartTest.java:52)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testBasics
Error Message:
Error from server at https://127.0.0.1:52116/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:52116/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:9388113928AFB03F]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:541)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:998)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:52116/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:518)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.TestDistribDocBasedVersion.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1172)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:692)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.getTotalReplicas(AbstractFullDistribZkTestBase.java:488)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:441)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1184)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
... 38 more
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
Error from server at http://127.0.0.1:53925/solr: Could not restore core
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:53925/solr: Could not restore core
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:275)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestLocalFSCloudBackupRestore.test
Error Message:
Error from server at https://127.0.0.1:54806/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000005
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:54806/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000005
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:275)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth
Error Message:
Error from server at https://127.0.0.1:38493/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:38493/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000000
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:25040E72B2DEAF33]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:200)
at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:172)
at org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth(TestSSLRandomization.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test
Error Message:
Trigger was not fired
Stack Trace:
java.lang.AssertionError: Trigger was not fired
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:150)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:60623_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:60623_solr wasn't created
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:B6EA37191E7423A0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.hdfs.StressHdfsTest.test
Error Message:
Error from server at http://127.0.0.1:38162/delete_data_dir: Cannot talk to ZooKeeper - Updates are disabled.
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38162/delete_data_dir: Cannot talk to ZooKeeper - Updates are disabled.
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:260480CFBEBD83B7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
at org.apache.solr.cloud.hdfs.StressHdfsTest.createAndDeleteCollection(StressHdfsTest.java:189)
at org.apache.solr.cloud.hdfs.StressHdfsTest.test(StressHdfsTest.java:104)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory
Error Message:
action did not execute
Stack Trace:
java.lang.AssertionError: action did not execute
at __randomizedtesting.SeedInfo.seed([AE50BF151041EE4F:C3AC1BE8AA091148]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.testHistory(AutoscalingHistoryHandlerTest.java:260)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11601 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 90315 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_AE50BF151041EE4F-001/init-core-data-001
[junit4] 2> 90335 WARN (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 90336 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 90354 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 90459 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.TriggerIntegrationTest_AE50BF151041EE4F-001/tempDir-001
[junit4] 2> 90519 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 90573 INFO (Thread-5) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 90574 INFO (Thread-5) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 91346 INFO (SUITE-TriggerIntegrationTest-seed#[AE50BF151041EE4F]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:49653
[junit4] 2> 92775 ERROR (Thread-5) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 94654 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f4919f0a50000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 96880 INFO (jetty-launcher-9-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 96962 INFO (jetty-launcher-9-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 97767 INFO (jetty-launcher-9-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6599c996{/solr,null,AVAILABLE}
[junit4] 2> 98310 INFO (jetty-launcher-9-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@660a306e{/solr,null,AVAILABLE}
[junit4] 2> 100842 INFO (jetty-launcher-9-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24b0f248{SSL,[ssl, http/1.1]}{127.0.0.1:45902}
[junit4] 2> 100842 INFO (jetty-launcher-9-thread-2) [ ] o.e.j.s.Server Started @116872ms
[junit4] 2> 100843 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45902}
[junit4] 2> 100868 INFO (jetty-launcher-9-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@681d382e{SSL,[ssl, http/1.1]}{127.0.0.1:38225}
[junit4] 2> 101012 INFO (jetty-launcher-9-thread-1) [ ] o.e.j.s.Server Started @117041ms
[junit4] 2> 101012 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38225}
[junit4] 2> 101140 ERROR (jetty-launcher-9-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 101140 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 101140 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 101183 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 101206 ERROR (jetty-launcher-9-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 101207 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 101207 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 101207 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 101524 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-23T11:59:27.595Z
[junit4] 2> 101542 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 101595 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-23T11:59:27.573Z
[junit4] 2> 101713 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 101752 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 102762 INFO (jetty-launcher-9-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49653/solr
[junit4] 2> 102786 INFO (jetty-launcher-9-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:49653/solr
[junit4] 2> 103478 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f4919f0a50004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 106589 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 106592 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38225_solr
[junit4] 2> 106611 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.Overseer Overseer (id=98878092585795590-127.0.0.1:38225_solr-n_0000000000) starting
[junit4] 2> 107164 INFO (jetty-launcher-9-thread-2) [n:127.0.0.1:45902_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 107173 INFO (jetty-launcher-9-thread-2) [n:127.0.0.1:45902_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45902_solr
[junit4] 2> 107262 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:38225_solr) [n:127.0.0.1:38225_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 107298 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:45902_solr) [n:127.0.0.1:45902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 108072 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38225_solr
[junit4] 2> 108096 INFO (zkCallback-20-thread-1-processing-n:127.0.0.1:45902_solr) [n:127.0.0.1:45902_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 108162 INFO (OverseerStateUpdate-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 108642 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 108698 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 109634 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 109634 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 109634 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 109771 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 109772 DEBUG (OverseerAutoScalingTriggerThread-98878092585795590-127.0.0.1:38225_solr-n_0000000000) [n:127.0.0.1:38225_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 109782 DEBUG (ScheduledTrigger-58-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 110954 DEBUG (ScheduledTrigger-58-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 112339 DEBUG (ScheduledTrigger-58-thread-2) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 113342 DEBUG (ScheduledTrigger-58-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 114342 DEBUG (ScheduledTrigger-58-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:45902_solr, 127.0.0.1:38225_solr]
[junit4] 2> 114681 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38225.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4fbcdd7d
[junit4] 2> 114700 INFO (jetty-launcher-9-thread-2) [n:127.0.0.1:45902_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45902.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4fbcdd7d
[junit4] 2> 114703 INFO (jetty-launcher-9-thread-1) [n:127.0.0.1:38225_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38225.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4fbcdd7d
[junit4] 2> 114703 INFO (jetty-launcher-9-thread-2) [n:127.0.0.1:45902_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45902.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4fbcdd7
[...truncated too long message...]
eds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/byte-buddy-1.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/commons-math3-3.6.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/hadoop-common-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/hadoop-hdfs-2.7.4-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/hadoop-minikdc-2.7.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/htrace-core-3.2.0-incubating.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/jetty-sslengine-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/mockito-core-2.6.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/netty-all-4.0.36.Final.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/test-lib/objenesis-2.5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/analysis/icu/lucene-analyzers-icu-8.0.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/queryparser/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/backward-codecs/classes/test:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/contrib/analysis-extras/lib/icu4j-59.1.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-log4j.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-junit4.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jai.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-javamail.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bsf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-net.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-antlr.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jsch.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-oro.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-commons-logging.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-netrexx.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-testutil.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jdepend.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-bcel.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-xalan2.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-resolver.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-jmf.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-apache-regexp.jar:/home/jenkins/tools/ant/apache-ant-1.8.4/lib/ant-swing.jar:/usr/local/asfpackages/java/jdk1.8.0_144/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.5.3.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1463167250817074923581.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1467773983180180687632.suites -stdin
[junit4] ERROR: JVM J0 ended with an exception: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1465221046348723899161.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1467028604370899767541.syserr
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1519)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:126)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:982)
[junit4] at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:979)
[junit4] at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] at java.lang.Thread.run(Thread.java:748)
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:770: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:262: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/common-build.xml:556: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1494: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:1021: At least one slave process threw an exception, first: Forked process returned with error code: 1. Very likely a JVM crash. See process stdout at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1465221046348723899161.sysout See process stderr at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/temp/junit4-J0-20171023_115730_1467028604370899767541.syserr
Total time: 342 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[Fast Archiver] No artifacts from Lucene-Solr-Tests-master #2129 to compare, so performing full copy of artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2129 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2129/
2 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([FD3C031AEBC243CD:47190B5D7B70E47]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testDistributions
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([7250DBC30104CAF3:CDAF9A69DFFE2A6F]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testDistributions(StreamExpressionTest.java:6137)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13474 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> 4793504 INFO (SUITE-ShardSplitTest-seed#[FD3C031AEBC243CD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/init-core-data-001
[junit4] 2> 4793504 WARN (SUITE-ShardSplitTest-seed#[FD3C031AEBC243CD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 4793505 INFO (SUITE-ShardSplitTest-seed#[FD3C031AEBC243CD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 4793506 INFO (SUITE-ShardSplitTest-seed#[FD3C031AEBC243CD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 4793506 INFO (SUITE-ShardSplitTest-seed#[FD3C031AEBC243CD]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 4793519 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 4793520 INFO (Thread-7175) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 4793520 INFO (Thread-7175) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 4793521 ERROR (Thread-7175) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 4793628 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkTestServer start zk server on port:40479
[junit4] 2> 4793697 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 4793731 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 4793731 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 4793732 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 4793733 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 4793733 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 4793734 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 4793768 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 4793769 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 4793770 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 4793770 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 4793788 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 4795009 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 4795065 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c47f26c{/,null,AVAILABLE}
[junit4] 2> 4795065 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5564025e{HTTP/1.1,[http/1.1]}{127.0.0.1:43876}
[junit4] 2> 4795081 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server Started @4809054ms
[junit4] 2> 4795081 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=43876, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/control-001/cores}
[junit4] 2> 4795081 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4795082 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 4795082 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4795082 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 4795082 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-22T13:47:23.370Z
[junit4] 2> 4795098 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4795098 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/control-001/solr.xml
[junit4] 2> 4795134 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 4795134 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 4795136 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 4795151 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40479/solr
[junit4] 2> 4795555 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4795555 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43876_
[junit4] 2> 4795556 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.c.Overseer Overseer (id=98872855219929092-127.0.0.1:43876_-n_0000000000) starting
[junit4] 2> 4795626 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43876_
[junit4] 2> 4795627 INFO (OverseerStateUpdate-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4796139 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4796176 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4796177 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4796191 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:43876_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/control-001/cores
[junit4] 2> 4796267 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4796285 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40479/solr ready
[junit4] 2> 4796399 INFO (qtp844517462-20248) [n:127.0.0.1:43876_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43876_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4796448 INFO (OverseerThreadFactory-6844-thread-1-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 4796630 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 4796631 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 4796760 INFO (zkCallback-3266-thread-1-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 4797858 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4797916 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 4798482 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 4798553 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 4798553 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4798554 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4798554 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 4798575 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=79.822265625, floorSegmentMB=0.67578125, forceMergeDeletesPctAllowed=1.409797112402782, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 4798599 WARN (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 4798893 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4798893 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4798927 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4798927 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4798928 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 4798979 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70aba65f[control_collection_shard1_replica_n1] main]
[junit4] 2> 4799036 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4799052 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4799053 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 4799053 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581965689320636416
[junit4] 2> 4799055 INFO (searcherExecutor-6847-thread-1-processing-n:127.0.0.1:43876_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@70aba65f[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4799138 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4799139 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4799139 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43876/control_collection_shard1_replica_n1/
[junit4] 2> 4799139 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4799139 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:43876/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 4799139 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 4799141 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43876/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 4799301 INFO (zkCallback-3266-thread-2-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 4799345 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4799402 INFO (qtp844517462-20246) [n:127.0.0.1:43876_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2771
[junit4] 2> 4799520 INFO (qtp844517462-20248) [n:127.0.0.1:43876_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 4799521 INFO (OverseerCollectionConfigSetProcessor-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4799694 INFO (zkCallback-3266-thread-2-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 4800537 INFO (qtp844517462-20248) [n:127.0.0.1:43876_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:43876_&wt=javabin&version=2} status=0 QTime=4138
[junit4] 2> 4800688 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4800688 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40479/solr ready
[junit4] 2> 4800688 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 4800695 INFO (qtp844517462-20249) [n:127.0.0.1:43876_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4800748 INFO (OverseerThreadFactory-6844-thread-2-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 4800749 WARN (OverseerThreadFactory-6844-thread-2-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 4801042 INFO (qtp844517462-20249) [n:127.0.0.1:43876_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 4801042 INFO (qtp844517462-20249) [n:127.0.0.1:43876_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=346
[junit4] 2> 4801043 INFO (OverseerCollectionConfigSetProcessor-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4802348 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001 of type TLOG
[junit4] 2> 4802349 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 4802398 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@174f8a18{/,null,AVAILABLE}
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ef9ed0f{HTTP/1.1,[http/1.1]}{127.0.0.1:37444}
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server Started @4816372ms
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=37444, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001/cores}
[junit4] 2> 4802399 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 4802399 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-22T13:47:30.687Z
[junit4] 2> 4802597 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4802597 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001/solr.xml
[junit4] 2> 4802600 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 4802600 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 4802671 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 4802683 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40479/solr
[junit4] 2> 4802720 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 4802721 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4802722 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37444_
[junit4] 2> 4802780 INFO (zkCallback-3266-thread-2-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4802792 INFO (zkCallback-3274-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4802902 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 4803178 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4803229 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4803229 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4803284 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:37444_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001/cores
[junit4] 2> 4803450 INFO (qtp1957652114-20295) [n:127.0.0.1:37444_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37444_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4803472 INFO (OverseerThreadFactory-6844-thread-3-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37444_ for creating new replica
[junit4] 2> 4803484 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 4803484 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 4803486 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 4804684 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4804775 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 4805206 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 4805341 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 4805341 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4805341 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4805341 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 4805344 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=79.822265625, floorSegmentMB=0.67578125, forceMergeDeletesPctAllowed=1.409797112402782, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 4805408 WARN (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 4805849 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4805849 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4805850 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4805850 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4805851 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 4805851 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@3b24ba35[collection1_shard2_replica_t41] main]
[junit4] 2> 4805852 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4805852 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4805886 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 4805887 INFO (searcherExecutor-6858-thread-1-processing-n:127.0.0.1:37444_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@3b24ba35[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4805887 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581965696486604800
[junit4] 2> 4805903 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4805903 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4805903 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37444/collection1_shard2_replica_t41/
[junit4] 2> 4805904 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4805904 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:37444/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 4805904 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 4805904 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 4805923 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37444/collection1_shard2_replica_t41/ shard2
[junit4] 2> 4805923 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 4805924 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4805938 INFO (qtp1957652114-20293) [n:127.0.0.1:37444_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2454
[junit4] 2> 4805941 INFO (qtp1957652114-20295) [n:127.0.0.1:37444_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:37444_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2491
[junit4] 2> 4806048 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 4806978 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001 of type TLOG
[junit4] 2> 4806979 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 4806980 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59f62da{/,null,AVAILABLE}
[junit4] 2> 4806980 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@43e67f3e{HTTP/1.1,[http/1.1]}{127.0.0.1:38902}
[junit4] 2> 4806980 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server Started @4820953ms
[junit4] 2> 4806980 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=38902, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001/cores}
[junit4] 2> 4806980 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4806995 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 4806995 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4806995 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 4806995 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-22T13:47:35.283Z
[junit4] 2> 4807092 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4807092 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001/solr.xml
[junit4] 2> 4807095 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 4807095 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 4807096 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 4807105 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40479/solr
[junit4] 2> 4807135 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 4807136 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4807162 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38902_
[junit4] 2> 4807230 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4807230 INFO (zkCallback-3274-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4807250 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4807230 INFO (zkCallback-3266-thread-1-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 4807612 INFO (OverseerCollectionConfigSetProcessor-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4807798 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4807853 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4807853 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4807854 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38902_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001/cores
[junit4] 2> 4808024 INFO (qtp1957652114-20297) [n:127.0.0.1:37444_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38902_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4808079 INFO (OverseerThreadFactory-6844-thread-4-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:38902_ for creating new replica
[junit4] 2> 4808091 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 4808092 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 4808158 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4808158 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4809165 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4809221 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 4809697 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 4809816 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 4809816 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4809817 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4809817 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 4809836 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=79.822265625, floorSegmentMB=0.67578125, forceMergeDeletesPctAllowed=1.409797112402782, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 4809946 WARN (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 4810273 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4810274 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4810275 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4810275 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4810276 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 4810294 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@5eb9a672[collection1_shard1_replica_t43] main]
[junit4] 2> 4810295 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4810295 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4810295 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 4810296 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581965701109776384
[junit4] 2> 4810298 INFO (searcherExecutor-6869-thread-1-processing-n:127.0.0.1:38902_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@5eb9a672[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38902/collection1_shard1_replica_t43/
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:38902/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 4810311 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 4810312 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 4810314 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4810346 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38902/collection1_shard1_replica_t43/ shard1
[junit4] 2> 4810347 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4810347 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 4810348 INFO (qtp348907851-20325) [n:127.0.0.1:38902_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2256
[junit4] 2> 4810423 INFO (OverseerCollectionConfigSetProcessor-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4810424 INFO (qtp1957652114-20297) [n:127.0.0.1:37444_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38902_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=2400
[junit4] 2> 4810582 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4810582 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 4811089 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001 of type TLOG
[junit4] 2> 4811089 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 4811152 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@79706f22{/,null,AVAILABLE}
[junit4] 2> 4811152 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@61a6eb2e{HTTP/1.1,[http/1.1]}{127.0.0.1:38252}
[junit4] 2> 4811152 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.e.j.s.Server Started @4825125ms
[junit4] 2> 4811152 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=38252, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001/cores}
[junit4] 2> 4811153 ERROR (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 4811172 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 4811172 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 4811172 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 4811172 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-22T13:47:39.460Z
[junit4] 2> 4811257 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 4811257 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001/solr.xml
[junit4] 2> 4811260 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 4811260 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 4811294 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 4811331 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40479/solr
[junit4] 2> 4811516 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 4811517 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 4811579 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38252_
[junit4] 2> 4811580 INFO (zkCallback-3274-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4811580 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4811580 INFO (zkCallback-3266-thread-1-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4811660 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4811696 INFO (zkCallback-3291-thread-1-processing-n:127.0.0.1:38252_) [n:127.0.0.1:38252_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 4812099 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4812175 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4812176 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4812230 INFO (TEST-ShardSplitTest.testSplitAfterFailedSplit-seed#[FD3C031AEBC243CD]) [n:127.0.0.1:38252_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001/cores
[junit4] 2> 4812689 INFO (qtp1957652114-20298) [n:127.0.0.1:37444_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38252_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 4812742 INFO (OverseerThreadFactory-6844-thread-5-processing-n:127.0.0.1:43876_) [n:127.0.0.1:43876_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:38252_ for creating new replica
[junit4] 2> 4812778 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 4812779 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 4812781 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4812798 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4812891 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 4812964 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 4813482 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 4813571 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 4813571 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@512bb065
[junit4] 2> 4813571 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 4813571 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FD3C031AEBC243CD-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 4813574 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=18, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=79.822265625, floorSegmentMB=0.67578125, forceMergeDeletesPctAllowed=1.409797112402782, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 4813646 WARN (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 4813900 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 4813900 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 4813901 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 4813901 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 4813902 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=21, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 4813922 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@21fadfd4[collection1_shard2_replica_t45] main]
[junit4] 2> 4813922 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 4813923 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 4813923 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 4813924 INFO (searcherExecutor-6880-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@21fadfd4[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 4813924 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581965704914010112
[junit4] 2> 4813940 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 4813954 INFO (qtp1459404735-20354) [n:127.0.0.1:38252_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1175
[junit4] 2> 4813966 INFO (updateExecutor-3288-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 4813966 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 4813981 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 4813982 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 4813982 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 4813982 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 4813982 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:37444/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:38252/collection1_shard2_replica_t45/]
[junit4] 2> 4814015 INFO (qtp1957652114-20298) [n:127.0.0.1:37444_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38252_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1326
[junit4] 2> 4814042 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:37444]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:38252_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 4814124 INFO (zkCallback-3285-thread-1-processing-n:127.0.0.1:38902_) [n:127.0.0.1:38902_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4814124 INFO (zkCallback-3279-thread-1-processing-n:127.0.0.1:37444_) [n:127.0.0.1:37444_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4814124 INFO (zkCallback-3291-thread-1-processing-n:127.0.0.1:38252_) [n:127.0.0.1:38252_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 4814201 INFO (qtp1957652114-20292) [n:127.0.0.1:37444_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 4814218 INFO (qtp1957652114-20292) [n:127.0.0.1:37444_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:38252_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:38252","node_name":"127.0.0.1:38252_","state":"recovering","type":"TLOG"}
[junit4] 2> 4814218 INFO (qtp1957652114-20292) [n:127.0.0.1:37444_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 4814218 INFO (qtp1957652114-20292) [n:127.0.0.1:37444_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:38252_&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=44
[junit4] 2> 4814702 INFO (OverseerCollectionConfigSetProcessor-98872855219929092-127.0.0.1:43876_-n_0000000000) [n:127.0.0.1:43876_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 4814734 INFO (recoveryExecutor-3289-thread-1-processing-n:127.0.0.1:38252_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:38252_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 4814734 INFO (rec
[...truncated too long message...]
N (zkCallback-2053-thread-1-processing-n:127.0.0.1:39574_solr x:collection1_shard2_replica_n2 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:39574_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 708141 INFO (jetty-closer-393-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98872993218363401-127.0.0.1:39574_solr-n_0000000000) closing
[junit4] 2> 708145 INFO (OverseerStateUpdate-98872993218363401-127.0.0.1:39574_solr-n_0000000000) [n:127.0.0.1:39574_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:39574_solr
[junit4] 2> 708146 INFO (jetty-closer-393-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ae62dc6{/solr,null,UNAVAILABLE}
[junit4] 2> 708158 WARN (OverseerAutoScalingTriggerThread-98872993218363401-127.0.0.1:39574_solr-n_0000000000) [n:127.0.0.1:39574_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 708166 INFO (jetty-closer-393-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@252084c7{/solr,null,UNAVAILABLE}
[junit4] 2> 708210 WARN (zkCallback-415-thread-3-processing-n:127.0.0.1:41362_solr) [n:127.0.0.1:41362_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:43291_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:43291_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:392)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:389)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:389)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:749)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:748)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1154)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1149)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 708211 INFO (jetty-closer-393-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c94bbab{/solr,null,UNAVAILABLE}
[junit4] 2> 708211 ERROR (SUITE-StreamExpressionTest-seed#[7250DBC30104CAF3]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 708212 INFO (SUITE-StreamExpressionTest-seed#[7250DBC30104CAF3]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39184 39184
[junit4] 2> 708289 INFO (Thread-107) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39184 39184
[junit4] 2> 708290 WARN (Thread-107) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 101 /solr/aliases.json
[junit4] 2> 101 /solr/clusterprops.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 8 /solr/configs/ml
[junit4] 2> 4 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 101 /solr/clusterstate.json
[junit4] 2> 44 /solr/collections/destinationCollection/state.json
[junit4] 2> 30 /solr/collections/parallelDestinationCollection1/state.json
[junit4] 2> 24 /solr/collections/parallelDestinationCollection/state.json
[junit4] 2> 16 /solr/collections/collection1/state.json
[junit4] 2> 12 /solr/collections/mainCorpus1/state.json
[junit4] 2> 12 /solr/collections/destination/state.json
[junit4] 2> 12 /solr/collections/destination1/state.json
[junit4] 2> 12 /solr/collections/workQueue1/state.json
[junit4] 2> 12 /solr/collections/workQueue/state.json
[junit4] 2> 12 /solr/collections/modelCollection/state.json
[junit4] 2> 12 /solr/collections/mainCorpus/state.json
[junit4] 2> 10 /solr/collections/uknownCollection/state.json
[junit4] 2> 10 /solr/collections/checkpointCollection/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 101 /solr/live_nodes
[junit4] 2> 101 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_7250DBC30104CAF3-001
[junit4] 2> Oct 22, 2017 2:28:35 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {name_s=PostingsFormat(name=Direct), expr_s=BlockTreeOrds(blocksize=128), terms_ss=PostingsFormat(name=LuceneFixedGap), join2_s=PostingsFormat(name=LuceneFixedGap), field_s=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=LuceneFixedGap), subject=PostingsFormat(name=LuceneFixedGap), a1_s=Lucene50(blocksize=128), a2_s=BlockTreeOrds(blocksize=128), level1_s=BlockTreeOrds(blocksize=128), body_t=PostingsFormat(name=Direct), s_multi=BlockTreeOrds(blocksize=128), col_s=Lucene50(blocksize=128), a_ss=PostingsFormat(name=LuceneFixedGap), level2_s=Lucene50(blocksize=128), a_s=BlockTreeOrds(blocksize=128), tv_text=Lucene50(blocksize=128), term_s=PostingsFormat(name=LuceneFixedGap), a_t=PostingsFormat(name=LuceneFixedGap), text_s=BlockTreeOrds(blocksize=128), id=PostingsFormat(name=Direct), text=BlockTreeOrds(blocksize=128), featureSet_s=Lucene50(blocksize=128), checkpoint_ss=PostingsFormat(name=Direct), test_t=PostingsFormat(name=Direct), ident_s=Lucene50(blocksize=128), whitetok=PostingsFormat(name=Direct), side_s=PostingsFormat(name=Direct)}, docValues:{name_s=DocValuesFormat(name=Memory), expr_s=DocValuesFormat(name=Direct), iteration_i=DocValuesFormat(name=Memory), terms_ss=DocValuesFormat(name=Lucene70), join2_s=DocValuesFormat(name=Lucene70), field_s=DocValuesFormat(name=Lucene70), multiDefault=DocValuesFormat(name=Lucene70), price_f=DocValuesFormat(name=Lucene70), a1_s=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Lucene70), a_f=DocValuesFormat(name=Lucene70), join1_i=DocValuesFormat(name=Direct), falseNegative_i=DocValuesFormat(name=Lucene70), a2_s=DocValuesFormat(name=Direct), a_i=DocValuesFormat(name=Memory), join3_i=DocValuesFormat(name=Memory), test_i=DocValuesFormat(name=Lucene70), falsePositive_i=DocValuesFormat(name=Lucene70), field_i=DocValuesFormat(name=Lucene70), level1_s=DocValuesFormat(name=Direct), s_multi=DocValuesFormat(name=Direct), col_s=DocValuesFormat(name=Lucene70), a_ss=DocValuesFormat(name=Lucene70), level2_s=DocValuesFormat(name=Lucene70), a_s=DocValuesFormat(name=Direct), score_f=DocValuesFormat(name=Direct), term_s=DocValuesFormat(name=Lucene70), text_s=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Lucene70), i_multi=DocValuesFormat(name=Memory), featureSet_s=DocValuesFormat(name=Lucene70), trueNegative_i=DocValuesFormat(name=Direct), index_i=DocValuesFormat(name=Lucene70), b_ls=DocValuesFormat(name=Lucene70), test_dt=DocValuesFormat(name=Direct), out_i=DocValuesFormat(name=Lucene70), checkpoint_ss=DocValuesFormat(name=Memory), ident_s=DocValuesFormat(name=Lucene70), order_i=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Lucene70), side_s=DocValuesFormat(name=Memory), truePositive_i=DocValuesFormat(name=Direct), miles_i=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=805, maxMBSortInHeap=6.127380794038093, sim=RandomSimilarity(queryNorm=false): {}, locale=en-US, timezone=Africa/Lome
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=49070144,total=369623040
[junit4] 2> NOTE: All tests run in this JVM: [TestCoreAdmin, SolrExampleBinaryTest, GraphExpressionTest, SquareRootEvaluatorTest, StreamingTest, NamedListTest, HttpSolrClientConPoolTest, TestPolicy, SolrExceptionTest, JettyWebappTest, SolrExampleXMLTest, TestZkConfigManager, CloudSolrClientCacheTest, StreamExpressionTest]
[junit4] Completed [135/145 (1!)] on J2 in 369.10s, 121 tests, 1 failure <<< FAILURES!
[...truncated 46245 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2128 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2128/
2 tests failed.
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t3","base_url":"http://127.0.0.1:44301/dcb/z","node_name":"127.0.0.1:44301_dcb%2Fz","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/31)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "core":"c8n_1x3_lf_shard1_replica_t1", "base_url":"http://127.0.0.1:34804/dcb/z", "node_name":"127.0.0.1:34804_dcb%2Fz", "state":"down", "type":"TLOG"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_t3", "base_url":"http://127.0.0.1:44301/dcb/z", "node_name":"127.0.0.1:44301_dcb%2Fz", "state":"active", "type":"TLOG", "leader":"true"}, "core_node6":{ "state":"down", "base_url":"http://127.0.0.1:37034/dcb/z", "core":"c8n_1x3_lf_shard1_replica_t2", "node_name":"127.0.0.1:37034_dcb%2Fz", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"0", "tlogReplicas":"3"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t3","base_url":"http://127.0.0.1:44301/dcb/z","node_name":"127.0.0.1:44301_dcb%2Fz","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/31)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"c8n_1x3_lf_shard1_replica_t1",
"base_url":"http://127.0.0.1:34804/dcb/z",
"node_name":"127.0.0.1:34804_dcb%2Fz",
"state":"down",
"type":"TLOG"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_t3",
"base_url":"http://127.0.0.1:44301/dcb/z",
"node_name":"127.0.0.1:44301_dcb%2Fz",
"state":"active",
"type":"TLOG",
"leader":"true"},
"core_node6":{
"state":"down",
"base_url":"http://127.0.0.1:37034/dcb/z",
"core":"c8n_1x3_lf_shard1_replica_t2",
"node_name":"127.0.0.1:37034_dcb%2Fz",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"0",
"tlogReplicas":"3"}
at __randomizedtesting.SeedInfo.seed([4CF5765B3D1012F3:C4A1498193EC7F0B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([4CF5765B3D1012F3:C7D2A58A7C16B977]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:908)
at org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey(ShardSplitTest.java:436)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12283 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> 1411366 INFO (SUITE-ShardSplitTest-seed#[4CF5765B3D1012F3]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/init-core-data-001
[junit4] 2> 1411366 WARN (SUITE-ShardSplitTest-seed#[4CF5765B3D1012F3]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=3 numCloses=3
[junit4] 2> 1411366 INFO (SUITE-ShardSplitTest-seed#[4CF5765B3D1012F3]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1411368 INFO (SUITE-ShardSplitTest-seed#[4CF5765B3D1012F3]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1411368 INFO (SUITE-ShardSplitTest-seed#[4CF5765B3D1012F3]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /yc/pm
[junit4] 2> 1411383 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1411402 INFO (Thread-1151) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1411402 INFO (Thread-1151) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1411422 ERROR (Thread-1151) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1411511 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkTestServer start zk server on port:36796
[junit4] 2> 1411852 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1411865 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1411866 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1411867 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1411867 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1411868 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1411886 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1411902 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1411903 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1411904 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1411904 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1411922 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f40b04d960001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1411922 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 1413251 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1413453 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47740174{/yc/pm,null,AVAILABLE}
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@15ea907c{HTTP/1.1,[http/1.1]}{127.0.0.1:35343}
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server Started @1429336ms
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/tempDir-001/control/data, hostContext=/yc/pm, hostPort=35343, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/control-001/cores}
[junit4] 2> 1413454 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1413454 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-21T20:46:58.950Z
[junit4] 2> 1413623 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1413623 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/control-001/solr.xml
[junit4] 2> 1413660 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1413661 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1413662 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1413807 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36796/solr
[junit4] 2> 1415118 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1415191 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35343_yc%2Fpm
[junit4] 2> 1415341 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.Overseer Overseer (id=98868842785538052-127.0.0.1:35343_yc%2Fpm-n_0000000000) starting
[junit4] 2> 1415802 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35343_yc%2Fpm
[junit4] 2> 1415923 INFO (zkCallback-464-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1416400 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1416436 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1416436 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1416451 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/control-001/cores
[junit4] 2> 1417057 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1417058 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36796/solr ready
[junit4] 2> 1417290 INFO (qtp2115813699-4226) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35343_yc%252Fpm&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1417416 INFO (OverseerThreadFactory-1293-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1417896 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1417896 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1418042 INFO (zkCallback-464-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1419103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1419170 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1420011 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1420425 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1420426 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1420463 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1420463 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1420499 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=81.708984375, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=9.767104575680225, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5766219367441728
[junit4] 2> 1420552 WARN (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1420956 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1420956 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1420957 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1420957 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1420958 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=74.62109375, floorSegmentMB=1.4375, forceMergeDeletesPctAllowed=10.92390037098098, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4197074315939172
[junit4] 2> 1420958 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@46f296e5[control_collection_shard1_replica_n1] main]
[junit4] 2> 1420959 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1420960 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1420993 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1420993 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581901494604529664
[junit4] 2> 1421079 INFO (searcherExecutor-1296-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@46f296e5[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35343/yc/pm/control_collection_shard1_replica_n1/
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35343/yc/pm/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1421103 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1421105 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35343/yc/pm/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1421244 INFO (zkCallback-464-thread-2-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1421321 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1421322 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3426
[junit4] 2> 1421375 INFO (qtp2115813699-4226) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1421432 INFO (zkCallback-464-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1421505 INFO (OverseerCollectionConfigSetProcessor-98868842785538052-127.0.0.1:35343_yc%2Fpm-n_0000000000) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1422375 INFO (qtp2115813699-4226) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35343_yc%252Fpm&wt=javabin&version=2} status=0 QTime=5085
[junit4] 2> 1422474 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1422474 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36796/solr ready
[junit4] 2> 1422474 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1422475 INFO (qtp2115813699-4227) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1422542 INFO (OverseerThreadFactory-1293-thread-2-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1422543 WARN (OverseerThreadFactory-1293-thread-2-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1422802 INFO (qtp2115813699-4227) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1422819 INFO (qtp2115813699-4227) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=343
[junit4] 2> 1423678 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001 of type TLOG
[junit4] 2> 1423679 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@24d7147a{/yc/pm,null,AVAILABLE}
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7fdf7670{HTTP/1.1,[http/1.1]}{127.0.0.1:44296}
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server Started @1439562ms
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/yc/pm, hostPort=44296, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001/cores}
[junit4] 2> 1423680 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1423680 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-21T20:47:09.176Z
[junit4] 2> 1423809 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1423809 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001/solr.xml
[junit4] 2> 1423824 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1423824 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1423844 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1423862 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36796/solr
[junit4] 2> 1423960 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1423961 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1423975 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44296_yc%2Fpm
[junit4] 2> 1424012 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1424124 INFO (zkCallback-464-thread-2-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1424132 INFO (zkCallback-472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1424462 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1424500 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1424500 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1424514 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001/cores
[junit4] 2> 1424543 INFO (OverseerCollectionConfigSetProcessor-98868842785538052-127.0.0.1:35343_yc%2Fpm-n_0000000000) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1424642 INFO (qtp2115813699-4230) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44296_yc%252Fpm&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1424657 INFO (OverseerThreadFactory-1293-thread-3-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:44296_yc%2Fpm for creating new replica
[junit4] 2> 1424716 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1424716 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1424978 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1425149 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 1426044 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1426152 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 1426152 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1426152 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1426153 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 1426224 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=81.708984375, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=9.767104575680225, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5766219367441728
[junit4] 2> 1426314 WARN (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1426642 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1426642 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1426643 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1426643 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1426651 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=74.62109375, floorSegmentMB=1.4375, forceMergeDeletesPctAllowed=10.92390037098098, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4197074315939172
[junit4] 2> 1426675 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@79472497[collection1_shard2_replica_t41] main]
[junit4] 2> 1426679 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1426680 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1426680 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1426680 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581901500567781376
[junit4] 2> 1426810 INFO (searcherExecutor-1307-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@79472497[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44296/yc/pm/collection1_shard2_replica_t41/
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:44296/yc/pm/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1426812 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 1426826 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44296/yc/pm/collection1_shard2_replica_t41/ shard2
[junit4] 2> 1426827 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1426882 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1426884 INFO (qtp116365062-4273) [n:127.0.0.1:44296_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2168
[junit4] 2> 1426964 INFO (qtp2115813699-4230) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44296_yc%252Fpm&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2322
[junit4] 2> 1426993 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1427861 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001 of type TLOG
[junit4] 2> 1427861 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1427862 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36d1ba25{/yc/pm,null,AVAILABLE}
[junit4] 2> 1427862 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4a206309{HTTP/1.1,[http/1.1]}{127.0.0.1:35711}
[junit4] 2> 1427862 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server Started @1443744ms
[junit4] 2> 1427862 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/yc/pm, hostPort=35711, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001/cores}
[junit4] 2> 1427862 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1427884 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1427884 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1427884 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1427884 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-21T20:47:13.380Z
[junit4] 2> 1427950 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1427950 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001/solr.xml
[junit4] 2> 1428006 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1428007 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1428008 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1428015 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36796/solr
[junit4] 2> 1428079 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f40b04d96000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1428222 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1428223 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1428225 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35711_yc%2Fpm
[junit4] 2> 1428238 INFO (zkCallback-472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1428349 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1428350 INFO (zkCallback-464-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1428368 INFO (zkCallback-483-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1428715 INFO (OverseerCollectionConfigSetProcessor-98868842785538052-127.0.0.1:35343_yc%2Fpm-n_0000000000) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1429023 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1429079 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1429079 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1429097 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001/cores
[junit4] 2> 1429683 INFO (qtp2115813699-4223) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35711_yc%252Fpm&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1429701 INFO (OverseerThreadFactory-1293-thread-4-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35711_yc%2Fpm for creating new replica
[junit4] 2> 1429773 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1429774 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1429776 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1429884 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1429995 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 1433636 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1433751 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 1433751 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1433752 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1433752 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 1433787 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=81.708984375, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=9.767104575680225, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5766219367441728
[junit4] 2> 1433960 WARN (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1434184 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1434184 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1434185 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1434185 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1434187 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=74.62109375, floorSegmentMB=1.4375, forceMergeDeletesPctAllowed=10.92390037098098, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4197074315939172
[junit4] 2> 1434204 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@12e6312b[collection1_shard1_replica_t43] main]
[junit4] 2> 1434205 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1434205 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1434206 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1434230 INFO (searcherExecutor-1318-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@12e6312b[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1434230 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581901508484530176
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35711/yc/pm/collection1_shard1_replica_t43/
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:35711/yc/pm/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1434243 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 1434263 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35711/yc/pm/collection1_shard1_replica_t43/ shard1
[junit4] 2> 1434265 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1434273 INFO (zkCallback-483-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1434318 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1434321 INFO (qtp151574905-4302) [n:127.0.0.1:35711_yc%2Fpm c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=4547
[junit4] 2> 1434332 INFO (qtp2115813699-4223) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35711_yc%252Fpm&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=4648
[junit4] 2> 1434428 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1434439 INFO (zkCallback-483-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1435592 INFO (OverseerCollectionConfigSetProcessor-98868842785538052-127.0.0.1:35343_yc%2Fpm-n_0000000000) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1435797 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001 of type TLOG
[junit4] 2> 1435798 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1435859 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3633db8{/yc/pm,null,AVAILABLE}
[junit4] 2> 1435859 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@59025b89{HTTP/1.1,[http/1.1]}{127.0.0.1:41586}
[junit4] 2> 1435860 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.e.j.s.Server Started @1451742ms
[junit4] 2> 1435860 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/yc/pm, hostPort=41586, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001/cores}
[junit4] 2> 1435894 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1435894 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 1435894 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1435894 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1435894 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-21T20:47:21.390Z
[junit4] 2> 1435996 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1435996 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001/solr.xml
[junit4] 2> 1436069 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1436069 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1436070 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1436142 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36796/solr
[junit4] 2> 1436349 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1436351 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1436352 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41586_yc%2Fpm
[junit4] 2> 1436366 INFO (zkCallback-464-thread-1-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1436366 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1436463 INFO (zkCallback-489-thread-1-processing-n:127.0.0.1:41586_yc%2Fpm) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1436532 INFO (zkCallback-472-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1436536 INFO (zkCallback-483-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1437819 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1437877 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1437877 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1437878 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[4CF5765B3D1012F3]) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001/cores
[junit4] 2> 1438293 INFO (qtp2115813699-4224) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41586_yc%252Fpm&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1438339 INFO (OverseerThreadFactory-1293-thread-5-processing-n:127.0.0.1:35343_yc%2Fpm) [n:127.0.0.1:35343_yc%2Fpm ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:41586_yc%2Fpm for creating new replica
[junit4] 2> 1438349 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 1438350 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1438354 INFO (zkCallback-483-thread-1-processing-n:127.0.0.1:35711_yc%2Fpm) [n:127.0.0.1:35711_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1438358 INFO (zkCallback-477-thread-1-processing-n:127.0.0.1:44296_yc%2Fpm) [n:127.0.0.1:44296_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1438367 INFO (zkCallback-489-thread-1-processing-n:127.0.0.1:41586_yc%2Fpm) [n:127.0.0.1:41586_yc%2Fpm ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1439493 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1439677 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 1440804 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1440950 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 1440951 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@98adcb5
[junit4] 2> 1440951 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1440951 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_4CF5765B3D1012F3-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 1441039 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=22, maxMergedSegmentMB=81.708984375, floorSegmentMB=1.4736328125, forceMergeDeletesPctAllowed=9.767104575680225, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5766219367441728
[junit4] 2> 1441238 WARN (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1441602 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1441602 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1441603 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1441603 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1441604 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=74.62109375, floorSegmentMB=1.4375, forceMergeDeletesPctAllowed=10.92390037098098, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4197074315939172
[junit4] 2> 1441622 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@2333f0d1[collection1_shard2_replica_t45] main]
[junit4] 2> 1441625 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1441625 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1441655 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1441692 INFO (searcherExecutor-1329-thread-1-processing-n:127.0.0.1:41586_yc%2Fpm x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@2333f0d1[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1441692 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581901516309004288
[junit4] 2> 1441749 INFO (qtp1833636019-4328) [n:127.0.0.1:41586_yc%2Fpm c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core nee
[...truncated too long message...]
des
[junit4] 2> 6 /solr/collections
[junit4] 2>
[junit4] 2> 5186306 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:44301/dcb/z, target: http://127.0.0.1:40721/dcb/z
[junit4] 2> 5186306 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SocketProxy Closing 0 connections to: http://127.0.0.1:34804/dcb/z, target: http://127.0.0.1:32992/dcb/z
[junit4] 2> 5186306 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:39717/dcb/z, target: http://127.0.0.1:40901/dcb/z
[junit4] 2> 5186306 WARN (TEST-LeaderFailoverAfterPartitionTest.test-seed#[4CF5765B3D1012F3]) [ ] o.a.s.c.SocketProxy Closing 1 connections to: http://127.0.0.1:37034/dcb/z, target: http://127.0.0.1:37466/dcb/z
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=LeaderFailoverAfterPartitionTest -Dtests.method=test -Dtests.seed=4CF5765B3D1012F3 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ro-RO -Dtests.timezone=America/Merida -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 178s J0 | LeaderFailoverAfterPartitionTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_t3","base_url":"http://127.0.0.1:44301/dcb/z","node_name":"127.0.0.1:44301_dcb%2Fz","state":"active","type":"TLOG","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//clusterstate.json/31)={
[junit4] > "pullReplicas":"0",
[junit4] > "replicationFactor":"1",
[junit4] > "shards":{"shard1":{
[junit4] > "range":"80000000-7fffffff",
[junit4] > "state":"active",
[junit4] > "replicas":{
[junit4] > "core_node4":{
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t1",
[junit4] > "base_url":"http://127.0.0.1:34804/dcb/z",
[junit4] > "node_name":"127.0.0.1:34804_dcb%2Fz",
[junit4] > "state":"down",
[junit4] > "type":"TLOG"},
[junit4] > "core_node5":{
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t3",
[junit4] > "base_url":"http://127.0.0.1:44301/dcb/z",
[junit4] > "node_name":"127.0.0.1:44301_dcb%2Fz",
[junit4] > "state":"active",
[junit4] > "type":"TLOG",
[junit4] > "leader":"true"},
[junit4] > "core_node6":{
[junit4] > "state":"down",
[junit4] > "base_url":"http://127.0.0.1:37034/dcb/z",
[junit4] > "core":"c8n_1x3_lf_shard1_replica_t2",
[junit4] > "node_name":"127.0.0.1:37034_dcb%2Fz",
[junit4] > "type":"TLOG"}}}},
[junit4] > "router":{"name":"compositeId"},
[junit4] > "maxShardsPerNode":"1",
[junit4] > "autoAddReplicas":"false",
[junit4] > "nrtReplicas":"0",
[junit4] > "tlogReplicas":"3"}
[junit4] > at __randomizedtesting.SeedInfo.seed([4CF5765B3D1012F3:C4A1498193EC7F0B]:0)
[junit4] > at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
[junit4] > at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_4CF5765B3D1012F3-001
[junit4] 2> Oct 21, 2017 9:49:48 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=FST50, id=PostingsFormat(name=Asserting), text=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Memory), _version_=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Asserting), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=496, maxMBSortInHeap=6.735910752778545, sim=RandomSimilarity(queryNorm=false): {}, locale=ro-RO, timezone=America/Merida
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=145512736,total=522190848
[junit4] 2> NOTE: All tests run in this JVM: [TestFoldingMultitermQuery, TestLegacyNumericRangeQueryBuilder, TestFileDictionaryLookup, TestRuleBasedAuthorizationPlugin, MultiTermTest, FullHLLTest, TestClusterProperties, DistributedQueueTest, HdfsRecoveryZkTest, TestManagedSchemaAPI, HdfsWriteToMultipleCollectionsTest, SolrSlf4jReporterTest, SearchHandlerTest, TestCopyFieldCollectionResource, CollectionStateFormat2Test, TestTlogReplica, TestBinaryField, DocumentBuilderTest, RAMDirectoryFactoryTest, AtomicUpdateProcessorFactoryTest, TestGraphMLResponseWriter, TestReqParamsAPI, TestExpandComponent, ResourceLoaderTest, TestMultiValuedNumericRangeQuery, QueryParsingTest, TestBulkSchemaConcurrent, TestReversedWildcardFilterFactory, AnalysisAfterCoreReloadTest, ForceLeaderTest, TestNamedUpdateProcessors, TestPolicyCloud, TestHdfsUpdateLog, TestRebalanceLeaders, TestNumericTokenStream, RequestLoggingTest, TestStressUserVersions, TestUpdate, TestUnifiedSolrHighlighter, DocExpirationUpdateProcessorFactoryTest, LeaderElectionIntegrationTest, ExternalFileFieldSortTest, BasicFunctionalityTest, TestDynamicLoading, TestSuggestSpellingConverter, TestQueryUtils, SparseHLLTest, CursorMarkTest, RemoteQueryErrorTest, HdfsCollectionsAPIDistributedZkTest, TestConfigReload, PreAnalyzedUpdateProcessorTest, TestSolrCoreParser, HdfsDirectoryFactoryTest, TestSchemaManager, TestConfigSetsAPI, TestCSVLoader, TestStressVersions, TestPayloadCheckQParserPlugin, HdfsThreadLeakTest, TestJoin, TestNestedDocsSort, TestSolrXml, SolrXmlInZkTest, TestRecoveryHdfs, TestIndexingPerformance, MetricsConfigTest, TestImpersonationWithHadoopAuth, TestCryptoKeys, PropertiesRequestHandlerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, DocValuesMissingTest, BaseCdcrDistributedZkTest, SpellCheckCollatorTest, SolrInfoBeanTest, DistanceUnitsTest, TestRequestStatusCollectionAPI, ClassificationUpdateProcessorIntegrationTest, TestHighlightDedupGrouping, OutOfBoxZkACLAndCredentialsProvidersTest, TestMultiWordSynonyms, IndexSchemaRuntimeFieldTest, TestUniqueKeyFieldResource, TestGraphTermsQParserPlugin, HdfsBasicDistributedZkTest, TestMinMaxOnMultiValuedField, TestUninvertingReader, OverseerTaskQueueTest, BigEndianAscendingWordSerializerTest, StatelessScriptUpdateProcessorFactoryTest, TestCrossCoreJoin, SyncSliceTest, TestRandomCollapseQParserPlugin, TestDownShardTolerantSearch, DateFieldTest, TestRandomFaceting, URLClassifyProcessorTest, UpdateLogTest, SubstringBytesRefFilterTest, JSONWriterTest, TestStressCloudBlindAtomicUpdates, ZkStateReaderTest, TestSubQueryTransformerCrossCore, TestOnReconnectListenerSupport, TestRandomDVFaceting, OverseerModifyCollectionTest, TestBadConfig, TestPerFieldSimilarityWithDefaultOverride, TestSolrIndexConfig, DistributedExpandComponentTest, SpellCheckComponentTest, BlockJoinFacetSimpleTest, TestLocalFSCloudBackupRestore, UpdateRequestProcessorFactoryTest, TestConfigOverlay, TestFieldCacheSortRandom, TestClassicSimilarityFactory, AutoscalingHistoryHandlerTest, DistributedMLTComponentTest, TestJsonRequest, TestCustomSort, DistributedSuggestComponentTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ClusterStateUpdateTest, LeaderElectionTest, TestZkChroot, ZkCLITest, TestDistributedSearch, TestDistributedGrouping, TestHashPartitioner, TermVectorComponentDistributedTest, TestStressReorder, SimpleFacetsTest, TestGroupingSearch, TestLazyCores, SimplePostToolTest, TestCoreDiscovery, SuggesterTSTTest, SuggesterTest, TestStressLucene, SpatialFilterTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, FieldMutatingUpdateProcessorTest, QueryEqualityTest, DocValuesMultiTest, DistanceFunctionTest, DebugComponentTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, TestComponentsName, HighlighterConfigTest, TestQuerySenderListener, UpdateParamsTest, CopyFieldTest, ResponseLogComponentTest, BadComponentTest, TestSolrDeletionPolicy2, SampleTest, TestSearchPerf, NumericFieldsTest, TestConfig, DirectSolrConnectionTest, TestPhraseSuggestions, TestCodecSupport, TestIBSimilarityFactory, TestFastWriter, ScriptEngineTest, TestSolrJ, ZkNodePropsTest, FileUtilsTest, TestRTGBase, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerSchemaAPI, ActionThrottleTest, AssignBackwardCompatibilityTest, ChaosMonkeySafeLeaderWithPullReplicasTest, ConfigSetsAPITest, ConnectionManagerTest, CreateCollectionCleanupTest, DeleteReplicaTest, DistribCursorPagingTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest]
[junit4] Completed [533/745 (2!)] on J0 in 178.93s, 1 test, 1 failure <<< FAILURES!
[...truncated 47873 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2127 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2127/
5 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrBootstrapTest
Error Message:
ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, SolrCore] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:222) at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:260) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:417) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020) at org.apache.solr.core.SolrCore.reload(SolrCore.java:637) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1288) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, InternalHttpClient, MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, SolrCore]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:222)
at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:260)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:417)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:735)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:716)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:497)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:637)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1288)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E03C385C5A01ED6D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:295)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CleanupOldIndexTest.test
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([E03C385C5A01ED6D:68680786F4FD8095]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1325)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:440)
at org.apache.solr.cloud.CleanupOldIndexTest.test(CleanupOldIndexTest.java:114)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration
Error Message:
Timed out waiting for replicas of collection to be 2 again null Live Nodes: [127.0.0.1:45421_solr] Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/8)={ "pullReplicas":"0", "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node3":{ "core":"testIntegration_shard1_replica_n1", "base_url":"http://127.0.0.1:39258/solr", "node_name":"127.0.0.1:39258_solr", "state":"down", "type":"NRT"}, "core_node4":{ "core":"testIntegration_shard1_replica_n2", "base_url":"http://127.0.0.1:45421/solr", "node_name":"127.0.0.1:45421_solr", "state":"active", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"2", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Timed out waiting for replicas of collection to be 2 again
null
Live Nodes: [127.0.0.1:45421_solr]
Last available state: DocCollection(testIntegration//collections/testIntegration/state.json/8)={
"pullReplicas":"0",
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node3":{
"core":"testIntegration_shard1_replica_n1",
"base_url":"http://127.0.0.1:39258/solr",
"node_name":"127.0.0.1:39258_solr",
"state":"down",
"type":"NRT"},
"core_node4":{
"core":"testIntegration_shard1_replica_n2",
"base_url":"http://127.0.0.1:45421/solr",
"node_name":"127.0.0.1:45421_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"2",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([E03C385C5A01ED6D:505D36707F3E4C48]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:209)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.security.PKIAuthenticationIntegrationTest.testPkiAuth
Error Message:
KeeperErrorCode = Session expired for /security.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /security.json
at __randomizedtesting.SeedInfo.seed([E03C385C5A01ED6D:D082A10DBAB76ACC]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1327)
at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:374)
at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:371)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:371)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:572)
at org.apache.solr.security.PKIAuthenticationIntegrationTest.testPkiAuth(PKIAuthenticationIntegrationTest.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
Error Message:
Did not see a fully active cluster after 30 seconds
Stack Trace:
java.lang.AssertionError: Did not see a fully active cluster after 30 seconds
at __randomizedtesting.SeedInfo.seed([7D2E81E52ED8CD7E:F51823B6F677256C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure(TestCollectionStateWatchers.java:250)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11506 lines...]
[junit4] Suite: org.apache.solr.cloud.CleanupOldIndexTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/init-core-data-001
[junit4] 2> 60169 WARN (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
[junit4] 2> 60169 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 60204 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 60204 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 60221 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001
[junit4] 2> 60259 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 60313 INFO (Thread-13) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 60335 INFO (Thread-13) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 60752 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41405
[junit4] 2> 63230 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 63422 ERROR (Thread-13) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 66557 INFO (jetty-launcher-5-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 66649 INFO (jetty-launcher-5-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 67232 INFO (jetty-launcher-5-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@633f6e2b{/solr,null,AVAILABLE}
[junit4] 2> 67234 INFO (jetty-launcher-5-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@267c60db{/solr,null,AVAILABLE}
[junit4] 2> 67563 INFO (jetty-launcher-5-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@728bd4c6{HTTP/1.1,[http/1.1]}{127.0.0.1:43777}
[junit4] 2> 67563 INFO (jetty-launcher-5-thread-2) [ ] o.e.j.s.Server Started @83071ms
[junit4] 2> 67563 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43777}
[junit4] 2> 67690 INFO (jetty-launcher-5-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1b68d631{HTTP/1.1,[http/1.1]}{127.0.0.1:35527}
[junit4] 2> 67690 INFO (jetty-launcher-5-thread-1) [ ] o.e.j.s.Server Started @83198ms
[junit4] 2> 67690 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35527}
[junit4] 2> 67817 ERROR (jetty-launcher-5-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 67817 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 67817 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 67818 ERROR (jetty-launcher-5-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 68000 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 68036 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-20T21:15:19.280Z
[junit4] 2> 68052 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 67942 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 68053 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 68053 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 68053 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-20T21:15:19.297Z
[junit4] 2> 68313 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 68316 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 68675 INFO (jetty-launcher-5-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41405/solr
[junit4] 2> 68787 INFO (jetty-launcher-5-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41405/solr
[junit4] 2> 69276 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f3ba3d06f0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 73696 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 73697 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 73771 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35527_solr
[junit4] 2> 73790 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.c.Overseer Overseer (id=98863291588083718-127.0.0.1:35527_solr-n_0000000000) starting
[junit4] 2> 73843 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43777_solr
[junit4] 2> 74208 INFO (zkCallback-16-thread-1-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 74209 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 75607 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35527_solr
[junit4] 2> 75851 INFO (zkCallback-16-thread-1-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 75974 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 77837 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43777.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 77838 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43777.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 77838 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43777.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 78319 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35527.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 78406 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35527.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 78406 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35527.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 78614 INFO (jetty-launcher-5-thread-2) [n:127.0.0.1:43777_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node2/.
[junit4] 2> 78688 INFO (jetty-launcher-5-thread-1) [n:127.0.0.1:35527_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node1/.
[junit4] 2> 80525 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 80526 INFO (SUITE-CleanupOldIndexTest-seed#[E03C385C5A01ED6D]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41405/solr ready
[junit4] 2> 80653 INFO (TEST-CleanupOldIndexTest.test-seed#[E03C385C5A01ED6D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 83454 INFO (qtp1474136906-63) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=9e7c720f-9db2-4c9a-948b-265eeee71a8c&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 83527 INFO (qtp1474136906-63) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=9e7c720f-9db2-4c9a-948b-265eeee71a8c&replicationFactor=2&collection.configName=conf1&name=oldindextest&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=130
[junit4] 2> 83615 INFO (OverseerThreadFactory-38-thread-1-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.CreateCollectionCmd Create collection oldindextest
[junit4] 2> 83863 INFO (qtp1474136906-64) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 83969 INFO (qtp1474136906-64) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=105
[junit4] 2> 84362 INFO (OverseerStateUpdate-98863291588083718-127.0.0.1:35527_solr-n_0000000000) [n:127.0.0.1:35527_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"oldindextest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"oldindextest_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:43777/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 84524 INFO (OverseerStateUpdate-98863291588083718-127.0.0.1:35527_solr-n_0000000000) [n:127.0.0.1:35527_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"oldindextest",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"oldindextest_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:35527/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 84823 INFO (qtp1474136906-60) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&coreNodeName=core_node2&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=15
[junit4] 2> 84824 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&coreNodeName=core_node2&name=oldindextest_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 84851 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 84871 INFO (qtp721729765-68) [n:127.0.0.1:35527_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691&coreNodeName=core_node4&name=oldindextest_shard1_replica_n3&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=18
[junit4] 2> 84925 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=oldindextest&version=2&replicaType=NRT&async=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691&coreNodeName=core_node4&name=oldindextest_shard1_replica_n3&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 84999 INFO (qtp1474136906-66) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838
[junit4] 2> 84999 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 85006 INFO (qtp1474136906-65) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 85129 INFO (qtp1474136906-66) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=129
[junit4] 2> 85290 INFO (qtp1474136906-65) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=284
[junit4] 2> 85545 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 85554 INFO (zkCallback-16-thread-1-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 85559 INFO (zkCallback-17-thread-2-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 85592 INFO (zkCallback-16-thread-2-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 86230 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838
[junit4] 2> 86231 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 86310 INFO (qtp1474136906-63) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 86312 INFO (qtp1474136906-63) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 86534 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 86554 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 86752 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n3] Schema name=cloud-dynamic
[junit4] 2> 86787 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema [oldindextest_shard1_replica_n1] Schema name=cloud-dynamic
[junit4] 2> 87191 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 87192 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n3' using configuration from collection oldindextest, trusted=true
[junit4] 2> 87406 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35527.solr.core.oldindextest.shard1.replica_n3' (registry 'solr.core.oldindextest.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 87423 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838
[junit4] 2> 87423 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 87424 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 87424 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node1/oldindextest_shard1_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node1/./oldindextest_shard1_replica_n3/data/]
[junit4] 2> 87465 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema cloud-dynamic/1.6 with uniqueid field id
[junit4] 2> 87465 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'oldindextest_shard1_replica_n1' using configuration from collection oldindextest, trusted=true
[junit4] 2> 87466 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43777.solr.core.oldindextest.shard1.replica_n1' (registry 'solr.core.oldindextest.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4c68948d
[junit4] 2> 87466 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 87479 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [[oldindextest_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node2/oldindextest_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.CleanupOldIndexTest_E03C385C5A01ED6D-001/tempDir-001/node2/./oldindextest_shard1_replica_n1/data/]
[junit4] 2> 87468 INFO (qtp1474136906-59) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 87484 INFO (qtp1474136906-59) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 88427 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838
[junit4] 2> 88427 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 88451 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 88451 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 88453 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 88453 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 88492 INFO (qtp1474136906-66) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 88493 INFO (qtp1474136906-66) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 88597 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 88820 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@67f76b42[oldindextest_shard1_replica_n3] main]
[junit4] 2> 88708 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 88849 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 88849 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 88872 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@dcb32ef[oldindextest_shard1_replica_n1] main]
[junit4] 2> 88880 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 88881 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 88881 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 88916 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581812694552412160
[junit4] 2> 88890 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 89089 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 89090 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 89090 INFO (parallelCoreAdminExecutor-40-thread-1-processing-n:127.0.0.1:35527_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581812694734864384
[junit4] 2> 89199 INFO (searcherExecutor-44-thread-1-processing-x:oldindextest_shard1_replica_n1 r:core_node2 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE n:127.0.0.1:43777_solr s:shard1 c:oldindextest) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.SolrCore [oldindextest_shard1_replica_n1] Registered new searcher Searcher@dcb32ef[oldindextest_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 89238 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 89317 INFO (zkCallback-17-thread-1-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 89326 INFO (searcherExecutor-43-thread-1-processing-x:oldindextest_shard1_replica_n3 r:core_node4 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643445052474691 CREATE n:127.0.0.1:35527_solr s:shard1 c:oldindextest) [n:127.0.0.1:35527_solr c:oldindextest s:shard1 r:core_node4 x:oldindextest_shard1_replica_n3] o.a.s.c.SolrCore [oldindextest_shard1_replica_n3] Registered new searcher Searcher@67f76b42[oldindextest_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 89357 INFO (zkCallback-17-thread-2-processing-n:127.0.0.1:35527_solr) [n:127.0.0.1:35527_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 89366 INFO (zkCallback-16-thread-2-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 89398 INFO (zkCallback-16-thread-2-processing-n:127.0.0.1:43777_solr) [n:127.0.0.1:43777_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/oldindextest/state.json] for collection [oldindextest] has occurred - updating... (live nodes size: [2])
[junit4] 2> 89432 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838
[junit4] 2> 89432 INFO (qtp1474136906-57) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 89501 INFO (qtp1474136906-64) [n:127.0.0.1:43777_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 89513 INFO (qtp1474136906-64) [n:127.0.0.1:43777_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9e7c720f-9db2-4c9a-948b-265eeee71a8c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=12
[junit4] 2> 89748 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 89749 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 89749 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43777/solr/oldindextest_shard1_replica_n1/
[junit4] 2> 89808 INFO (parallelCoreAdminExecutor-39-thread-1-processing-n:127.0.0.1:43777_solr 9e7c720f-9db2-4c9a-948b-265eeee71a8c8643444892736838 CREATE) [n:127.0.0.1:43777_solr c:oldindextest s:shard1 r:core_node2 x:oldindextest_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=oldindextest_shard1_replica_n1 url=http://127.0.0.1:43777/solr START replicas=[http://
[...truncated too long message...]
.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [0])
[junit4] 2> 291170 INFO (zkCallback-72-thread-1-processing-n:127.0.0.1:38441_solr) [n:127.0.0.1:38441_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/currentstate/state.json] for collection [currentstate] has occurred - updating... (live nodes size: [0])
[junit4] 2> 291185 INFO (zkCallback-110-thread-6-processing-n:127.0.0.1:41622_solr) [n:127.0.0.1:41622_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/falsepredicate/state.json] for collection [falsepredicate] has occurred - updating... (live nodes size: [0])
[junit4] 2> 291259 INFO (coreCloseExecutor-299-thread-1) [n:127.0.0.1:43999_solr c:falsepredicate s:shard1 r:core_node3 x:falsepredicate_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard1.leader, tag=135463467
[junit4] 2> 291408 INFO (coreCloseExecutor-298-thread-4) [n:127.0.0.1:40984_solr c:delayed s:shard1 r:core_node2 x:delayed_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.delayed.shard1.leader, tag=1604300867
[junit4] 2> 291479 INFO (coreCloseExecutor-300-thread-3) [n:127.0.0.1:38441_solr c:falsepredicate s:shard2 r:core_node5 x:falsepredicate_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard2.leader, tag=538311946
[junit4] 2> 291481 INFO (coreCloseExecutor-301-thread-3) [n:127.0.0.1:41622_solr c:stateformat1 s:shard1 r:core_node2 x:stateformat1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.stateformat1.shard1.leader, tag=836390946
[junit4] 2> 291494 INFO (coreCloseExecutor-300-thread-2) [n:127.0.0.1:38441_solr c:testcollection s:shard3 r:core_node7 x:testcollection_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard3.replica_n4, tag=1713194606
[junit4] 2> 291494 INFO (coreCloseExecutor-300-thread-2) [n:127.0.0.1:38441_solr c:testcollection s:shard3 r:core_node7 x:testcollection_shard3_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@26e21af5: rootName = solr_38441, domain = solr.core.testcollection.shard3.replica_n4, service url = null, agent id = null] for registry solr.core.testcollection.shard3.replica_n4 / com.codahale.metrics.MetricRegistry@10f43ed8
[junit4] 2> 291497 INFO (coreCloseExecutor-301-thread-1) [n:127.0.0.1:41622_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.falsepredicate.shard4.replica_n6, tag=836792375
[junit4] 2> 291497 INFO (coreCloseExecutor-301-thread-1) [n:127.0.0.1:41622_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d65cb21: rootName = solr_41622, domain = solr.core.falsepredicate.shard4.replica_n6, service url = null, agent id = null] for registry solr.core.falsepredicate.shard4.replica_n6 / com.codahale.metrics.MetricRegistry@2bb1d67e
[junit4] 2> 291732 INFO (coreCloseExecutor-300-thread-2) [n:127.0.0.1:38441_solr c:testcollection s:shard3 r:core_node7 x:testcollection_shard3_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard3.leader, tag=1713194606
[junit4] 2> 291898 INFO (coreCloseExecutor-301-thread-1) [n:127.0.0.1:41622_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard4.leader, tag=836792375
[junit4] 2> 291899 INFO (coreCloseExecutor-301-thread-2) [n:127.0.0.1:41622_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard1.replica_n1, tag=1537481805
[junit4] 2> 291899 INFO (coreCloseExecutor-301-thread-2) [n:127.0.0.1:41622_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@44cb49c3: rootName = solr_41622, domain = solr.core.testcollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.testcollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1d3bd3c
[junit4] 2> 292048 INFO (coreCloseExecutor-301-thread-2) [n:127.0.0.1:41622_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=1537481805
[junit4] 2> 292051 INFO (jetty-closer-55-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98863759505621002-127.0.0.1:40984_solr-n_0000000001) closing
[junit4] 2> 292052 INFO (jetty-closer-55-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5c4fc123{/solr,null,UNAVAILABLE}
[junit4] 2> 292059 INFO (OverseerStateUpdate-98863759505621002-127.0.0.1:40984_solr-n_0000000001) [n:127.0.0.1:40984_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40984_solr
[junit4] 2> 292059 WARN (OverseerAutoScalingTriggerThread-98863759505621002-127.0.0.1:40984_solr-n_0000000001) [n:127.0.0.1:40984_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 292094 INFO (jetty-closer-55-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@422d4ae9{/solr,null,UNAVAILABLE}
[junit4] 2> 292115 INFO (zkCallback-110-thread-6-processing-n:127.0.0.1:41622_solr) [n:127.0.0.1:41622_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41622_solr
[junit4] 2> 292128 INFO (jetty-closer-55-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3fc323dd{/solr,null,UNAVAILABLE}
[junit4] 2> 292171 INFO (jetty-closer-55-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4f50a727{/solr,null,UNAVAILABLE}
[junit4] 2> 292172 ERROR (SUITE-TestCollectionStateWatchers-seed#[7D2E81E52ED8CD7E]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 292172 INFO (SUITE-TestCollectionStateWatchers-seed#[7D2E81E52ED8CD7E]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41073 41073
[junit4] 2> 292260 INFO (Thread-43) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41073 41073
[junit4] 2> 292261 WARN (Thread-43) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 8 /solr/configs/config
[junit4] 2> 7 /solr/security.json
[junit4] 2> 4 /solr/collections/stateformat1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 58 /solr/collections/falsepredicate/state.json
[junit4] 2> 51 /solr/collections/testcollection/state.json
[junit4] 2> 17 /solr/collections/waitforstate/state.json
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 8 /solr/collections/currentstate/state.json
[junit4] 2> 8 /solr/collections/stateformat1/state.json
[junit4] 2> 7 /solr/collections/delayed/state.json
[junit4] 2> 6 /solr/collections/tobedeleted/state.json
[junit4] 2> 3 /solr/overseer_elect/election/98863759505621000-127.0.0.1:38441_solr-n_0000000002
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/98863759505621002-127.0.0.1:40984_solr-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 9 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_7D2E81E52ED8CD7E-001
[junit4] 2> Oct 20, 2017 11:15:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1977, maxMBSortInHeap=5.173651223265618, sim=RandomSimilarity(queryNorm=false): {}, locale=is, timezone=America/Argentina/ComodRivadavia
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=96621816,total=374865920
[junit4] 2> NOTE: All tests run in this JVM: [CloudSolrClientBuilderTest, QueryResponseTest, MultiplyEvaluatorTest, NormalizeEvaluatorTest, NoOpResponseParserTest, StreamExpressionToExplanationTest, SineEvaluatorTest, CloudSolrClientTest, AddEvaluatorTest, PowerEvaluatorTest, TestCollectionStateWatchers]
[junit4] Completed [66/145 (1!)] on J1 in 108.24s, 9 tests, 1 failure <<< FAILURES!
[...truncated 46470 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2126 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2126/
11 tests failed.
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:C8C5638FCDE1823A]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.MultiThreadedOCPTest.testFillWorkQueue(MultiThreadedOCPTest.java:112)
at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
core_node1 should be gone after publishing the null state
Stack Trace:
java.lang.AssertionError: core_node1 should be gone after publishing the null state
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:4499D3A671B800E3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:642)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestOnReconnectListenerSupport.test
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:C8C5638FCDE1823A]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:586)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testKillLeader
Error Message:
Replica core_node2 not up to date after 10 seconds expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: Replica core_node2 not up to date after 10 seconds expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:987A8E101A67B94]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.TestTlogReplica.waitForNumDocsInAllReplicas(TestTlogReplica.java:743)
at org.apache.solr.cloud.TestTlogReplica.waitForNumDocsInAllReplicas(TestTlogReplica.java:731)
at org.apache.solr.cloud.TestTlogReplica.doReplaceLeader(TestTlogReplica.java:382)
at org.apache.solr.cloud.TestTlogReplica.testKillLeader(TestTlogReplica.java:321)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.NodeLostTriggerTest.testRestoreState
Error Message:
Lost node was not discovered by trigger even after 10 seconds
Stack Trace:
java.lang.AssertionError: Lost node was not discovered by trigger even after 10 seconds
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:8E3FF8C69B2497D4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.NodeLostTriggerTest.testRestoreState(NodeLostTriggerTest.java:327)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test
Error Message:
wrong number of events added to .system expected:<9> but was:<10>
Stack Trace:
java.lang.AssertionError: wrong number of events added to .system expected:<9> but was:<10>
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:C8C5638FCDE1823A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.autoscaling.SystemLogListenerTest.test(SystemLogListenerTest.java:165)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:54697_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:54697_solr wasn't created
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:582BD4596D28222D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest
Error Message:
Error from server at http://127.0.0.1:42565/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42565/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.setupCluster(AutoscalingHistoryHandlerTest.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:874)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.update.SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds
Error Message:
Tracker reports too many soft commits expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: Tracker reports too many soft commits expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:ED32E0BA6380FD57]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.update.SoftAutoCommitTest.doTestSoftAndHardCommitMaxTimeMixedAdds(SoftAutoCommitTest.java:272)
at org.apache.solr.update.SoftAutoCommitTest.testSoftCommitWithinAndHardCommitMaxTimeMixedAdds(SoftAutoCommitTest.java:170)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeRapidAdds
Error Message:
softCommit: commit#1 has TS too low relative to previous TS & commitWait: commitNanos=8714146267893382, prevTimestampNanos=8714146287272396, commitWaitMillis=500
Stack Trace:
java.lang.AssertionError: softCommit: commit#1 has TS too low relative to previous TS & commitWait: commitNanos=8714146267893382, prevTimestampNanos=8714146287272396, commitWaitMillis=500
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:1C84F26C889FAEBA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.update.SoftAutoCommitTest.assertRapidMultiCommitQueues(SoftAutoCommitTest.java:498)
at org.apache.solr.update.SoftAutoCommitTest.doTestSoftAndHardCommitMaxTimeRapidAdds(SoftAutoCommitTest.java:459)
at org.apache.solr.update.SoftAutoCommitTest.testSoftAndHardCommitMaxTimeRapidAdds(SoftAutoCommitTest.java:405)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2:B9DCCFFA5F68A248]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11580 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.SystemLogListenerTest
[junit4] 2> 91683 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/init-core-data-001
[junit4] 2> 91786 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 91790 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 91791 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 3 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001
[junit4] 2> 91792 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 91832 INFO (Thread-30) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 91832 INFO (Thread-30) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 91932 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36036
[junit4] 2> 91919 ERROR (Thread-30) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 92114 INFO (jetty-launcher-57-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 92448 INFO (jetty-launcher-57-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 92467 INFO (jetty-launcher-57-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 92486 INFO (jetty-launcher-57-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d6d33a4{/solr,null,AVAILABLE}
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2b3a455a{HTTP/1.1,[http/1.1]}{127.0.0.1:41705}
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.e.j.s.Server Started @110218ms
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41705}
[junit4] 2> 92509 ERROR (jetty-launcher-57-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 92509 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-20T00:21:25.455Z
[junit4] 2> 92579 INFO (jetty-launcher-57-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1fe7f4a3{/solr,null,AVAILABLE}
[junit4] 2> 92580 INFO (jetty-launcher-57-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@422bb28d{HTTP/1.1,[http/1.1]}{127.0.0.1:52141}
[junit4] 2> 92580 INFO (jetty-launcher-57-thread-1) [ ] o.e.j.s.Server Started @110289ms
[junit4] 2> 92580 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52141}
[junit4] 2> 92580 ERROR (jetty-launcher-57-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 92580 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 92580 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 92581 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 92581 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-20T00:21:25.527Z
[junit4] 2> 92667 INFO (jetty-launcher-57-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5ead21d5{/solr,null,AVAILABLE}
[junit4] 2> 92668 INFO (jetty-launcher-57-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6b98c589{HTTP/1.1,[http/1.1]}{127.0.0.1:52496}
[junit4] 2> 92668 INFO (jetty-launcher-57-thread-3) [ ] o.e.j.s.Server Started @110377ms
[junit4] 2> 92668 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=52496}
[junit4] 2> 92668 ERROR (jetty-launcher-57-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 92668 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 92668 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 92669 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 92669 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-20T00:21:25.615Z
[junit4] 2> 93282 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93382 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93418 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 93668 INFO (jetty-launcher-57-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36036/solr
[junit4] 2> 93744 INFO (jetty-launcher-57-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36036/solr
[junit4] 2> 93879 INFO (jetty-launcher-57-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36036/solr
[junit4] 2> 94048 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f3727eeab0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 94049 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f3727eeab0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 94635 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 94733 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 94735 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:52141_solr
[junit4] 2> 94747 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41705_solr
[junit4] 2> 94798 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.Overseer Overseer (id=98858361472876553-127.0.0.1:52141_solr-n_0000000000) starting
[junit4] 2> 94855 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 94967 INFO (zkCallback-73-thread-1-processing-n:127.0.0.1:41705_solr) [n:127.0.0.1:41705_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 95117 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 95199 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52141_solr
[junit4] 2> 95210 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 95242 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:41705_solr]
[junit4] 2> 95243 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 95243 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 95264 INFO (zkCallback-73-thread-1-processing-n:127.0.0.1:41705_solr) [n:127.0.0.1:41705_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 95265 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 95794 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 95797 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 95799 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52496_solr
[junit4] 2> 95803 INFO (zkCallback-73-thread-1-processing-n:127.0.0.1:41705_solr) [n:127.0.0.1:41705_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 95934 INFO (zkCallback-72-thread-1-processing-n:127.0.0.1:52496_solr) [n:127.0.0.1:52496_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 96015 INFO (zkCallback-74-thread-2-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 96164 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 96175 DEBUG (OverseerAutoScalingTriggerThread-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 96176 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 97839 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41705.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 98326 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 98554 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41705.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 98555 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41705.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 98557 INFO (jetty-launcher-57-thread-2) [n:127.0.0.1:41705_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node2/.
[junit4] 2> 101710 DEBUG (ScheduledTrigger-51-thread-2) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 102643 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52141.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 102714 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 102904 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52141.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 102904 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52141.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 102906 INFO (jetty-launcher-57-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node1/.
[junit4] 2> 103381 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52496.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 103597 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52496.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 103597 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52496.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 103718 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 104998 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 105028 INFO (jetty-launcher-57-thread-3) [n:127.0.0.1:52496_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node3/.
[junit4] 2> 106032 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 106120 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 106139 INFO (SUITE-SystemLogListenerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36036/solr ready
[junit4] 2> 106278 INFO (qtp143665379-215) [n:127.0.0.1:52141_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=3&name=.system&nrtReplicas=3&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 106359 INFO (OverseerThreadFactory-53-thread-1-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.CreateCollectionCmd Create collection .system
[junit4] 2> 106861 INFO (OverseerStateUpdate-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:41705/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 107078 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 107175 INFO (OverseerStateUpdate-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52496/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 107238 INFO (OverseerStateUpdate-98858361472876553-127.0.0.1:52141_solr-n_0000000000) [n:127.0.0.1:52141_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":".system",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":".system_shard1_replica_n5",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52141/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 107688 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node6&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n5&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 107689 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n1&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 107695 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 107702 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=.system&newCollection=true&name=.system_shard1_replica_n3&action=CREATE&numShards=1&collection=.system&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 107703 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 107706 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 108132 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 108720 INFO (zkCallback-72-thread-1-processing-n:127.0.0.1:52496_solr) [n:127.0.0.1:52496_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 108720 INFO (zkCallback-73-thread-1-processing-n:127.0.0.1:41705_solr) [n:127.0.0.1:41705_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 108722 INFO (zkCallback-74-thread-1-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 108970 INFO (zkCallback-74-thread-2-processing-n:127.0.0.1:52141_solr) [n:127.0.0.1:52141_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 109578 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 109579 INFO (zkCallback-72-thread-2-processing-n:127.0.0.1:52496_solr) [n:127.0.0.1:52496_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 109644 INFO (zkCallback-73-thread-2-processing-n:127.0.0.1:41705_solr) [n:127.0.0.1:41705_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/.system/state.json] for collection [.system] has occurred - updating... (live nodes size: [3])
[junit4] 2> 109887 WARN (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.Config You should not use LATEST as luceneMatchVersion property: if you use this setting, and then Solr upgrades to a newer release of Lucene, sizable changes may happen. If precise back compatibility is important then you should instead explicitly specify an actual Lucene version.
[junit4] 2> 109929 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 110012 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 110105 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 110332 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 110339 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 110339 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
[junit4] 2> 110449 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.IndexSchema [.system_shard1_replica_n3] Schema name=_system collection or core
[junit4] 2> 110480 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.IndexSchema [.system_shard1_replica_n5] Schema name=_system collection or core
[junit4] 2> 110480 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema [.system_shard1_replica_n1] Schema name=_system collection or core
[junit4] 2> 110579 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 111454 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 111482 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 111541 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema _system collection or core/1.1 with uniqueid field id
[junit4] 2> 111579 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] HEARTBEAT J1 PID(23017@lucene1-us-west): 2017-10-20T00:22:48, stalled for 68.0s at: TestAuthorizationFramework.authorizationFrameworkTest
[junit4] 2> 111789 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 111792 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/.system/schema.xml to /configs/.system/schema.xml.bak
[junit4] 2> 111792 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n1' using configuration from collection .system, trusted=true
[junit4] 2> 111811 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41705.solr.core..system.shard1.replica_n1' (registry 'solr.core..system.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 111811 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 111811 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.c.SolrCore [[.system_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node2/.system_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node2/./.system_shard1_replica_n1/data/]
[junit4] 2> 111812 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/.system/managed-schema
[junit4] 2> 111813 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/.system/schema.xml no longer exists.
[junit4] 2> 111813 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n5' using configuration from collection .system, trusted=true
[junit4] 2> 111814 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52141.solr.core..system.shard1.replica_n5' (registry 'solr.core..system.shard1.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 111814 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 111834 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.ManagedIndexSchema Managed schema znode at /configs/.system/managed-schema already exists - no need to create it
[junit4] 2> 111836 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, the non-managed schema /configs/.system/schema.xml no longer exists.
[junit4] 2> 111836 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore '.system_shard1_replica_n3' using configuration from collection .system, trusted=true
[junit4] 2> 111837 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.SolrCore [[.system_shard1_replica_n5] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node1/.system_shard1_replica_n5], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node1/./.system_shard1_replica_n5/data/]
[junit4] 2> 111858 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_52496.solr.core..system.shard1.replica_n3' (registry 'solr.core..system.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6fea95e1
[junit4] 2> 111858 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 111858 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.c.SolrCore [[.system_shard1_replica_n3] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node3/.system_shard1_replica_n3], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.SystemLogListenerTest_40915C55631DEFC2-001/tempDir-001/node3/./.system_shard1_replica_n3/data/]
[junit4] 2> 112590 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 113632 DEBUG (ScheduledTrigger-51-thread-1) [n:127.0.0.1:52141_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:41705_solr, 127.0.0.1:52141_solr, 127.0.0.1:52496_solr]
[junit4] 2> 113792 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 113792 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 113826 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 113860 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 113861 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 113861 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 113940 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 113940 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 113989 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 113989 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 113988 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: if 1 uncommited docs
[junit4] 2> 113994 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 114034 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f905d33[.system_shard1_replica_n1] main]
[junit4] 2> 114035 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@236ccad8[.system_shard1_replica_n3] main]
[junit4] 2> 114075 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@65a6b975[.system_shard1_replica_n5] main]
[junit4] 2> 114090 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 114107 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 114108 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 114109 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 114130 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/.system
[junit4] 2> 114132 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/.system
[junit4] 2> 114132 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 114142 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 114147 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
[junit4] 2> 114147 INFO (qtp143665379-217) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 114158 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/.system/managed-schema
[junit4] 2> 114162 INFO (qtp288420631-204) [n:127.0.0.1:41705_solr c:.system s:shard1 r:core_node2 x:.system_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 114187 INFO (qtp152442930-224) [n:127.0.0.1:52496_solr c:.system s:shard1 r:core_node4 x:.system_shard1_replica_n3] o.a.s.s.ZkIndexSchemaReader Retrieved schema version 0 from ZooKeeper
[junit4] 2> 114340 INFO (searcherExecutor-61-thread-1-processing-n:127.0.0.1:52141_solr x:.system_shard1_replica_n5 s:shard1 c:.system r:core_node6) [n:127.0.0.1:52141_solr c:.system s:shard1 r:core_node6 x:.system_shard1_replica_n5] o.a.s.c.S
[...truncated too long message...]
ard1 r:core_node5 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=734042700
[junit4] 2> 9565511 INFO (coreCloseExecutor-7955-thread-1) [n:127.0.0.1:59950_solr c:AutoscalingHistoryHandlerTest_collection s:shard1 r:core_node3 x:AutoscalingHistoryHandlerTest_collection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.AutoscalingHistoryHandlerTest_collection.shard1.leader, tag=358814990
[junit4] 2> 9565527 INFO (jetty-closer-4651-thread-3) [ ] o.a.s.c.Overseer Overseer (id=98858969043959820-127.0.0.1:59950_solr-n_0000000003) closing
[junit4] 2> 9565527 INFO (OverseerStateUpdate-98858969043959820-127.0.0.1:59950_solr-n_0000000003) [n:127.0.0.1:59950_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:59950_solr
[junit4] 2> 9565527 INFO (jetty-closer-4651-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2ebff7a5{/solr,null,UNAVAILABLE}
[junit4] 2> 9565527 WARN (OverseerAutoScalingTriggerThread-98858969043959820-127.0.0.1:59950_solr-n_0000000003) [n:127.0.0.1:59950_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 9565574 DEBUG (jetty-closer-4651-thread-3) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 9565594 INFO (jetty-closer-4651-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@75151b4f{/solr,null,UNAVAILABLE}
[junit4] 2> 9565614 ERROR (SUITE-AutoscalingHistoryHandlerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 9565624 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44678 44678
[junit4] 2> 9566722 INFO (Thread-6348) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44678 44678
[junit4] 2> 9566724 WARN (Thread-6348) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/aliases.json
[junit4] 2> 8 /solr/clusterprops.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/AutoscalingHistoryHandlerTest_collection
[junit4] 2> 6 /solr/configs/AutoscalingHistoryHandlerTest_collection/managed-schema
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 21 /solr/collections/AutoscalingHistoryHandlerTest_collection/state.json
[junit4] 2> 14 /solr/collections/.system/state.json
[junit4] 2> 8 /solr/clusterstate.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/collections
[junit4] 2> 5 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> 9566744 INFO (SUITE-AutoscalingHistoryHandlerTest-seed#[40915C55631DEFC2]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1745, maxMBSortInHeap=5.900278211923103, sim=RandomSimilarity(queryNorm=true): {}, locale=de-GR, timezone=Etc/GMT-4
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=249528400,total=525336576
[junit4] 2> NOTE: All tests run in this JVM: [TestApiFramework, TestRemoteStreaming, HighlighterConfigTest, TestAuthorizationFramework, CircularListTest, TestRTGBase, EnumFieldTest, BlockDirectoryTest, CreateCollectionCleanupTest, VersionInfoTest, HdfsTlogReplayBufferedWhileIndexingTest, TestRandomFlRTGCloud, TestSolr4Spatial, ShufflingReplicaListTransformerTest, LukeRequestHandlerTest, LargeFieldTest, TestSSLRandomization, RollingRestartTest, TestSolrCLIRunExample, DOMUtilTest, SignatureUpdateProcessorFactoryTest, TestNRTOpen, TestCloudRecovery, TestConfigSetImmutable, TestLockTree, FacetPivotSmallTest, JavabinLoaderTest, HealthCheckHandlerTest, RequestHandlersTest, TestFieldCacheVsDocValues, TestExactSharedStatsCache, InfoHandlerTest, V2ApiIntegrationTest, TestSurroundQueryParser, TestStressReorder, TestExportWriter, PeerSyncReplicationTest, TestStressRecovery, TestFaceting, HttpTriggerListenerTest, TestTolerantUpdateProcessorCloud, TestRestoreCore, SmileWriterTest, TestConfigSetsAPIExclusivity, HdfsChaosMonkeyNothingIsSafeTest, TestChildDocTransformer, OpenExchangeRatesOrgProviderTest, SOLR749Test, TestOrdValues, ShardSplitTest, BadCopyFieldTest, CdcrRequestHandlerTest, TestDeleteCollectionOnDownNodes, SynonymTokenizerTest, HdfsLockFactoryTest, CheckHdfsIndexTest, MoreLikeThisHandlerTest, TestLuceneMatchVersion, DistributedFacetExistsSmallTest, ChaosMonkeySafeLeaderTest, TestBM25SimilarityFactory, DeleteLastCustomShardedReplicaTest, TestFastLRUCache, DistributedIntervalFacetingTest, MoveReplicaHDFSFailoverTest, TestManagedSchemaThreadSafety, TestAnalyzedSuggestions, NumericFieldsTest, SuggesterTSTTest, DebugComponentTest, MetricUtilsTest, TestFastWriter, SolrCoreMetricManagerTest, AutoAddReplicasIntegrationTest, BadIndexSchemaTest, TestXIncludeConfig, TestNumericRangeQuery32, PingRequestHandlerTest, TestLazyCores, TestSha256AuthenticationProvider, BinaryUpdateRequestHandlerTest, TestSolrFieldCacheBean, TestManagedStopFilterFactory, TestSchemalessBufferedUpdates, TermVectorComponentDistributedTest, TriLevelCompositeIdRoutingTest, PathHierarchyTokenizerFactoryTest, DataDrivenBlockJoinTest, AtomicUpdatesTest, SchemaVersionSpecificBehaviorTest, TestCursorMarkWithoutUniqueKey, TestHalfAndHalfDocValues, SuggesterFSTTest, TestCorePropertiesReload, TriggerIntegrationTest, TestPayloadScoreQParserPlugin, TestSchemaVersionResource, BasicAuthIntegrationTest, TestQuerySenderNoQuery, LeaderFailoverAfterPartitionTest, TestSolrQueryParser, SolrMetricsIntegrationTest, PrimUtilsTest, ConvertedLegacyTest, TestLegacyNumericUtils, TestExclusionRuleCollectionAccess, TestInPlaceUpdatesDistrib, TestSimpleTextCodec, DirectoryFactoryTest, GraphQueryTest, AssignTest, ClassificationUpdateProcessorTest, QueryResultKeyTest, TestDocumentBuilder, CurrencyFieldTypeTest, BitVectorTest, CachingDirectoryFactoryTest, ShardRoutingTest, ClusterStateUpdateTest, TestRandomFaceting, DistributedSpellCheckComponentTest, TestRealTimeGet, TestReload, TestRangeQuery, TestTolerantSearch, TestLuceneIndexBackCompat, TestEmbeddedSolrServerAdminHandler, TestJettySolrRunner, ConnectionReuseTest, AssignBackwardCompatibilityTest, CloudExitableDirectoryReaderTest, CollectionTooManyReplicasTest, DeleteInactiveReplicaTest, DeleteNodeTest, DeleteShardTest, DeleteStatusTest, DistributedVersionInfoTest, LeaderInitiatedRecoveryOnShardRestartTest, MigrateRouteKeyTest, MultiThreadedOCPTest, SharedFSAutoReplicaFailoverTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudDeleteByQuery, TestCloudPivotFacet, TestCollectionsAPIViaSolrCloudCluster, TestLeaderElectionWithEmptyReplica, TestMiniSolrCloudClusterSSL, TestRandomRequestDistribution, TestSizeLimitedDistributedMap, TestSolrCloudWithKerberosAlt, TestStressLiveNodes, ComputePlanActionTest, NodeLostTriggerTest, TestPolicyCloud, HdfsRecoverLeaseTest, StressHdfsTest, TestInitParams, SearchHandlerTest, TestHdfsBackupRestoreCore, TestSystemCollAutoCreate, V2StandaloneTest, AutoscalingHistoryHandlerTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=AutoscalingHistoryHandlerTest -Dtests.seed=40915C55631DEFC2 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=de-GR -Dtests.timezone=Etc/GMT-4 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J1 | AutoscalingHistoryHandlerTest (suite) <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42565/solr: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000002
[junit4] > at __randomizedtesting.SeedInfo.seed([40915C55631DEFC2]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:867)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
[junit4] > at org.apache.solr.handler.admin.AutoscalingHistoryHandlerTest.setupCluster(AutoscalingHistoryHandlerTest.java:74)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] Completed [605/745 (10!)] on J1 in 202.68s, 0 tests, 1 error <<< FAILURES!
[...truncated 47603 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2125 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2125/
5 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testTriggerThrottling
Error Message:
Both triggers should have fired by now
Stack Trace:
java.lang.AssertionError: Both triggers should have fired by now
at __randomizedtesting.SeedInfo.seed([6D999028E1166D4F:96BB380D33BC8EDD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testTriggerThrottling(TriggerIntegrationTest.java:194)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testOverwriteOption
Error Message:
Could not load collection from ZK: overwrite
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: overwrite
at __randomizedtesting.SeedInfo.seed([1DCA8860397DC6D8:F1F1698B572DB90E]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testOverwriteOption(CloudSolrClientTest.java:155)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/overwrite/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 44 more
FAILED: org.apache.solr.client.solrj.request.TestV2Request.testHttpSolrClient
Error Message:
Error from server at http://127.0.0.1:39742/solr: Cannot create collection test. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteExecutionException: Error from server at http://127.0.0.1:39742/solr: Cannot create collection test. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 3. This allows a maximum of 3 to be created. Value of numShards is 2, value of nrtReplicas is 2, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 4 shards to be created (higher than the allowed number)
at __randomizedtesting.SeedInfo.seed([1DCA8860397DC6D8:C5D2904A9849D4FF]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteExecutionException.create(HttpSolrClient.java:812)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:603)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.client.solrj.request.TestV2Request.assertSuccess(TestV2Request.java:42)
at org.apache.solr.client.solrj.request.TestV2Request.doTest(TestV2Request.java:72)
at org.apache.solr.client.solrj.request.TestV2Request.testHttpSolrClient(TestV2Request.java:62)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.request.TestV2Request
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.client.solrj.request.TestV2Request: 1) Thread[id=2930, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestV2Request] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.request.TestV2Request:
1) Thread[id=2930, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestV2Request]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([1DCA8860397DC6D8]:0)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([6D999028E1166D4F:94D40387DD6320C5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12164 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/init-core-data-001
[junit4] 2> 1498487 WARN (SUITE-ShardSplitTest-seed#[6D999028E1166D4F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=27 numCloses=27
[junit4] 2> 1498487 INFO (SUITE-ShardSplitTest-seed#[6D999028E1166D4F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1498488 INFO (SUITE-ShardSplitTest-seed#[6D999028E1166D4F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1498488 INFO (SUITE-ShardSplitTest-seed#[6D999028E1166D4F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 1498488 INFO (SUITE-ShardSplitTest-seed#[6D999028E1166D4F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1498614 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1498615 INFO (Thread-980) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1498615 INFO (Thread-980) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1498616 ERROR (Thread-980) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1498754 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkTestServer start zk server on port:40498
[junit4] 2> 1499240 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1499275 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1499276 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1499277 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1499277 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1499311 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1499311 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1499312 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1499313 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1499313 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1499314 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1499348 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1500758 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@66eaa5f6{/,null,AVAILABLE}
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@3998dd00{HTTP/1.1,[http/1.1]}{127.0.0.1:36649}
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server Started @1515352ms
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/tempDir-001/control/data, hostContext=/, hostPort=36649, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/control-001/cores}
[junit4] 2> 1500759 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1500759 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T22:42:20.750Z
[junit4] 2> 1500807 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1500807 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/control-001/solr.xml
[junit4] 2> 1500810 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1500810 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1500811 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1500870 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40498/solr
[junit4] 2> 1501298 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1501298 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36649_
[junit4] 2> 1501299 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.c.Overseer Overseer (id=98852309474082820-127.0.0.1:36649_-n_0000000000) starting
[junit4] 2> 1501374 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36649_
[junit4] 2> 1501412 INFO (OverseerStateUpdate-98852309474082820-127.0.0.1:36649_-n_0000000000) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1502015 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1502065 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1502065 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1502066 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:36649_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/control-001/cores
[junit4] 2> 1502183 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1502184 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40498/solr ready
[junit4] 2> 1502244 INFO (qtp556113522-3368) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36649_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1502370 INFO (OverseerThreadFactory-1518-thread-1-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1502691 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1502691 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1502946 INFO (zkCallback-502-thread-1-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1504204 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1504368 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1505025 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1505067 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1505067 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1505067 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1505067 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1505103 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=15.2724609375, floorSegmentMB=0.763671875, forceMergeDeletesPctAllowed=25.08386209456478, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1505175 WARN (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1505503 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1505503 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1505504 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1505504 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1505505 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1505505 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7695508e[control_collection_shard1_replica_n1] main]
[junit4] 2> 1505506 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1505506 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1505519 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1505520 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581636958825742336
[junit4] 2> 1505597 INFO (searcherExecutor-1521-thread-1-processing-n:127.0.0.1:36649_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@7695508e[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36649/control_collection_shard1_replica_n1/
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:36649/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1505598 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1505600 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36649/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1505633 INFO (zkCallback-502-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1505683 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1505684 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2993
[junit4] 2> 1505699 INFO (qtp556113522-3368) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1505786 INFO (zkCallback-502-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1506442 INFO (OverseerCollectionConfigSetProcessor-98852309474082820-127.0.0.1:36649_-n_0000000000) [n:127.0.0.1:36649_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1506702 INFO (qtp556113522-3368) [n:127.0.0.1:36649_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36649_&wt=javabin&version=2} status=0 QTime=4458
[junit4] 2> 1506889 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1506905 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40498/solr ready
[junit4] 2> 1506905 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1506906 INFO (qtp556113522-3372) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1507019 INFO (OverseerThreadFactory-1518-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1507076 WARN (OverseerThreadFactory-1518-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1507393 INFO (qtp556113522-3372) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1507393 INFO (qtp556113522-3372) [n:127.0.0.1:36649_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=486
[junit4] 2> 1508016 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001 of type NRT
[junit4] 2> 1508017 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7be442f7{/,null,AVAILABLE}
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@34d53f1b{HTTP/1.1,[http/1.1]}{127.0.0.1:42253}
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server Started @1522610ms
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=42253, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001/cores}
[junit4] 2> 1508018 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1508018 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T22:42:28.009Z
[junit4] 2> 1508056 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1508056 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001/solr.xml
[junit4] 2> 1508165 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1508165 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1508166 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1508223 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40498/solr
[junit4] 2> 1508369 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1508370 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1508371 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42253_
[junit4] 2> 1508389 INFO (zkCallback-510-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1508482 INFO (zkCallback-515-thread-1-processing-n:127.0.0.1:42253_) [n:127.0.0.1:42253_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1508544 INFO (zkCallback-502-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1509104 INFO (OverseerCollectionConfigSetProcessor-98852309474082820-127.0.0.1:36649_-n_0000000000) [n:127.0.0.1:36649_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1509885 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1509994 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1509994 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1509996 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:42253_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001/cores
[junit4] 2> 1510221 INFO (qtp556113522-3365) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:42253_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1510258 INFO (OverseerThreadFactory-1518-thread-3-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:42253_ for creating new replica
[junit4] 2> 1510311 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1510311 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1510360 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1510412 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 1510726 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1510790 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 1510791 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1510791 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1510791 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 1510806 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=15.2724609375, floorSegmentMB=0.763671875, forceMergeDeletesPctAllowed=25.08386209456478, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1510876 WARN (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1511057 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1511057 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1511058 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1511058 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1511060 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1511060 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@a73a41d[collection1_shard2_replica_n41] main]
[junit4] 2> 1511061 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1511077 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1511078 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1511095 INFO (searcherExecutor-1532-thread-1-processing-n:127.0.0.1:42253_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@a73a41d[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1511095 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581636964671553536
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42253/collection1_shard2_replica_n41/
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:42253/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 1511131 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1511133 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42253/collection1_shard2_replica_n41/ shard2
[junit4] 2> 1511297 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1511334 INFO (qtp657719593-3415) [n:127.0.0.1:42253_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1023
[junit4] 2> 1511351 INFO (qtp556113522-3365) [n:127.0.0.1:36649_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:42253_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1130
[junit4] 2> 1512054 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001 of type NRT
[junit4] 2> 1512055 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1512055 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3a4d761b{/,null,AVAILABLE}
[junit4] 2> 1512056 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6ef5279d{HTTP/1.1,[http/1.1]}{127.0.0.1:39945}
[junit4] 2> 1512056 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server Started @1526648ms
[junit4] 2> 1512068 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=39945, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001/cores}
[junit4] 2> 1512068 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1512072 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1512073 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1512073 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1512073 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T22:42:32.064Z
[junit4] 2> 1512133 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1512133 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001/solr.xml
[junit4] 2> 1512136 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1512136 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1512170 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1512206 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40498/solr
[junit4] 2> 1512259 INFO (OverseerCollectionConfigSetProcessor-98852309474082820-127.0.0.1:36649_-n_0000000000) [n:127.0.0.1:36649_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1512502 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1512536 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1512538 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39945_
[junit4] 2> 1512539 INFO (zkCallback-515-thread-1-processing-n:127.0.0.1:42253_) [n:127.0.0.1:42253_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1512539 INFO (zkCallback-502-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1512568 INFO (zkCallback-510-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1512604 INFO (zkCallback-521-thread-1-processing-n:127.0.0.1:39945_) [n:127.0.0.1:39945_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1513128 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1513240 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1513240 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1513241 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:39945_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001/cores
[junit4] 2> 1513497 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39945_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1513535 INFO (OverseerThreadFactory-1518-thread-4-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39945_ for creating new replica
[junit4] 2> 1513608 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1513608 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1514713 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1514881 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 1515715 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1515755 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 1515772 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1515772 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1515772 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 1515800 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=15.2724609375, floorSegmentMB=0.763671875, forceMergeDeletesPctAllowed=25.08386209456478, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1515888 WARN (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1516101 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1516101 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1516102 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1516102 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1516103 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1516103 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ff081aa[collection1_shard1_replica_n43] main]
[junit4] 2> 1516104 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1516117 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1516117 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1516122 INFO (searcherExecutor-1543-thread-1-processing-n:127.0.0.1:39945_ x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@1ff081aa[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1516122 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581636969942745088
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39945/collection1_shard1_replica_n43/
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:39945/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 1516140 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1516154 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39945/collection1_shard1_replica_n43/ shard1
[junit4] 2> 1516205 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1516206 INFO (qtp135929446-3445) [n:127.0.0.1:39945_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2598
[junit4] 2> 1516279 INFO (qtp556113522-3366) [n:127.0.0.1:36649_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39945_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=2782
[junit4] 2> 1516679 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001 of type NRT
[junit4] 2> 1516679 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1516718 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35ea3c73{/,null,AVAILABLE}
[junit4] 2> 1516718 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@60c53178{HTTP/1.1,[http/1.1]}{127.0.0.1:37094}
[junit4] 2> 1516718 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.e.j.s.Server Started @1531311ms
[junit4] 2> 1516719 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=37094, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001/cores}
[junit4] 2> 1516719 ERROR (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1516719 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1516719 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1516719 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1516719 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T22:42:36.710Z
[junit4] 2> 1516722 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1516722 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001/solr.xml
[junit4] 2> 1516725 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1516725 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1516743 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1516754 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40498/solr
[junit4] 2> 1516793 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1516794 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1516808 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37094_
[junit4] 2> 1516809 INFO (zkCallback-510-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1516809 INFO (zkCallback-502-thread-2-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1516809 INFO (zkCallback-521-thread-1-processing-n:127.0.0.1:39945_) [n:127.0.0.1:39945_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1516809 INFO (zkCallback-515-thread-1-processing-n:127.0.0.1:42253_) [n:127.0.0.1:42253_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1516860 INFO (zkCallback-527-thread-1-processing-n:127.0.0.1:37094_) [n:127.0.0.1:37094_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1517506 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1517591 INFO (OverseerCollectionConfigSetProcessor-98852309474082820-127.0.0.1:36649_-n_0000000000) [n:127.0.0.1:36649_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1517592 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1517593 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1517594 INFO (TEST-ShardSplitTest.testSplitStaticIndexReplication-seed#[6D999028E1166D4F]) [n:127.0.0.1:37094_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001/cores
[junit4] 2> 1517899 INFO (qtp556113522-3368) [n:127.0.0.1:36649_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37094_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1517961 INFO (OverseerThreadFactory-1518-thread-5-processing-n:127.0.0.1:36649_) [n:127.0.0.1:36649_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37094_ for creating new replica
[junit4] 2> 1518043 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1518044 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1519113 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 1519183 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema [collection1_shard2_replica_n45] Schema name=test
[junit4] 2> 1519833 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1519905 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n45' using configuration from collection collection1, trusted=true
[junit4] 2> 1519906 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n45' (registry 'solr.core.collection1.shard2.replica_n45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@18bf1128
[junit4] 2> 1519906 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1519906 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.SolrCore [[collection1_shard2_replica_n45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001/cores/collection1_shard2_replica_n45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.ShardSplitTest_6D999028E1166D4F-001/shard-3-001/cores/collection1_shard2_replica_n45/data/]
[junit4] 2> 1519942 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=15.2724609375, floorSegmentMB=0.763671875, forceMergeDeletesPctAllowed=25.08386209456478, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1519997 WARN (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1520308 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1520309 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1520309 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1520310 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1520311 INFO (qtp2111992963-3475) [n:127.0.0.1:37094_ c:collection1 s:shard2 x:collection1_shard2_replica_n45] o.a.s.u.Rand
[...truncated too long message...]
4] 2> at org.apache.solr.common.cloud.ZkStateReader.getAutoScalingConfig(ZkStateReader.java:171)
[junit4] 2> at org.apache.solr.cloud.ZkController.createEphemeralLiveNode(ZkController.java:970)
[junit4] 2> at org.apache.solr.cloud.ZkController.access$500(ZkController.java:138)
[junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:361)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168)
[junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 540299 ERROR (zkCallback-950-thread-1-processing-n:127.0.0.1:36907_solr) [n:127.0.0.1:36907_solr ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed:org.apache.solr.common.cloud.ZooKeeperException:
[junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:413)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:168)
[junit4] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:57)
[junit4] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:142)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getAutoScalingConfig(ZkStateReader.java:185)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getAutoScalingConfig(ZkStateReader.java:171)
[junit4] 2> at org.apache.solr.cloud.ZkController.createEphemeralLiveNode(ZkController.java:970)
[junit4] 2> at org.apache.solr.cloud.ZkController.access$500(ZkController.java:138)
[junit4] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:361)
[junit4] 2> ... 10 more
[junit4] 2>
[junit4] 2> 540299 WARN (zkCallback-950-thread-1-processing-n:127.0.0.1:36907_solr) [n:127.0.0.1:36907_solr ] o.a.s.c.c.DefaultConnectionStrategy Reconnect to ZooKeeper failed
[junit4] 2> 540300 INFO (zkCallback-950-thread-1-processing-n:127.0.0.1:36907_solr) [n:127.0.0.1:36907_solr ] o.a.s.c.c.ConnectionManager Connected:true
[junit4] 2> 540300 INFO (jetty-closer-930-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1b16516a{/solr,null,UNAVAILABLE}
[junit4] 2> 540301 ERROR (SUITE-TestV2Request-seed#[1DCA8860397DC6D8]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 540301 INFO (SUITE-TestV2Request-seed#[1DCA8860397DC6D8]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38424 38424
[junit4] 2> 540407 INFO (Thread-446) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38424 38424
[junit4] 2> 540407 WARN (Thread-446) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 8 /solr/configs/config
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 5 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/collections/test/state.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 2 /solr/overseer_elect/election/98852702584373257-127.0.0.1:39742_solr-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/98852702584373256-127.0.0.1:41532_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/98852702584373259-127.0.0.1:44642_solr-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.request.TestV2Request_1DCA8860397DC6D8-001
[junit4] 2> Oct 19, 2017 12:22:59 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Oct 19, 2017 12:23:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.request.TestV2Request:
[junit4] 2> 1) Thread[id=2930, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestV2Request]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Oct 19, 2017 12:23:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=2930, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestV2Request]
[junit4] 2> Oct 19, 2017 12:23:19 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=415, maxMBSortInHeap=5.886801822704588, sim=RandomSimilarity(queryNorm=false): {}, locale=es-MX, timezone=Europe/Rome
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=205915880,total=421527552
[junit4] 2> NOTE: All tests run in this JVM: [NamedListTest, StreamingTest, TestCoreAdmin, DocumentAnalysisResponseTest, ModifiableSolrParamsTest, TestJavaBinCodec, FieldValueEvaluatorTest, ShardParamsTest, NotEvaluatorTest, SolrExceptionTest, JdbcTest, HttpSolrClientConPoolTest, ArcSineEvaluatorTest, CloudSolrClientCacheTest, SolrExampleXMLTest, GraphExpressionTest, TestClusteringResponse, CubedRootEvaluatorTest, SchemaTest, TestPolicy, AndEvaluatorTest, LessThanEvaluatorTest, RawValueEvaluatorTest, AddEvaluatorTest, AppendEvaluatorTest, CorrelationEvaluatorTest, CosineEvaluatorTest, DivideEvaluatorTest, EmpiricalDistributionEvaluatorTest, EqualToEvaluatorTest, FloorEvaluatorTest, GreaterThanEvaluatorTest, HyperbolicTangentEvaluatorTest, LengthEvaluatorTest, NaturalLogEvaluatorTest, NormalizeEvaluatorTest, OrEvaluatorTest, ReverseEvaluatorTest, SquareRootEvaluatorTest, UniformDistributionEvaluatorTest, UuidEvaluatorTest, StreamExpressionParserTest, TestConfigSetAdminRequest, TestDelegationTokenRequest, TestV1toV2ApiMapper, TestV2Request]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestV2Request -Dtests.seed=1DCA8860397DC6D8 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es-MX -Dtests.timezone=Europe/Rome -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | TestV2Request (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.client.solrj.request.TestV2Request:
[junit4] > 1) Thread[id=2930, name=Connection evictor, state=TIMED_WAITING, group=TGRP-TestV2Request]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([1DCA8860397DC6D8]:0)
[junit4] Completed [137/145 (2!)] on J2 in 62.37s, 3 tests, 2 errors <<< FAILURES!
[...truncated 46240 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2124 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2124/
7 tests failed.
FAILED: org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:34863/wu/lx/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:34863/wu/lx/collection1
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD:376509CEE0EEAD35]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:637)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:463)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1583)
at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest.test(ChaosMonkeyNothingIsSafeTest.java:213)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
... 53 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
8 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest: 1) Thread[id=14072, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-SendThread(127.0.0.1:34980), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2) Thread[id=14073, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 3) Thread[id=14071, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=14344, name=zkCallback-3418-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=14346, name=zkCallback-3418-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest:
1) Thread[id=14072, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-SendThread(127.0.0.1:34980), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
2) Thread[id=14073, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-EventThread, state=WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
3) Thread[id=14071, name=Connection evictor, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=14344, name=zkCallback-3418-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=14346, name=zkCallback-3418-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=14072, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-SendThread(127.0.0.1:34980), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 2) Thread[id=14344, name=zkCallback-3418-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=14346, name=zkCallback-3418-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=14072, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-SendThread(127.0.0.1:34980), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
2) Thread[id=14344, name=zkCallback-3418-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=14346, name=zkCallback-3418-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD]:0)
FAILED: org.apache.solr.cloud.DistribCursorPagingTest.test
Error Message:
Could not load collection from ZK: collection1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD:376509CEE0EEAD35]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1227)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:827)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.indexDoc(AbstractFullDistribZkTestBase.java:839)
at org.apache.solr.cloud.DistribCursorPagingTest.doRandomSortsOnLargeIndex(DistribCursorPagingTest.java:581)
at org.apache.solr.cloud.DistribCursorPagingTest.test(DistribCursorPagingTest.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 50 more
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Didn't see all replicas for shard shard1 in c8n_1x3_lf come up within 90000 ms! ClusterState: { "control_collection":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{"core_node2":{ "core":"control_collection_shard1_replica_n1", "base_url":"http://127.0.0.1:45335/c_nec", "node_name":"127.0.0.1:45335_c_nec", "state":"active", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"}, "c8n_1x3_lf":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "core":"c8n_1x3_lf_shard1_replica_t3", "base_url":"http://127.0.0.1:46845/c_nec", "node_name":"127.0.0.1:46845_c_nec", "state":"active", "type":"TLOG", "leader":"true"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_t1", "base_url":"http://127.0.0.1:45335/c_nec", "node_name":"127.0.0.1:45335_c_nec", "state":"active", "type":"TLOG"}, "core_node6":{ "state":"down", "base_url":"http://127.0.0.1:42971/c_nec", "core":"c8n_1x3_lf_shard1_replica_t2", "node_name":"127.0.0.1:42971_c_nec", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"0", "tlogReplicas":"3"}, "collection1":{ "pullReplicas":"0", "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{"core_node44":{ "core":"collection1_shard1_replica_t43", "base_url":"http://127.0.0.1:42971/c_nec", "node_name":"127.0.0.1:42971_c_nec", "state":"active", "type":"TLOG", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node42":{ "core":"collection1_shard2_replica_t41", "base_url":"http://127.0.0.1:42152/c_nec", "node_name":"127.0.0.1:42152_c_nec", "state":"active", "type":"TLOG", "leader":"true"}, "core_node46":{ "core":"collection1_shard2_replica_t45", "base_url":"http://127.0.0.1:46845/c_nec", "node_name":"127.0.0.1:46845_c_nec", "state":"active", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"}}
Stack Trace:
java.lang.AssertionError: Didn't see all replicas for shard shard1 in c8n_1x3_lf come up within 90000 ms! ClusterState: {
"control_collection":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{"core_node2":{
"core":"control_collection_shard1_replica_n1",
"base_url":"http://127.0.0.1:45335/c_nec",
"node_name":"127.0.0.1:45335_c_nec",
"state":"active",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"},
"c8n_1x3_lf":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"c8n_1x3_lf_shard1_replica_t3",
"base_url":"http://127.0.0.1:46845/c_nec",
"node_name":"127.0.0.1:46845_c_nec",
"state":"active",
"type":"TLOG",
"leader":"true"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_t1",
"base_url":"http://127.0.0.1:45335/c_nec",
"node_name":"127.0.0.1:45335_c_nec",
"state":"active",
"type":"TLOG"},
"core_node6":{
"state":"down",
"base_url":"http://127.0.0.1:42971/c_nec",
"core":"c8n_1x3_lf_shard1_replica_t2",
"node_name":"127.0.0.1:42971_c_nec",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"0",
"tlogReplicas":"3"},
"collection1":{
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node44":{
"core":"collection1_shard1_replica_t43",
"base_url":"http://127.0.0.1:42971/c_nec",
"node_name":"127.0.0.1:42971_c_nec",
"state":"active",
"type":"TLOG",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node42":{
"core":"collection1_shard2_replica_t41",
"base_url":"http://127.0.0.1:42152/c_nec",
"node_name":"127.0.0.1:42152_c_nec",
"state":"active",
"type":"TLOG",
"leader":"true"},
"core_node46":{
"core":"collection1_shard2_replica_t45",
"base_url":"http://127.0.0.1:46845/c_nec",
"node_name":"127.0.0.1:46845_c_nec",
"state":"active",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"}}
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD:376509CEE0EEAD35]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.ensureAllReplicasAreActive(AbstractFullDistribZkTestBase.java:1996)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:99)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestRandomRequestDistribution.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:56579/a1x2
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:56579/a1x2
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD:376509CEE0EEAD35]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:637)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
at org.apache.solr.cloud.TestRandomRequestDistribution.testRequestTracking(TestRandomRequestDistribution.java:124)
at org.apache.solr.cloud.TestRandomRequestDistribution.test(TestRandomRequestDistribution.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
... 48 more
FAILED: org.apache.solr.cloud.autoscaling.NodeLostTriggerTest.testListenerAcceptance
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD:AE856CF3F79BD43B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.NodeLostTriggerTest.testListenerAcceptance(NodeLostTriggerTest.java:253)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11732 lines...]
[junit4] Suite: org.apache.solr.cloud.DistribCursorPagingTest
[junit4] 2> 742801 INFO (SUITE-DistribCursorPagingTest-seed#[BF3136144E12C0CD]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/init-core-data-001
[junit4] 2> 742860 WARN (SUITE-DistribCursorPagingTest-seed#[BF3136144E12C0CD]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
[junit4] 2> 742863 INFO (SUITE-DistribCursorPagingTest-seed#[BF3136144E12C0CD]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 742868 INFO (SUITE-DistribCursorPagingTest-seed#[BF3136144E12C0CD]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-9182 - causes OOM)
[junit4] 2> 742868 INFO (SUITE-DistribCursorPagingTest-seed#[BF3136144E12C0CD]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 742905 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 742905 INFO (Thread-134) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 742905 INFO (Thread-134) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 743013 ERROR (Thread-134) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 743016 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.ZkTestServer start zk server on port:48624
[junit4] 2> 743325 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-deeppaging.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 743344 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema-sorts.xml to /configs/conf1/schema.xml
[junit4] 2> 743345 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 743353 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 743356 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 743361 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 743368 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 743372 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 743377 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 743388 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 743389 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 743432 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 744514 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 744585 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@57e10674{/,null,AVAILABLE}
[junit4] 2> 744586 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@78a1aa58{HTTP/1.1,[http/1.1]}{127.0.0.1:34910}
[junit4] 2> 744586 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.Server Started @765047ms
[junit4] 2> 744586 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/tempDir-001/control/data, hostContext=/, hostPort=34910, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/control-001/cores}
[junit4] 2> 744587 ERROR (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 744587 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 744587 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 744587 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 744587 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T14:00:59.599Z
[junit4] 2> 744820 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 744820 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/control-001/solr.xml
[junit4] 2> 744824 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 744824 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 744841 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 744853 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48624/solr
[junit4] 2> 745974 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 745974 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:34910_
[junit4] 2> 745993 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.c.Overseer Overseer (id=98850259463307268-127.0.0.1:34910_-n_0000000000) starting
[junit4] 2> 746101 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34910_
[junit4] 2> 746165 INFO (OverseerStateUpdate-98850259463307268-127.0.0.1:34910_-n_0000000000) [n:127.0.0.1:34910_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 748300 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 748462 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 748463 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 748464 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:34910_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/control-001/cores
[junit4] 2> 748966 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 748984 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48624/solr ready
[junit4] 2> 749101 INFO (qtp319124802-689) [n:127.0.0.1:34910_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34910_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 749125 INFO (OverseerThreadFactory-480-thread-1-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 749425 INFO (qtp319124802-687) [n:127.0.0.1:34910_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 749425 INFO (qtp319124802-687) [n:127.0.0.1:34910_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 749549 INFO (zkCallback-119-thread-1-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 750592 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 750855 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=sortable
[junit4] 2> 760064 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema sortable/1.6 with uniqueid field id
[junit4] 2> 760064 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 760069 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 760069 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 760069 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 760101 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 761616 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 761616 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 761617 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 761617 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 761619 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=42, maxMergedSegmentMB=25.3427734375, floorSegmentMB=0.427734375, forceMergeDeletesPctAllowed=9.025132656807903, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.23034572362514336
[junit4] 2> 761656 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@15b9d36d[control_collection_shard1_replica_n1] main]
[junit4] 2> 761658 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 761658 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 761659 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 761659 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581604171070570496
[junit4] 2> 761885 INFO (searcherExecutor-483-thread-1-processing-n:127.0.0.1:34910_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@15b9d36d[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 762009 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 762009 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 762010 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34910/control_collection_shard1_replica_n1/
[junit4] 2> 762010 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 762010 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:34910/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 762010 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 762030 INFO (zkCallback-119-thread-2-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 762032 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34910/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 762048 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 762069 INFO (qtp319124802-687) [n:127.0.0.1:34910_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=12645
[junit4] 2> 762105 INFO (qtp319124802-689) [n:127.0.0.1:34910_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 762169 INFO (zkCallback-119-thread-1-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 763106 INFO (qtp319124802-689) [n:127.0.0.1:34910_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:34910_&wt=javabin&version=2} status=0 QTime=14005
[junit4] 2> 763438 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 763439 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:48624/solr ready
[junit4] 2> 763439 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 763449 INFO (qtp319124802-690) [n:127.0.0.1:34910_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 763489 INFO (OverseerCollectionConfigSetProcessor-98850259463307268-127.0.0.1:34910_-n_0000000000) [n:127.0.0.1:34910_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 763490 INFO (OverseerThreadFactory-480-thread-2-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 763499 WARN (OverseerThreadFactory-480-thread-2-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 763677 INFO (qtp319124802-690) [n:127.0.0.1:34910_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 763678 INFO (qtp319124802-690) [n:127.0.0.1:34910_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=228
[junit4] 2> 763717 INFO (OverseerCollectionConfigSetProcessor-98850259463307268-127.0.0.1:34910_-n_0000000000) [n:127.0.0.1:34910_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 765830 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/shard-1-001 of type NRT
[junit4] 2> 765869 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 765937 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1816537a{/,null,AVAILABLE}
[junit4] 2> 765937 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24c368cd{HTTP/1.1,[http/1.1]}{127.0.0.1:40764}
[junit4] 2> 765937 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.e.j.s.Server Started @786398ms
[junit4] 2> 765937 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=40764, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/shard-1-001/cores}
[junit4] 2> 765950 ERROR (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 765997 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 765997 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 765997 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 765997 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-18T14:01:21.009Z
[junit4] 2> 766193 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 766193 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/shard-1-001/solr.xml
[junit4] 2> 766217 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 766217 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 766218 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 766629 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48624/solr
[junit4] 2> 768056 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 768058 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 768059 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40764_
[junit4] 2> 768097 INFO (zkCallback-119-thread-1-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 768124 INFO (zkCallback-127-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 768218 INFO (zkCallback-132-thread-1-processing-n:127.0.0.1:40764_) [n:127.0.0.1:40764_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 768510 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 768551 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 768551 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 768568 INFO (TEST-DistribCursorPagingTest.test-seed#[BF3136144E12C0CD]) [n:127.0.0.1:40764_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPagingTest_BF3136144E12C0CD-001/shard-1-001/cores
[junit4] 2> 768813 INFO (qtp319124802-686) [n:127.0.0.1:34910_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40764_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 768858 INFO (OverseerThreadFactory-480-thread-3-processing-n:127.0.0.1:34910_) [n:127.0.0.1:34910_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40764_ for creating new replica
[junit4] 2> 768990 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 768991 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 769681 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 769751 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=sortable
[junit4] 2> 772854 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema sortable/1.6 with uniqueid field id
[junit4] 2> 772854 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 772854 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f00ed14
[junit4] 2> 772854 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 772854 INFO (qtp1482862051-736) [n:127.0.0.1:40764_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.DistribCursorPag
[...truncated too long message...]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 7) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=14072, name=TEST-ChaosMonkeyNothingIsSafeTest.test-seed#[BF3136144E12C0CD]-SendThread(127.0.0.1:34980), state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 2) Thread[id=14344, name=zkCallback-3418-thread-2, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 3) Thread[id=14346, name=zkCallback-3418-thread-3, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=14074, name=zkCallback-3418-thread-1, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 5) Thread[id=14382, name=zkCallback-3418-thread-4, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=14489, name=zkCallback-3418-thread-5, state=TIMED_WAITING, group=TGRP-ChaosMonkeyNothingIsSafeTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([BF3136144E12C0CD]:0)
[junit4] Completed [302/743 (5!)] on J2 in 181.52s, 1 test, 3 errors <<< FAILURES!
[...truncated 48519 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2123 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2123/
10 tests failed.
FAILED: org.apache.solr.cloud.CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap
Error Message:
Captured an uncaught exception in thread: Thread[id=282, name=Thread-47, state=RUNNABLE, group=TGRP-CdcrBootstrapTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=282, name=Thread-47, state=RUNNABLE, group=TGRP-CdcrBootstrapTest]
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:D518024D8088EB67]:0)
Caused by: java.lang.AssertionError: 1
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320]:0)
at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:192)
at org.apache.solr.core.SolrCore.close(SolrCore.java:1614)
at org.apache.solr.core.CoreContainer.registerCore(CoreContainer.java:874)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1289)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrBootstrapTest
Error Message:
ObjectTracker found 3 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020) at org.apache.solr.core.SolrCore.reload(SolrCore.java:637) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1288) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 3 object(s) that were not released!!! [SolrCore, MockDirectoryWrapper, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:637)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1288)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:952)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:779)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:734)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:294)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:8A9B12E09A2B1ED8]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:584)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1480)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderWithPullReplicasTest.test(ChaosMonkeySafeLeaderWithPullReplicasTest.java:196)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:8A9B12E09A2B1ED8]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:584)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:352)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestRandomRequestDistribution.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:37539/tkjhi/qd
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:37539/tkjhi/qd
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:8A9B12E09A2B1ED8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:637)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.TestRandomRequestDistribution.testRequestTracking(TestRandomRequestDistribution.java:84)
at org.apache.solr.cloud.TestRandomRequestDistribution.test(TestRandomRequestDistribution.java:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
... 52 more
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:43988_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:43988_solr wasn't created
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:1A75A5363AE2BECF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.rule.RulesTest.doIntegrationTest
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320:E7FC6ABB28A38122]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320)
at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:426)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:442)
at org.apache.solr.cloud.rule.RulesTest.removeCollections(RulesTest.java:65)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:992)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.core.TestCoreDiscovery
Error Message:
ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, SolrCore, SolrIndexSearcher] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:323) at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2044) at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2196) at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1072) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:961) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040) at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505) at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737) at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934) at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970) at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, SolrCore, SolrIndexSearcher]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.Thread
[...truncated too long message...]
SolrXmlInZkTest, AddBlockUpdateTest, IndexSchemaTest, FullSolrCloudDistribCmdsTest, TestRebalanceLeaders, TestJavabinTupleStreamParser, TestTolerantSearch, TestLMDirichletSimilarityFactory, TestLRUCache, TlogReplayBufferedWhileIndexingTest, UniqFieldsUpdateProcessorFactoryTest, TestSearchPerf, TestSolrCoreProperties, GraphQueryTest, TestDownShardTolerantSearch, TestSmileRequest, TestAnalyzeInfixSuggestions, XsltUpdateRequestHandlerTest, TestSystemIdResolver, WordBreakSolrSpellCheckerTest, QueryElevationComponentTest, TestReloadDeadlock, HighlighterTest, TestGroupingSearch, TestSolrDeletionPolicy2, TestEmbeddedSolrServerConstructors, TestLFUCache, TestCloudManagedSchema, TestTrieFacet, BasicDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, RecoveryZkTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, DistributedSpellCheckComponentTest, TestRealTimeGet, TestReload, DistributedTermsComponentTest, TestCoreContainer, TestSolr4Spatial, SolrCoreTest, SpellCheckComponentTest, PeerSyncTest, TestSort, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, TestBadConfig, TestIndexSearcher, ShowFileRequestHandlerTest, TestCoreDiscovery]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestCoreDiscovery -Dtests.seed=2CF2D3A34D77320 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=ar-TN -Dtests.timezone=Europe/San_Marino -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J2 | TestCoreDiscovery (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, MDCAwareThreadPoolExecutor, SolrCore, SolrIndexSearcher]
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
[junit4] > at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
[junit4] > at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
[junit4] > at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
[junit4] > at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)
[junit4] > at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:873)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.search.SolrIndexSearcher
[junit4] > at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
[junit4] > at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:323)
[junit4] > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2044)
[junit4] > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2196)
[junit4] > at org.apache.solr.core.SolrCore.initSearcher(SolrCore.java:1072)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:961)
[junit4] > at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
[junit4] > at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1040)
[junit4] > at org.apache.solr.core.CoreContainer.getCore(CoreContainer.java:1505)
[junit4] > at org.apache.solr.core.TestCoreDiscovery.testTooManyTransientCores(TestCoreDiscovery.java:320)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:294)
[junit4] > at java.lang.Thread.run(Thread.java:748)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestCoreDiscovery:
[junit4] > 1) Thread[id=13521, name=searcherExecutor-6014-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=13521, name=searcherExecutor-6014-thread-1, state=WAITING, group=TGRP-TestCoreDiscovery]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([2CF2D3A34D77320]:0)
[junit4] Completed [417/743 (7!)] on J2 in 78.58s, 13 tests, 1 failure, 2 errors <<< FAILURES!
[...truncated 48158 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2122 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2122/
1 tests failed.
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testBasics
Error Message:
Error from server at http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([7BAA6BBC6B10BC3D:4672C59053FEE24D]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
Build Log:
[...truncated 12190 lines...]
[junit4] Suite: org.apache.solr.cloud.TestAuthenticationFramework
[junit4] 2> 2057352 INFO (SUITE-TestAuthenticationFramework-seed#[7BAA6BBC6B10BC3D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/init-core-data-001
[junit4] 2> 2057353 INFO (SUITE-TestAuthenticationFramework-seed#[7BAA6BBC6B10BC3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 2057353 INFO (SUITE-TestAuthenticationFramework-seed#[7BAA6BBC6B10BC3D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2057355 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001
[junit4] 2> 2057355 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2057392 INFO (Thread-868) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2057392 INFO (Thread-868) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2057428 ERROR (Thread-868) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2057501 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.ZkTestServer start zk server on port:45529
[junit4] 2> 2057555 INFO (jetty-launcher-2476-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2057628 INFO (jetty-launcher-2476-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2057664 INFO (jetty-launcher-2476-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5e7a5402{/solr,null,AVAILABLE}
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4fe26542{HTTP/1.1,[http/1.1]}{127.0.0.1:42933}
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.e.j.s.Server Started @2070971ms
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42933}
[junit4] 2> 2057667 ERROR (jetty-launcher-2476-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2057667 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-16T21:19:06.221Z
[junit4] 2> 2057774 INFO (jetty-launcher-2476-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3e04f341{/solr,null,AVAILABLE}
[junit4] 2> 2057774 INFO (jetty-launcher-2476-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2636bb9a{HTTP/1.1,[http/1.1]}{127.0.0.1:38293}
[junit4] 2> 2057774 INFO (jetty-launcher-2476-thread-2) [ ] o.e.j.s.Server Started @2071079ms
[junit4] 2> 2057774 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38293}
[junit4] 2> 2057774 ERROR (jetty-launcher-2476-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2057774 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2057775 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2057775 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2057775 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-16T21:19:06.329Z
[junit4] 2> 2057847 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2057867 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2057900 INFO (jetty-launcher-2476-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45529/solr
[junit4] 2> 2057974 INFO (jetty-launcher-2476-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45529/solr
[junit4] 2> 2058289 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2058289 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2058303 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38293_solr
[junit4] 2> 2058303 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42933_solr
[junit4] 2> 2058304 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.Overseer Overseer (id=98840657654317060-127.0.0.1:38293_solr-n_0000000000) starting
[junit4] 2> 2058378 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2058575 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2058669 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38293_solr
[junit4] 2> 2058670 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2058671 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2058705 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 2059097 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42933.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059169 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42933.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059170 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42933.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059171 INFO (jetty-launcher-2476-thread-1) [n:127.0.0.1:42933_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node1/.
[junit4] 2> 2059464 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.cloud.TestAuthenticationFramework$MockAuthenticationPlugin
[junit4] 2> 2059805 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38293.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059901 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38293.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059902 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38293.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2059935 INFO (jetty-launcher-2476-thread-2) [n:127.0.0.1:38293_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node2/.
[junit4] 2> 2060316 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2060389 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45529/solr ready
[junit4] 2> 2060579 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testBasics
[junit4] 2> 2060581 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=9ce73134-a559-417d-9e0b-128f743abaca&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=2&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2060690 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=9ce73134-a559-417d-9e0b-128f743abaca&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=2&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=108
[junit4] 2> 2060692 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2060815 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=123
[junit4] 2> 2060889 INFO (OverseerThreadFactory-2178-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.CreateCollectionCmd Create collection testcollection
[junit4] 2> 2061465 INFO (OverseerStateUpdate-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38293/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2061631 INFO (OverseerStateUpdate-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testcollection_shard1_replica_n3",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42933/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2061793 INFO (OverseerStateUpdate-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n5",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38293/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2061818 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2061874 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=56
[junit4] 2> 2062000 INFO (OverseerStateUpdate-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testcollection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"testcollection_shard2_replica_n7",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:42933/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2062273 INFO (qtp876687970-7301) [n:127.0.0.1:42933_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059796007441&coreNodeName=core_node8&name=testcollection_shard2_replica_n7&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=0
[junit4] 2> 2062273 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059796007441&coreNodeName=core_node8&name=testcollection_shard2_replica_n7&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 2062273 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2062273 INFO (qtp742916998-7312) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059285098623&coreNodeName=core_node2&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=14
[junit4] 2> 2062274 INFO (qtp876687970-7300) [n:127.0.0.1:42933_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059447236677&coreNodeName=core_node4&name=testcollection_shard1_replica_n3&action=CREATE&numShards=2&shard=shard1&wt=javabin} status=0 QTime=1
[junit4] 2> 2062274 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059447236677&coreNodeName=core_node4&name=testcollection_shard1_replica_n3&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 2062321 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059285098623&coreNodeName=core_node2&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&wt=javabin
[junit4] 2> 2062321 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2062365 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&coreNodeName=core_node6&name=testcollection_shard2_replica_n5&action=CREATE&numShards=2&shard=shard2&wt=javabin} status=0 QTime=90
[junit4] 2> 2062381 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&coreNodeName=core_node6&name=testcollection_shard2_replica_n5&action=CREATE&numShards=2&shard=shard2&wt=javabin
[junit4] 2> 2062438 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2062438 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2062564 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2062564 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2062600 INFO (zkCallback-2484-thread-2-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2062875 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2062876 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2063408 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2063479 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2063479 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2063590 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.s.IndexSchema [testcollection_shard2_replica_n7] Schema name=minimal
[junit4] 2> 2063904 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2063918 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2063935 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2063935 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n7' using configuration from collection testcollection, trusted=true
[junit4] 2> 2064009 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42933.solr.core.testcollection.shard2.replica_n7' (registry 'solr.core.testcollection.shard2.replica_n7') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2064010 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2064010 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrCore [[testcollection_shard2_replica_n7] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node1/testcollection_shard2_replica_n7], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node1/./testcollection_shard2_replica_n7/data/]
[junit4] 2> 2064013 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2064065 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=146
[junit4] 2> 2064231 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.IndexSchema [testcollection_shard1_replica_n3] Schema name=minimal
[junit4] 2> 2064233 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2064233 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n3' using configuration from collection testcollection, trusted=true
[junit4] 2> 2064233 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42933.solr.core.testcollection.shard1.replica_n3' (registry 'solr.core.testcollection.shard1.replica_n3') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2064234 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2064234 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrCore [[testcollection_shard1_replica_n3] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node1/testcollection_shard1_replica_n3], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node1/./testcollection_shard1_replica_n3/data/]
[junit4] 2> 2064265 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema [testcollection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2064267 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2064267 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n1' using configuration from collection testcollection, trusted=true
[junit4] 2> 2064267 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38293.solr.core.testcollection.shard1.replica_n1' (registry 'solr.core.testcollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2064267 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2064267 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [[testcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node2/testcollection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node2/./testcollection_shard1_replica_n1/data/]
[junit4] 2> 2064391 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2064487 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2064487 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2064536 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.s.IndexSchema [testcollection_shard2_replica_n5] Schema name=minimal
[junit4] 2> 2064538 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2064538 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n5' using configuration from collection testcollection, trusted=true
[junit4] 2> 2064538 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38293.solr.core.testcollection.shard2.replica_n5' (registry 'solr.core.testcollection.shard2.replica_n5') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5682a8b0
[junit4] 2> 2064538 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2064538 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.SolrCore [[testcollection_shard2_replica_n5] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node2/testcollection_shard2_replica_n5], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001/tempDir-001/node2/./testcollection_shard2_replica_n5/data/]
[junit4] 2> 2064682 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2064682 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2064683 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2064683 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2064702 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.s.SolrIndexSearcher Opening [Searcher@33c62516[testcollection_shard2_replica_n7] main]
[junit4] 2> 2064759 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2064760 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2065068 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2065068 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2065085 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2065085 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581450530535768064
[junit4] 2> 2065087 INFO (qtp742916998-7312) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2065087 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2065088 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2065088 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2065088 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2065106 INFO (searcherExecutor-2183-thread-1-processing-x:testcollection_shard2_replica_n7 r:core_node8 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE n:127.0.0.1:42933_solr s:shard2 c:testcollection) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SolrCore [testcollection_shard2_replica_n7] Registered new searcher Searcher@33c62516[testcollection_shard2_replica_n7] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2065125 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@366f3c79[testcollection_shard1_replica_n3] main]
[junit4] 2> 2065142 INFO (qtp742916998-7312) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=54
[junit4] 2> 2065105 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2065154 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2065211 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2065211 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2065212 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2065212 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581450530668937216
[junit4] 2> 2065212 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@375cd046[testcollection_shard1_replica_n1] main]
[junit4] 2> 2065215 INFO (searcherExecutor-2184-thread-1-processing-x:testcollection_shard1_replica_n3 r:core_node4 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE n:127.0.0.1:42933_solr s:shard1 c:testcollection) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrCore [testcollection_shard1_replica_n3] Registered new searcher Searcher@366f3c79[testcollection_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2065374 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2065375 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2065375 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2065375 INFO (parallelCoreAdminExecutor-2181-thread-1-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581450530839855104
[junit4] 2> 2065378 INFO (searcherExecutor-2185-thread-1-processing-x:testcollection_shard1_replica_n1 r:core_node2 9ce73134-a559-417d-9e0b-128f743abaca8298059285098623 CREATE n:127.0.0.1:38293_solr s:shard1 c:testcollection) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@375cd046[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2065447 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2065447 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2065448 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2065448 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2065449 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.s.SolrIndexSearcher Opening [Searcher@632b631d[testcollection_shard2_replica_n5] main]
[junit4] 2> 2065451 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
[junit4] 2> 2065486 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
[junit4] 2> 2065486 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2065487 INFO (parallelCoreAdminExecutor-2181-thread-2-processing-n:127.0.0.1:38293_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581450530957295616
[junit4] 2> 2065488 INFO (searcherExecutor-2187-thread-1-processing-x:testcollection_shard2_replica_n5 r:core_node6 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857 CREATE n:127.0.0.1:38293_solr s:shard2 c:testcollection) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.SolrCore [testcollection_shard2_replica_n5] Registered new searcher Searcher@632b631d[testcollection_shard2_replica_n5] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2065505 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2065505 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2065506 INFO (zkCallback-2484-thread-2-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065506 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065507 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065507 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9977ms
[junit4] 2> 2065508 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2065508 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2065630 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/
[junit4] 2> 2065630 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n3 url=http://127.0.0.1:42933/solr START replicas=[http://127.0.0.1:38293/solr/testcollection_shard1_replica_n1/] nUpdates=100
[junit4] 2> 2065632 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065634 INFO (zkCallback-2484-thread-2-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065634 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2065821 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.S.Request [testcollection_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=186
[junit4] 2> 2065931 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n3 url=http://127.0.0.1:42933/solr DONE. We have no versions. sync failed.
[junit4] 2> 2065931 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2065931 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2065931 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2065981 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/ shard1
[junit4] 2> 2066016 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2066016 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2066016 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42933/solr/testcollection_shard2_replica_n7/
[junit4] 2> 2066016 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n7 url=http://127.0.0.1:42933/solr START replicas=[http://127.0.0.1:38293/solr/testcollection_shard2_replica_n5/] nUpdates=100
[junit4] 2> 2066055 INFO (qtp742916998-7318) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.S.Request [testcollection_shard2_replica_n5] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=37
[junit4] 2> 2066090 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066090 INFO (zkCallback-2484-thread-2-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066090 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066105 INFO (parallelCoreAdminExecutor-2179-thread-2-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059447236677 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2066146 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2066163 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 2066216 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066216 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066216 INFO (zkCallback-2484-thread-3-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066325 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n7 url=http://127.0.0.1:42933/solr DONE. We have no versions. sync failed.
[junit4] 2> 2066325 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2066325 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2066325 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2066327 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42933/solr/testcollection_shard2_replica_n7/ shard2
[junit4] 2> 2066508 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066508 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2066509 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2066509 INFO (zkCallback-2484-thread-3-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066509 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066545 INFO (parallelCoreAdminExecutor-2179-thread-1-processing-n:127.0.0.1:42933_solr 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441 CREATE) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2066712 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066727 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2066728 INFO (zkCallback-2484-thread-3-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2067013 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2067013 INFO (zkCallback-2484-thread-3-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2067020 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2067164 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2067180 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 2067513 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059613526857
[junit4] 2> 2067513 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059613526857&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2067516 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 9ce73134-a559-417d-9e0b-128f743abaca8298059796007441
[junit4] 2> 2067516 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=9ce73134-a559-417d-9e0b-128f743abaca8298059796007441&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2067550 INFO (OverseerThreadFactory-2178-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2068192 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2068194 INFO (qtp742916998-7311) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 2068195 INFO (qtp742916998-7318) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2068228 INFO (qtp742916998-7318) [n:127.0.0.1:38293_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=9ce73134-a559-417d-9e0b-128f743abaca&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=33
[junit4] 2> 2068228 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testcollection failOnTimeout:true timeout (sec):330
[junit4] 1> -
[junit4] 1> replica:core_node2 rstate:active live:true
[junit4] 1> replica:core_node4 rstate:active live:true
[junit4] 1> replica:core_node6 rstate:active live:true
[junit4] 1> replica:core_node8 rstate:active live:true
[junit4] 1> no one is recoverying
[junit4] 2> 2068229 INFO (TEST-TestAuthenticationFramework.testBasics-seed#[7BAA6BBC6B10BC3D]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testcollection
[junit4] 2> 2068232 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.c.S.Request [testcollection_shard2_replica_n5] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:12&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:38293/solr/testcollection_shard2_replica_n5/|http://127.0.0.1:42933/solr/testcollection_shard2_replica_n7/&rows=10&version=2&q=*:*&NOW=1508188756785&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2068266 INFO (qtp876687970-7307) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.S.Request [testcollection_shard1_replica_n3] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:12&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/|http://127.0.0.1:38293/solr/testcollection_shard1_replica_n1/&rows=10&version=2&q=*:*&NOW=1508188756785&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2068266 INFO (qtp876687970-7306) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.S.Request [testcollection_shard2_replica_n7] webapp=/solr path=/select params={q=*:*&_stateVer_=testcollection:12&wt=javabin&version=2} hits=0 status=0 QTime=35
[junit4] 2> 2068444 INFO (qtp742916998-7315) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&wt=javabin&version=2}{add=[1 (1581450533964611584)]} 0 31
[junit4] 2> 2068444 INFO (qtp876687970-7307) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n3] webapp=/solr path=/update params={_stateVer_=testcollection:12&wt=javabin&version=2}{add=[1 (1581450533964611584)]} 0 89
[junit4] 2> 2068460 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1581450534074712064,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2068461 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7cb85bc7 commitCommandVersion:1581450534074712064
[junit4] 2> 2068468 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1581450534083100672,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2068468 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@3d306ab0 commitCommandVersion:1581450534083100672
[junit4] 2> 2068577 INFO (qtp876687970-7305) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1581450534197395456,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2068578 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1581450534198444032,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 2068578 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2068590 INFO (qtp876687970-7305) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 2068631 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2068632 INFO (qtp742916998-7316) [n:127.0.0.1:38293_solr c:testcollection s:shard2 r:core_node6 x:testcollection_shard2_replica_n5] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n5] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 53
[junit4] 2> 2068633 INFO (qtp876687970-7305) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2068633 INFO (qtp876687970-7305) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n7] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 56
[junit4] 2> 2068648 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@787e4571[testcollection_shard1_replica_n1] main]
[junit4] 2> 2068648 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2068650 INFO (searcherExecutor-2185-thread-1-processing-n:127.0.0.1:38293_solr x:testcollection_shard1_replica_n1 s:shard1 c:testcollection r:core_node2) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@787e4571[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 2068650 INFO (qtp742916998-7317) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 189
[junit4] 2> 2068650 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f0f3fd8[testcollection_shard1_replica_n3] main]
[junit4] 2> 2068668 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 2068668 INFO (searcherExecutor-2184-thread-1-processing-n:127.0.0.1:42933_solr x:testcollection_shard1_replica_n3 s:shard1 c:testcollection r:core_node4) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.SolrCore [testcollection_shard1_replica_n3] Registered new searcher Searcher@4f0f3fd8[testcollection_shard1_replica_n3] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 2068668 INFO (qtp876687970-7303) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n3] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 199
[junit4] 2> 2068668 INFO (qtp876687970-7300) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n3] webapp=/solr path=/update params={_stateVer_=testcollection:12&commit=true&wt=javabin&version=2}{commit=} 0 219
[junit4] 2> 2068669 INFO (qtp876687970-7306) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node8 x:testcollection_shard2_replica_n7] o.a.s.c.S.Request [testcollection_shard2_replica_n7] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:12&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:42933/solr/testcollection_shard2_replica_n7/|http://127.0.0.1:38293/solr/testcollection_shard2_replica_n5/&rows=10&version=2&q=*:*&NOW=1508188757223&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 2068669 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.S.Request [testcollection_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:12&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:38293/solr/testcollection_shard1_replica_n1/|http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&rows=10&version=2&q=*:*&NOW=1508188757223&isShard=true&wt=javabin} hits=1 status=0 QTime=0
[junit4] 2> 2068705 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr c:testcollection s:shard1 r:core_node2 x:testcollection_shard1_replica_n1] o.a.s.c.S.Request [testcollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=testcollection:12&shards.purpose=64&NOW=1508188757223&ids=1&isShard=true&shard.url=http://127.0.0.1:38293/solr/testcollection_shard1_replica_n1/|http://127.0.0.1:42933/solr/testcollection_shard1_replica_n3/&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2068720 INFO (qtp876687970-7304) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node4 x:testcollection_shard1_replica_n3] o.a.s.c.S.Request [testcollection_shard1_replica_n3] webapp=/solr path=/select params={q=*:*&_stateVer_=testcollection:12&wt=javabin&version=2} hits=1 status=0 QTime=51
[junit4] 2> 2068721 INFO (qtp742916998-7314) [n:127.0.0.1:38293_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testcollection&action=DELETE&wt=javabin&vers
[...truncated too long message...]
vent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2076506 INFO (zkCallback-2484-thread-2-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2076506 INFO (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2076506 INFO (coreCloseExecutor-2224-thread-2) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard2.replica_n4, tag=296708573
[junit4] 2> 2076506 INFO (coreCloseExecutor-2224-thread-2) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3a505896: rootName = solr_42933, domain = solr.core.testcollection.shard2.replica_n4, service url = null, agent id = null] for registry solr.core.testcollection.shard2.replica_n4 / com.codahale.metrics.MetricRegistry@2763df9f
[junit4] 2> 2076623 INFO (coreCloseExecutor-2224-thread-1) [n:127.0.0.1:42933_solr c:testcollection s:shard1 r:core_node3 x:testcollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard1.leader, tag=1127207188
[junit4] 2> 2076623 INFO (coreCloseExecutor-2224-thread-2) [n:127.0.0.1:42933_solr c:testcollection s:shard2 r:core_node7 x:testcollection_shard2_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard2.leader, tag=296708573
[junit4] 2> 2076750 INFO (jetty-closer-2477-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98840657654317060-127.0.0.1:38293_solr-n_0000000000) closing
[junit4] 2> 2076750 INFO (OverseerStateUpdate-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:38293_solr
[junit4] 2> 2076762 WARN (OverseerAutoScalingTriggerThread-98840657654317060-127.0.0.1:38293_solr-n_0000000000) [n:127.0.0.1:38293_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2076819 INFO (zkCallback-2489-thread-1-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42933_solr
[junit4] 2> 2076819 INFO (zkCallback-2489-thread-2-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2078306 WARN (zkCallback-2484-thread-1-processing-n:127.0.0.1:38293_solr) [n:127.0.0.1:38293_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2078306 INFO (jetty-closer-2477-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3e04f341{/solr,null,UNAVAILABLE}
[junit4] 2> 2078321 WARN (zkCallback-2489-thread-3-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2078326 WARN (zkCallback-2489-thread-2-processing-n:127.0.0.1:42933_solr) [n:127.0.0.1:42933_solr ] o.a.s.c.ZkController Unable to register nodeLost path for 127.0.0.1:38293_solr
[junit4] 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /autoscaling/nodeLost/127.0.0.1:38293_solr
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:392)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$9.execute(SolrZkClient.java:389)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:389)
[junit4] 2> at org.apache.solr.cloud.ZkController.lambda$registerLiveNodesListener$2(ZkController.java:879)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.lambda$refreshLiveNodes$1(ZkStateReader.java:747)
[junit4] 2> at java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:746)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$1000(ZkStateReader.java:72)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1152)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1147)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2078327 INFO (jetty-closer-2477-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5e7a5402{/solr,null,UNAVAILABLE}
[junit4] 2> 2078328 ERROR (SUITE-TestAuthenticationFramework-seed#[7BAA6BBC6B10BC3D]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2078328 INFO (SUITE-TestAuthenticationFramework-seed#[7BAA6BBC6B10BC3D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45529 45529
[junit4] 2> 2078456 INFO (Thread-868) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45529 45529
[junit4] 2> 2078456 WARN (Thread-868) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/configs/solrCloudCollectionConfig
[junit4] 2> 3 /solr/aliases.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 28 /solr/collections/testcollection/state.json
[junit4] 2> 3 /solr/clusterstate.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 3 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestAuthenticationFramework_7BAA6BBC6B10BC3D-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {id=Lucene50(blocksize=128)}, docValues:{}, maxPointsInLeafNode=1575, maxMBSortInHeap=5.11104481443652, sim=RandomSimilarity(queryNorm=true): {}, locale=sv-SE, timezone=Europe/Kiev
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=221365768,total=525336576
[junit4] 2> NOTE: All tests run in this JVM: [TestSolrConfigHandlerConcurrent, MBeansHandlerTest, TestFieldCacheWithThreads, TestPivotHelperCode, SolrCLIZkUtilsTest, SpatialRPTFieldTypeTest, TestFunctionQuery, MetricsHandlerTest, TestSerializedLuceneMatchVersion, V2StandaloneTest, UUIDFieldTest, TestPushWriter, HdfsSyncSliceTest, SolrPluginUtilsTest, CloudExitableDirectoryReaderTest, IndexBasedSpellCheckerTest, SolrRequestParserTest, LeaderFailoverAfterPartitionTest, TestMissingGroups, TestCloudRecovery, ChaosMonkeySafeLeaderWithPullReplicasTest, TestQueryWrapperFilter, TestCSVResponseWriter, ConjunctionSolrSpellCheckerTest, TestDistributedSearch, TestSolrCoreSnapshots, TestCrossCoreJoin, UUIDUpdateProcessorFallbackTest, TestNumericRangeQuery64, TestComplexPhraseQParserPlugin, TestLuceneMatchVersion, TestCollectionAPI, BlockJoinFacetRandomTest, SolrGangliaReporterTest, TestDelegationWithHadoopAuth, TestLockTree, SolrMetricManagerTest, TestWordDelimiterFilterFactory, TestSubQueryTransformer, TestLazyCores, TestReRankQParserPlugin, CloneFieldUpdateProcessorFactoryTest, TestRealTimeGet, ExplicitHLLTest, TestFieldTypeCollectionResource, TestSQLHandler, RAMDirectoryFactoryTest, TestInitQParser, TestDistributedStatsComponentCardinality, PeerSyncTest, TestConfigSetsAPIExclusivity, DistributedVersionInfoTest, TestInPlaceUpdatesStandalone, TestOverriddenPrefixQueryForCustomFieldType, ReplaceNodeTest, TestDeleteCollectionOnDownNodes, TestClusterStateMutator, TestAuthenticationFramework]
[junit4] Completed [191/745 (1!)] on J0 in 21.38s, 1 test, 1 error <<< FAILURES!
[...truncated 48754 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2121 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2121/
6 tests failed.
FAILED: org.apache.solr.cloud.DeleteShardTest.testDirectoryCleanupAfterDeleteShard
Error Message:
Could not load collection from ZK: deleteshard_test
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: deleteshard_test
at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:21EBFD85E70B2B34]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.DeleteShardTest.testDirectoryCleanupAfterDeleteShard(DeleteShardTest.java:113)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/deleteshard_test/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 44 more
FAILED: org.apache.solr.cloud.DeleteStatusTest.testAsyncIdsMayBeDeleted
Error Message:
expected:<NOT_FOUND> but was:<RUNNING>
Stack Trace:
java.lang.AssertionError: expected:<NOT_FOUND> but was:<RUNNING>
at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:BF44DA28A2EDB7FD]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.cloud.DeleteStatusTest.testAsyncIdsMayBeDeleted(DeleteStatusTest.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.HttpPartitionTest.test
Error Message:
Doc with id=2 not found in http://127.0.0.1:51898/c8n_1x2 due to: Path not found: /id; rsp={doc=null}
Stack Trace:
java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:51898/c8n_1x2 due to: Path not found: /id; rsp={doc=null}
at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:9A58904ED870DC0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:605)
at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:560)
at org.apache.solr.cloud.HttpPartitionTest.testRf2(HttpPartitionTest.java:329)
at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:132)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:48392_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:48392_solr wasn't created
at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:994B3ED24D4EADD7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenRenew
Error Message:
expected:<200> but was:<403>
Stack Trace:
java.lang.AssertionError: expected:<200> but was:<403>
at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:B66A42C07BB7BD9C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.renewDelegationToken(TestDelegationWithHadoopAuth.java:118)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.verifyDelegationTokenRenew(TestDelegationWithHadoopAuth.java:302)
at org.apache.solr.security.hadoop.TestDelegationWithHadoopAuth.testDelegationTokenRenew(TestDelegationWithHadoopAuth.java:319)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testHandlingOfStaleAlias
Error Message:
Fetching cluster properties not supported using the HttpClusterStateProvider. ZkClientClusterStateProvider can be used for this.
Stack Trace:
java.lang.UnsupportedOperationException: Fetching cluster properties not supported using the HttpClusterStateProvider. ZkClientClusterStateProvider can be used for this.
at __randomizedtesting.SeedInfo.seed([DE81599CA4335759:CEFC1E5551D057CE]:0)
at org.apache.solr.client.solrj.impl.HttpClusterStateProvider.getClusterProperties(HttpClusterStateProvider.java:254)
at org.apache.solr.client.solrj.impl.ClusterStateProvider.getClusterProperty(ClusterStateProvider.java:65)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1019)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testHandlingOfStaleAlias(CloudSolrClientTest.java:226)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11684 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteStatusTest
[junit4] 2> 657686 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/init-core-data-001
[junit4] 2> 657686 WARN (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
[junit4] 2> 657686 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 657692 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 657692 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001
[junit4] 2> 657692 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 657711 INFO (Thread-275) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 657711 INFO (Thread-275) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 657771 ERROR (Thread-275) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 657823 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:40097
[junit4] 2> 657940 INFO (jetty-launcher-1002-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 658155 INFO (jetty-launcher-1002-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 658176 INFO (jetty-launcher-1002-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2ba12a9b{/solr,null,AVAILABLE}
[junit4] 2> 658177 INFO (jetty-launcher-1002-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@24b97dee{HTTP/1.1,[http/1.1]}{127.0.0.1:44989}
[junit4] 2> 658177 INFO (jetty-launcher-1002-thread-2) [ ] o.e.j.s.Server Started @674801ms
[junit4] 2> 658178 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44989}
[junit4] 2> 658178 ERROR (jetty-launcher-1002-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 658178 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 658178 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 658178 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 658178 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-15T13:15:21.895Z
[junit4] 2> 658192 INFO (jetty-launcher-1002-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6f1ad765{/solr,null,AVAILABLE}
[junit4] 2> 658199 INFO (jetty-launcher-1002-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6131ca66{HTTP/1.1,[http/1.1]}{127.0.0.1:46416}
[junit4] 2> 658199 INFO (jetty-launcher-1002-thread-1) [ ] o.e.j.s.Server Started @674823ms
[junit4] 2> 658199 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=46416}
[junit4] 2> 658249 ERROR (jetty-launcher-1002-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 658249 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 658249 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 658249 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 658249 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-15T13:15:21.966Z
[junit4] 2> 658320 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 658340 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 658416 INFO (jetty-launcher-1002-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40097/solr
[junit4] 2> 658541 INFO (jetty-launcher-1002-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40097/solr
[junit4] 2> 659285 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 659324 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:46416_solr
[junit4] 2> 659325 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.c.Overseer Overseer (id=98833093194153989-127.0.0.1:46416_solr-n_0000000000) starting
[junit4] 2> 659345 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 659345 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44989_solr
[junit4] 2> 659384 INFO (zkCallback-1014-thread-1-processing-n:127.0.0.1:44989_solr) [n:127.0.0.1:44989_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 659404 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 659568 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46416_solr
[junit4] 2> 659627 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 659628 INFO (zkCallback-1014-thread-1-processing-n:127.0.0.1:44989_solr) [n:127.0.0.1:44989_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 660321 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44989.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660326 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46416.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660510 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44989.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660511 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44989.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660576 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46416.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660577 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46416.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 660588 INFO (jetty-launcher-1002-thread-1) [n:127.0.0.1:46416_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node1/.
[junit4] 2> 660588 INFO (jetty-launcher-1002-thread-2) [n:127.0.0.1:44989_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node2/.
[junit4] 2> 661348 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 661349 INFO (SUITE-DeleteStatusTest-seed#[81F1B6DE437B6038]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40097/solr ready
[junit4] 2> 661443 INFO (TEST-DeleteStatusTest.testAsyncIdsMayBeDeleted-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testAsyncIdsMayBeDeleted
[junit4] 2> 661528 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=6733edf7-da46-4802-aee7-a161d4f7091c&replicationFactor=1&collection.configName=conf1&name=deletestatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 661531 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=6733edf7-da46-4802-aee7-a161d4f7091c&replicationFactor=1&collection.configName=conf1&name=deletestatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 661535 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 661536 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 661537 INFO (OverseerThreadFactory-573-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.CreateCollectionCmd Create collection deletestatus
[junit4] 2> 661666 INFO (OverseerStateUpdate-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"deletestatus",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"deletestatus_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46416/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 662196 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=deletestatus&version=2&replicaType=NRT&async=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&coreNodeName=core_node2&name=deletestatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=15
[junit4] 2> 662197 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=deletestatus&version=2&replicaType=NRT&async=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&coreNodeName=core_node2&name=deletestatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 662222 INFO (qtp1135172787-2099) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666
[junit4] 2> 662222 INFO (qtp1135172787-2099) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 662232 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 662499 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 662568 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 662568 INFO (zkCallback-1013-thread-2-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 662593 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=25
[junit4] 2> 663224 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666
[junit4] 2> 663224 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 663386 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 663529 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.s.IndexSchema [deletestatus_shard1_replica_n1] Schema name=minimal
[junit4] 2> 663602 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 663604 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 663606 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 663606 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'deletestatus_shard1_replica_n1' using configuration from collection deletestatus, trusted=true
[junit4] 2> 663643 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46416.solr.core.deletestatus.shard1.replica_n1' (registry 'solr.core.deletestatus.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 663643 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 663644 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SolrCore [[deletestatus_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node1/deletestatus_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node1/./deletestatus_shard1_replica_n1/data/]
[junit4] 2> 664207 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 664207 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 664208 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 664208 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 664248 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@541ceeae[deletestatus_shard1_replica_n1] main]
[junit4] 2> 664249 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 664249 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 664250 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 664268 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581329497965199360
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46416/solr/deletestatus_shard1_replica_n1/
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:46416/solr/deletestatus_shard1_replica_n1/ has no replicas
[junit4] 2> 664308 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 664344 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46416/solr/deletestatus_shard1_replica_n1/ shard1
[junit4] 2> 664424 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666
[junit4] 2> 664424 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 664428 INFO (searcherExecutor-578-thread-1-processing-x:deletestatus_shard1_replica_n1 r:core_node2 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE n:127.0.0.1:46416_solr s:shard1 c:deletestatus) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.SolrCore [deletestatus_shard1_replica_n1] Registered new searcher Searcher@541ceeae[deletestatus_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 664627 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 664627 INFO (zkCallback-1013-thread-2-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 664632 INFO (parallelCoreAdminExecutor-575-thread-1-processing-n:127.0.0.1:46416_solr 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666 CREATE) [n:127.0.0.1:46416_solr c:deletestatus s:shard1 r:core_node2 x:deletestatus_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 664736 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 664753 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 664831 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 664919 INFO (zkCallback-1013-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/deletestatus/state.json] for collection [deletestatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 665437 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666
[junit4] 2> 665446 INFO (qtp1135172787-2100) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=6733edf7-da46-4802-aee7-a161d4f7091c8325251530765666&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=9
[junit4] 2> 665924 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 665928 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 665931 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 665933 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 665935 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 665936 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 665940 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 665940 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=6733edf7-da46-4802-aee7-a161d4f7091c&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 665941 INFO (TEST-DeleteStatusTest.testAsyncIdsMayBeDeleted-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testAsyncIdsMayBeDeleted
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteStatusTest -Dtests.method=testAsyncIdsMayBeDeleted -Dtests.seed=81F1B6DE437B6038 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=sq-AL -Dtests.timezone=Asia/Krasnoyarsk -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 4.59s J1 | DeleteStatusTest.testAsyncIdsMayBeDeleted <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<NOT_FOUND> but was:<RUNNING>
[junit4] > at __randomizedtesting.SeedInfo.seed([81F1B6DE437B6038:BF44DA28A2EDB7FD]:0)
[junit4] > at org.apache.solr.cloud.DeleteStatusTest.testAsyncIdsMayBeDeleted(DeleteStatusTest.java:74)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 665952 INFO (OverseerThreadFactory-573-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 666008 INFO (TEST-DeleteStatusTest.testProcessAndWaitDeletesAsyncIds-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProcessAndWaitDeletesAsyncIds
[junit4] 2> 666008 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=request1&replicationFactor=1&collection.configName=conf1&name=requeststatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 666009 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=request1&replicationFactor=1&collection.configName=conf1&name=requeststatus&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 666010 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 666012 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 666103 INFO (OverseerCollectionConfigSetProcessor-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 666130 INFO (OverseerThreadFactory-573-thread-2-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.CreateCollectionCmd Create collection requeststatus
[junit4] 2> 666316 INFO (OverseerStateUpdate-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"requeststatus",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"requeststatus_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46416/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 667075 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 667075 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 667745 INFO (qtp1135172787-2095) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=requeststatus&version=2&replicaType=NRT&async=request18325256181658011&coreNodeName=core_node2&name=requeststatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=1117
[junit4] 2> 667770 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : request18325256181658011
[junit4] 2> 667770 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=request18325256181658011&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 667770 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=requeststatus&version=2&replicaType=NRT&async=request18325256181658011&coreNodeName=core_node2&name=requeststatus_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 667897 INFO (zkCallback-1013-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 667897 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 668127 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 668135 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 668772 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : request18325256181658011
[junit4] 2> 668772 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=request18325256181658011&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 669133 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 669140 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 669168 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=27
[junit4] 2> 669206 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.s.IndexSchema [requeststatus_shard1_replica_n1] Schema name=minimal
[junit4] 2> 669208 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 669208 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'requeststatus_shard1_replica_n1' using configuration from collection requeststatus, trusted=true
[junit4] 2> 669209 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_46416.solr.core.requeststatus.shard1.replica_n1' (registry 'solr.core.requeststatus.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a79b6ee
[junit4] 2> 669209 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 669209 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SolrCore [[requeststatus_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node1/requeststatus_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteStatusTest_81F1B6DE437B6038-001/tempDir-001/node1/./requeststatus_shard1_replica_n1/data/]
[junit4] 2> 669766 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 669766 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 669767 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 669767 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 669776 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : request18325256181658011
[junit4] 2> 669776 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=request18325256181658011&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 669777 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@291169dd[requeststatus_shard1_replica_n1] main]
[junit4] 2> 669796 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 669796 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 669796 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 669843 INFO (searcherExecutor-583-thread-1-processing-x:requeststatus_shard1_replica_n1 r:core_node2 request18325256181658011 CREATE n:127.0.0.1:46416_solr s:shard1 c:requeststatus) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SolrCore [requeststatus_shard1_replica_n1] Registered new searcher Searcher@291169dd[requeststatus_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 669863 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581329503831982080
[junit4] 2> 669902 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 669902 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 669902 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46416/solr/requeststatus_shard1_replica_n1/
[junit4] 2> 669920 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 669920 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:46416/solr/requeststatus_shard1_replica_n1/ has no replicas
[junit4] 2> 669920 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 669937 INFO (zkCallback-1013-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 669937 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 669955 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46416/solr/requeststatus_shard1_replica_n1/ shard1
[junit4] 2> 669956 INFO (parallelCoreAdminExecutor-575-thread-2-processing-n:127.0.0.1:46416_solr request18325256181658011 CREATE) [n:127.0.0.1:46416_solr c:requeststatus s:shard1 r:core_node2 x:requeststatus_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 670176 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 670176 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 670220 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 670220 INFO (zkCallback-1013-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/requeststatus/state.json] for collection [requeststatus] has occurred - updating... (live nodes size: [2])
[junit4] 2> 670792 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : request18325256181658011
[junit4] 2> 670792 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=request18325256181658011&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 670811 INFO (OverseerThreadFactory-573-thread-2-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 671226 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671227 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 671239 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=request1&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671259 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=19
[junit4] 2> 671263 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671264 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=request1&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 671265 INFO (TEST-DeleteStatusTest.testProcessAndWaitDeletesAsyncIds-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProcessAndWaitDeletesAsyncIds
[junit4] 2> 671364 INFO (TEST-DeleteStatusTest.testDeletingNonExistentRequests-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeletingNonExistentRequests
[junit4] 2> 671367 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=foo&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671371 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=foo&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=3
[junit4] 2> 671372 INFO (TEST-DeleteStatusTest.testDeletingNonExistentRequests-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeletingNonExistentRequests
[junit4] 2> 671452 INFO (TEST-DeleteStatusTest.testDeleteStatusFlush-seed#[81F1B6DE437B6038]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteStatusFlush
[junit4] 2> 671452 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&replicationFactor=1&collection.configName=conf1&name=flush1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671461 INFO (qtp1433681445-2107) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&replicationFactor=1&collection.configName=conf1&name=flush1&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=8
[junit4] 2> 671483 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=7436c340-de46-4c84-a708-45c1c3e1194c&replicationFactor=1&collection.configName=conf1&name=flush2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671488 INFO (qtp1433681445-2108) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=7436c340-de46-4c84-a708-45c1c3e1194c&replicationFactor=1&collection.configName=conf1&name=flush2&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=5
[junit4] 2> 671520 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 671535 INFO (qtp1433681445-2109) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=14
[junit4] 2> 671555 INFO (OverseerCollectionConfigSetProcessor-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000001 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 671560 INFO (OverseerThreadFactory-573-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.CreateCollectionCmd Create collection flush1
[junit4] 2> 671564 INFO (OverseerThreadFactory-573-thread-4-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.CreateCollectionCmd Create collection flush2
[junit4] 2> 671780 INFO (OverseerStateUpdate-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"flush1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"flush1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44989/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 671829 INFO (OverseerStateUpdate-98833093194153989-127.0.0.1:46416_solr-n_0000000000) [n:127.0.0.1:46416_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"flush2",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"flush2_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:46416/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 672100 INFO (qtp1433681445-2104) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush1&version=2&replicaType=NRT&async=ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462&coreNodeName=core_node2&name=flush1_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=0
[junit4] 2> 672116 INFO (parallelCoreAdminExecutor-574-thread-1-processing-n:127.0.0.1:44989_solr ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462 CREATE) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush1&version=2&replicaType=NRT&async=ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462&coreNodeName=core_node2&name=flush1_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 672116 INFO (parallelCoreAdminExecutor-574-thread-1-processing-n:127.0.0.1:44989_solr ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462 CREATE) [n:127.0.0.1:44989_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 672117 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462
[junit4] 2> 672117 INFO (qtp1433681445-2106) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 672200 INFO (qtp1135172787-2098) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush2&version=2&replicaType=NRT&async=7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007&coreNodeName=core_node2&name=flush2_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin} status=0 QTime=69
[junit4] 2> 672215 INFO (parallelCoreAdminExecutor-575-thread-3-processing-n:127.0.0.1:46416_solr 7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007 CREATE) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&collection=flush2&version=2&replicaType=NRT&async=7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007&coreNodeName=core_node2&name=flush2_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&wt=javabin
[junit4] 2> 672252 INFO (qtp1135172787-2095) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007
[junit4] 2> 672252 INFO (qtp1135172787-2095) [n:127.0.0.1:46416_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 672326 INFO (zkCallback-1014-thread-1-processing-n:127.0.0.1:44989_solr) [n:127.0.0.1:44989_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 672395 INFO (zkCallback-1014-thread-2-processing-n:127.0.0.1:44989_solr) [n:127.0.0.1:44989_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush1/state.json] for collection [flush1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 672456 INFO (zkCallback-1013-thread-3-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
[junit4] 2> 672456 INFO (zkCallback-1013-thread-1-processing-n:127.0.0.1:46416_solr) [n:127.0.0.1:46416_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/flush2/state.json] for collection [flush2] has occurred - updating... (live nodes size: [2])
[junit4] 2> 672576 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 672577 INFO (qtp1433681445-2110) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 673132 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462
[junit4] 2> 673132 INFO (qtp1433681445-2103) [n:127.0.0.1:44989_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=ec36e34f-fa96-4f4b-be38-e00bf6cd474d8325261646028462&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 673330 INFO (qtp1135172787-2095) [n:127.0.0.1:46416_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 7436c340-de46-4c84-a708-45c1c3e1194c8325261694515007
[junit4] 2> 673330 INFO (qtp1135172787-2095) [n:127.0.0.1:46416_
[...truncated too long message...]
er Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=1280107932
[junit4] 2> 599682 INFO (coreCloseExecutor-575-thread-5) [n:127.0.0.1:43673_solr c:multicollection1 s:shard2 r:core_node4 x:multicollection1_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.multicollection1.shard2.replica_n3, tag=1774323606
[junit4] 2> 599682 INFO (coreCloseExecutor-575-thread-5) [n:127.0.0.1:43673_solr c:multicollection1 s:shard2 r:core_node4 x:multicollection1_shard2_replica_n3] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6735c671: rootName = solr_43673, domain = solr.core.multicollection1.shard2.replica_n3, service url = null, agent id = null] for registry solr.core.multicollection1.shard2.replica_n3 / com.codahale.metrics.MetricRegistry@1d894870
[junit4] 2> 599689 INFO (coreCloseExecutor-575-thread-6) [n:127.0.0.1:43673_solr c:multicollection2 s:shard2 r:core_node4 x:multicollection2_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.multicollection2.shard2.replica_n2, tag=1019532888
[junit4] 2> 599689 INFO (coreCloseExecutor-575-thread-6) [n:127.0.0.1:43673_solr c:multicollection2 s:shard2 r:core_node4 x:multicollection2_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7940b8f8: rootName = solr_43673, domain = solr.core.multicollection2.shard2.replica_n2, service url = null, agent id = null] for registry solr.core.multicollection2.shard2.replica_n2 / com.codahale.metrics.MetricRegistry@73c7accc
[junit4] 2> 599724 INFO (coreCloseExecutor-575-thread-7) [n:127.0.0.1:43673_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.foo.shard1.replica_n4, tag=729848066
[junit4] 2> 599724 INFO (coreCloseExecutor-575-thread-7) [n:127.0.0.1:43673_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@611720e9: rootName = solr_43673, domain = solr.core.foo.shard1.replica_n4, service url = null, agent id = null] for registry solr.core.foo.shard1.replica_n4 / com.codahale.metrics.MetricRegistry@65e624c2
[junit4] 2> 599747 INFO (coreCloseExecutor-575-thread-7) [n:127.0.0.1:43673_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=729848066
[junit4] 2> 599774 INFO (coreCloseExecutor-575-thread-1) [n:127.0.0.1:43673_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=573737818
[junit4] 2> 599775 INFO (coreCloseExecutor-575-thread-5) [n:127.0.0.1:43673_solr c:multicollection1 s:shard2 r:core_node4 x:multicollection1_shard2_replica_n3] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection1.shard2.leader, tag=1774323606
[junit4] 2> 599775 INFO (coreCloseExecutor-575-thread-6) [n:127.0.0.1:43673_solr c:multicollection2 s:shard2 r:core_node4 x:multicollection2_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection2.shard2.leader, tag=1019532888
[junit4] 2> 599775 INFO (coreCloseExecutor-575-thread-4) [n:127.0.0.1:43673_solr c:localShardsTestColl s:shard3 r:core_node15 x:localShardsTestColl_shard3_replica_n12] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard3.leader, tag=233617229
[junit4] 2> 600083 WARN (zkCallback-168-thread-1-processing-n:127.0.0.1:46997_solr) [n:127.0.0.1:46997_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 600084 INFO (jetty-closer-152-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4785523a{/solr,null,UNAVAILABLE}
[junit4] 2> 600085 INFO (zkCallback-167-thread-7-processing-n:127.0.0.1:43673_solr) [n:127.0.0.1:43673_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 600085 INFO (zkCallback-163-thread-4-processing-n:127.0.0.1:34477_solr) [n:127.0.0.1:34477_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 600151 INFO (jetty-closer-152-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98833817686376457-127.0.0.1:43673_solr-n_0000000000) closing
[junit4] 2> 600152 INFO (OverseerStateUpdate-98833817686376457-127.0.0.1:43673_solr-n_0000000000) [n:127.0.0.1:43673_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:43673_solr
[junit4] 2> 600158 INFO (zkCallback-167-thread-9-processing-n:127.0.0.1:43673_solr) [n:127.0.0.1:43673_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 600186 WARN (OverseerAutoScalingTriggerThread-98833817686376457-127.0.0.1:43673_solr-n_0000000000) [n:127.0.0.1:43673_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 600243 INFO (jetty-closer-152-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@12160018{/solr,null,UNAVAILABLE}
[junit4] 2> 601925 WARN (zkCallback-163-thread-4-processing-n:127.0.0.1:34477_solr) [n:127.0.0.1:34477_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 601934 INFO (jetty-closer-152-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3eddafb9{/solr,null,UNAVAILABLE}
[junit4] 2> 601957 ERROR (SUITE-CloudSolrClientTest-seed#[DE81599CA4335759]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 601957 INFO (SUITE-CloudSolrClientTest-seed#[DE81599CA4335759]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41259 41259
[junit4] 2> 602102 INFO (Thread-246) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41259 41259
[junit4] 2> 602103 WARN (Thread-246) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 39 /solr/collections/localShardsTestColl/state.json
[junit4] 2> 27 /solr/collections/foo/state.json
[junit4] 2> 18 /solr/collections/2nd_collection/state.json
[junit4] 2> 15 /solr/collections/multicollection1/state.json
[junit4] 2> 11 /solr/collections/multicollection2/state.json
[junit4] 2> 9 /solr/collections/collection1/state.json
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/overwrite/state.json
[junit4] 2> 2 /solr/collections/foo/leader_elect/shard1/election/98833817686376454-core_node3-n_0000000000
[junit4] 2> 2 /solr/collections/localShardsTestColl/leader_elect/shard2/election/98833817686376457-core_node9-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/98833817686376457-127.0.0.1:43673_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 9 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.impl.CloudSolrClientTest_DE81599CA4335759-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=MockRandom), multiDefault=PostingsFormat(name=Asserting), a_t=PostingsFormat(name=MockRandom), title_s=PostingsFormat(name=Asserting), intDefault=PostingsFormat(name=MockRandom), id=PostingsFormat(name=Direct), text=BlockTreeOrds(blocksize=128), timestamp=PostingsFormat(name=MockRandom)}, docValues:{_version_=DocValuesFormat(name=Direct), multiDefault=DocValuesFormat(name=Lucene70), title_s=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=1858, maxMBSortInHeap=7.33641652414445, sim=RandomSimilarity(queryNorm=false): {}, locale=en-PH, timezone=US/Hawaii
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=171383416,total=416808960
[junit4] 2> NOTE: All tests run in this JVM: [LBHttpSolrClientBuilderTest, PowerEvaluatorTest, TestFastInputStream, CloudSolrClientBuilderTest, TestJsonRecordReader, CommonParamsTest, TangentEvaluatorTest, NoOpResponseParserTest, FacetFieldTest, ExclusiveOrEvaluatorTest, OperationsTest, TestDocumentObjectBinder, QueryResponseTest, LessThanEqualToEvaluatorTest, HyperbolicSineEvaluatorTest, MultiplyEvaluatorTest, AddEvaluatorTest, SolrQueryTest, ArrayEvaluatorTest, UuidEvaluatorTest, CosineEvaluatorTest, TestSolrProperties, TestCollectionStateWatchers, MergeIndexesEmbeddedTest, SolrExampleStreamingTest, SolrExampleBinaryTest, SolrExampleEmbeddedTest, JettyWebappTest, ContentStreamTest, DocumentAnalysisResponseTest, SolrDocumentTest, SolrExceptionTest, TestUpdateRequestCodec, ClientUtilsTest, GetByIdTest, TestLBHttpSolrClient, TestPolicy, CloudSolrClientTest]
[junit4] Completed [90/145 (1!)] on J1 in 143.43s, 15 tests, 1 error <<< FAILURES!
[...truncated 46145 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2120 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2120/
5 tests failed.
FAILED: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration
Error Message:
expected:<2> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at __randomizedtesting.SeedInfo.seed([F06683C6E6B2D1AB:40078DEAC38D708E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:219)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3:5D3A18BABC22BBEE]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream(StreamExpressionTest.java:7686)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamExpressionTest
Error Message:
8 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamExpressionTest: 1) Thread[id=750, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=1016, name=zkCallback-248-thread-2-EventThread, state=WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 3) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 5) Thread[id=749, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=743, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamExpressionTest:
1) Thread[id=750, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=1016, name=zkCallback-248-thread-2-EventThread, state=WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
3) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
5) Thread[id=749, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=743, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.client.solrj.io.stream.StreamExpressionTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060) 3) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
3) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3]:0)
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testClassifyStream
Error Message:
--> https://127.0.0.1:39757/solr/collection1:Could not load collection from ZK: uknownCollection
Stack Trace:
java.io.IOException: --> https://127.0.0.1:39757/solr/collection1:Could not load collection from ZK: uknownCollection
at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3:4565F79BBC569F27]:0)
at org.apache.solr.client.solrj.io.stream.SolrStream.read(SolrStream.java:221)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.getTuples(StreamExpressionTest.java:8405)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.getIdToLabel(StreamExpressionTest.java:7706)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testClassifyStream(StreamExpressionTest.java:4936)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11659 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.ExecutePlanActionTest
[junit4] 2> 520916 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/init-core-data-001
[junit4] 2> 520917 WARN (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=21 numCloses=21
[junit4] 2> 520918 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 520919 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 520919 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001
[junit4] 2> 520920 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 520937 INFO (Thread-334) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 520937 INFO (Thread-334) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 520973 ERROR (Thread-334) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 521034 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:36268
[junit4] 2> 521325 INFO (jetty-launcher-220-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 521345 INFO (jetty-launcher-220-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 521396 INFO (jetty-launcher-220-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d73493f{/solr,null,AVAILABLE}
[junit4] 2> 521482 INFO (jetty-launcher-220-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@c4e579{/solr,null,AVAILABLE}
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6169bfe2{SSL,[ssl, http/1.1]}{127.0.0.1:33694}
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.e.j.s.Server Started @534238ms
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33694}
[junit4] 2> 521483 ERROR (jetty-launcher-220-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 521483 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-13T20:34:20.669Z
[junit4] 2> 521484 INFO (jetty-launcher-220-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@756dc6ec{SSL,[ssl, http/1.1]}{127.0.0.1:42412}
[junit4] 2> 521484 INFO (jetty-launcher-220-thread-2) [ ] o.e.j.s.Server Started @534239ms
[junit4] 2> 521484 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42412}
[junit4] 2> 521485 ERROR (jetty-launcher-220-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 521485 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 521485 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 521485 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 521485 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-13T20:34:20.671Z
[junit4] 2> 521555 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 521759 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 521771 INFO (jetty-launcher-220-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36268/solr
[junit4] 2> 521835 INFO (jetty-launcher-220-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36268/solr
[junit4] 2> 522974 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 522974 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:42412_solr
[junit4] 2> 522996 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.c.Overseer Overseer (id=98823494706069510-127.0.0.1:42412_solr-n_0000000000) starting
[junit4] 2> 523039 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42412_solr
[junit4] 2> 523040 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 523068 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 523083 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 523092 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 523097 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 523098 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33694_solr
[junit4] 2> 523190 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 523214 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 523239 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 523239 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 523239 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 523385 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 523401 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 523421 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33694_solr, 127.0.0.1:42412_solr]
[junit4] 2> 523685 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33694.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 523794 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33694.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 523794 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33694.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 523795 INFO (jetty-launcher-220-thread-1) [n:127.0.0.1:33694_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node1/.
[junit4] 2> 523940 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42412.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 524061 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42412.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 524062 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42412.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 524063 INFO (jetty-launcher-220-thread-2) [n:127.0.0.1:42412_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node2/.
[junit4] 2> 524441 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 524514 INFO (SUITE-ExecutePlanActionTest-seed#[F06683C6E6B2D1AB]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36268/solr ready
[junit4] 2> 524542 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:33694_solr, 127.0.0.1:42412_solr]
[junit4] 2> 524599 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testIntegration
[junit4] 2> 524628 DEBUG (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 524628 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 524686 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 524686 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 524687 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 524721 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f1771e16b0009, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 525239 INFO (qtp939522241-1219) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 525242 INFO (qtp939522241-1219) [n:127.0.0.1:42412_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36268/solr ready
[junit4] 2> 525294 INFO (qtp939522241-1213) [n:127.0.0.1:42412_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 525608 INFO (qtp1275125222-1228) [n:127.0.0.1:33694_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=1
[junit4] 2> 525623 DEBUG (qtp939522241-1219) [n:127.0.0.1:42412_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 525657 INFO (qtp939522241-1219) [n:127.0.0.1:42412_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=799
[junit4] 2> 525700 INFO (qtp939522241-1220) [n:127.0.0.1:42412_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=testIntegration&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 525700 DEBUG (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 525752 DEBUG (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 525752 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 525772 INFO (OverseerThreadFactory-428-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.CreateCollectionCmd Create collection testIntegration
[junit4] 2> 525772 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: [127.0.0.1:33694_solr, 127.0.0.1:42412_solr]
[junit4] 2> 525773 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 525773 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 525920 INFO (OverseerStateUpdate-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testIntegration",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testIntegration_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42412/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 526180 INFO (OverseerStateUpdate-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testIntegration",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testIntegration_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:33694/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 526381 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testIntegration_shard1_replica_n1&action=CREATE&numShards=1&collection=testIntegration&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 526382 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 526471 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testIntegration_shard1_replica_n2&action=CREATE&numShards=1&collection=testIntegration&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 526471 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 526665 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 526666 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 526666 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 526685 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 526775 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 527523 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 527549 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.s.IndexSchema [testIntegration_shard1_replica_n1] Schema name=minimal
[junit4] 2> 527552 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 527552 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testIntegration_shard1_replica_n1' using configuration from collection testIntegration, trusted=true
[junit4] 2> 527552 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42412.solr.core.testIntegration.shard1.replica_n1' (registry 'solr.core.testIntegration.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 527552 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 527552 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SolrCore [[testIntegration_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node2/testIntegration_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node2/./testIntegration_shard1_replica_n1/data/]
[junit4] 2> 527783 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 527783 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 527783 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 527786 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 527800 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 527800 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 527803 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b458484[testIntegration_shard1_replica_n1] main]
[junit4] 2> 527808 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 527808 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 527809 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 527836 INFO (searcherExecutor-433-thread-1-processing-n:127.0.0.1:42412_solr x:testIntegration_shard1_replica_n1 s:shard1 c:testIntegration r:core_node3) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SolrCore [testIntegration_shard1_replica_n1] Registered new searcher Searcher@2b458484[testIntegration_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 527836 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581175922514460672
[junit4] 2> 527857 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 527868 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.s.IndexSchema [testIntegration_shard1_replica_n2] Schema name=minimal
[junit4] 2> 527870 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 527870 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testIntegration_shard1_replica_n2' using configuration from collection testIntegration, trusted=true
[junit4] 2> 527871 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33694.solr.core.testIntegration.shard1.replica_n2' (registry 'solr.core.testIntegration.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 527871 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 527871 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.SolrCore [[testIntegration_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node1/testIntegration_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node1/./testIntegration_shard1_replica_n2/data/]
[junit4] 2> 528002 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528002 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528002 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528002 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528074 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 528074 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 528091 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 528091 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 528093 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@76b156[testIntegration_shard1_replica_n2] main]
[junit4] 2> 528094 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 528094 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 528095 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 528108 INFO (searcherExecutor-438-thread-1-processing-n:127.0.0.1:33694_solr x:testIntegration_shard1_replica_n2 s:shard1 c:testIntegration r:core_node4) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.SolrCore [testIntegration_shard1_replica_n2] Registered new searcher Searcher@76b156[testIntegration_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 528108 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581175922799673344
[junit4] 2> 528359 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 528359 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 528359 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:42412/solr/testIntegration_shard1_replica_n1/
[junit4] 2> 528360 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testIntegration_shard1_replica_n1 url=https://127.0.0.1:42412/solr START replicas=[https://127.0.0.1:33694/solr/testIntegration_shard1_replica_n2/] nUpdates=100
[junit4] 2> 528430 INFO (qtp1275125222-1229) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.S.Request [testIntegration_shard1_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=15
[junit4] 2> 528676 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.u.PeerSync PeerSync: core=testIntegration_shard1_replica_n1 url=https://127.0.0.1:42412/solr DONE. We have no versions. sync failed.
[junit4] 2> 528676 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 528676 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 528676 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 528678 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:42412/solr/testIntegration_shard1_replica_n1/ shard1
[junit4] 2> 528786 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 528786 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528786 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528786 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528786 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528859 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 528860 INFO (qtp939522241-1216) [n:127.0.0.1:42412_solr c:testIntegration s:shard1 r:core_node3 x:testIntegration_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testIntegration_shard1_replica_n1&action=CREATE&numShards=1&collection=testIntegration&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2478
[junit4] 2> 528969 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528969 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528969 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 528969 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 529137 INFO (qtp1275125222-1222) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testIntegration_shard1_replica_n2&action=CREATE&numShards=1&collection=testIntegration&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2666
[junit4] 2> 529153 INFO (qtp939522241-1220) [n:127.0.0.1:42412_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 529246 INFO (zkCallback-231-thread-1-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 529246 INFO (zkCallback-231-thread-2-processing-n:127.0.0.1:33694_solr) [n:127.0.0.1:33694_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 529246 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 529246 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [2])
[junit4] 2> 529786 DEBUG (ScheduledTrigger-426-thread-1) [n:127.0.0.1:42412_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: node_lost_trigger with currently live nodes: [127.0.0.1:42412_solr, 127.0.0.1:33694_solr]
[junit4] 2> 529799 INFO (OverseerCollectionConfigSetProcessor-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 530156 INFO (qtp939522241-1220) [n:127.0.0.1:42412_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=testIntegration&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=4456
[junit4] 2> 530204 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6169bfe2{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 530247 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=148966438
[junit4] 2> 530258 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 530262 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10ca4599: rootName = solr_33694, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3d5b630b
[junit4] 2> 530285 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 530285 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@323dbe0a: rootName = solr_33694, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@6ba90868
[junit4] 2> 530301 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 530301 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@23b40085: rootName = solr_33694, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5084b314
[junit4] 2> 530315 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 530316 INFO (coreCloseExecutor-443-thread-1) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.c.SolrCore [testIntegration_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@4302d7ce
[junit4] 2> 530316 INFO (coreCloseExecutor-443-thread-1) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testIntegration.shard1.replica_n2, tag=1124259790
[junit4] 2> 530335 INFO (coreCloseExecutor-443-thread-1) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4777fb21: rootName = solr_33694, domain = solr.core.testIntegration.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.testIntegration.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@6a88d54e
[junit4] 2> 530354 INFO (coreCloseExecutor-443-thread-1) [n:127.0.0.1:33694_solr c:testIntegration s:shard1 r:core_node4 x:testIntegration_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testIntegration.shard1.leader, tag=1124259790
[junit4] 2> 530407 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 530425 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@c4e579{/solr,null,UNAVAILABLE}
[junit4] 2> 530444 INFO (TEST-ExecutePlanActionTest.testIntegration-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testIntegration
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ExecutePlanActionTest -Dtests.method=testIntegration -Dtests.seed=F06683C6E6B2D1AB -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=hi -Dtests.timezone=America/Monterrey -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] FAILURE 5.92s J1 | ExecutePlanActionTest.testIntegration <<<
[junit4] > Throwable #1: java.lang.AssertionError: expected:<2> but was:<1>
[junit4] > at __randomizedtesting.SeedInfo.seed([F06683C6E6B2D1AB:40078DEAC38D708E]:0)
[junit4] > at org.apache.solr.cloud.autoscaling.ExecutePlanActionTest.testIntegration(ExecutePlanActionTest.java:219)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 530482 INFO (zkCallback-238-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 530498 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [1])
[junit4] 2> 530498 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testIntegration/state.json] for collection [testIntegration] has occurred - updating... (live nodes size: [1])
[junit4] 2> 530554 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testExecute
[junit4] 2> 530554 DEBUG (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 530555 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 530596 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 530619 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 530628 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- deleted /autoscaling/nodeLost/127.0.0.1:33694_solr
[junit4] 2> 530628 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 530644 DEBUG (OverseerAutoScalingTriggerThread-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 530645 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@82de2ce{/solr,null,AVAILABLE}
[junit4] 2> 530645 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2c183b09{SSL,[ssl, http/1.1]}{127.0.0.1:42025}
[junit4] 2> 530669 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.e.j.s.Server Started @543424ms
[junit4] 2> 530669 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=42025}
[junit4] 2> 530670 ERROR (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 530673 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 530691 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 530691 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 530691 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-13T20:34:29.877Z
[junit4] 2> 530730 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 530754 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36268/solr
[junit4] 2> 530884 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 530921 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 530934 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42025_solr
[junit4] 2> 530942 INFO (zkCallback-238-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 531014 INFO (zkCallback-248-thread-1-processing-n:127.0.0.1:42025_solr) [n:127.0.0.1:42025_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 530942 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 531430 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42025.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 531648 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42025.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 531649 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42025.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 531650 INFO (TEST-ExecutePlanActionTest.testExecute-seed#[F06683C6E6B2D1AB]) [n:127.0.0.1:42025_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node3/.
[junit4] 2> 532168 INFO (qtp1671960088-1305) [n:127.0.0.1:42025_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&maxShardsPerNode=1&name=testExecute&nrtReplicas=2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 532186 INFO (OverseerThreadFactory-428-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.CreateCollectionCmd Create collection testExecute
[junit4] 2> 532424 INFO (OverseerStateUpdate-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testExecute",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testExecute_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42025/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 532461 INFO (OverseerStateUpdate-98823494706069510-127.0.0.1:42412_solr-n_0000000000) [n:127.0.0.1:42412_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"testExecute",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"testExecute_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:42412/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 532681 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n2&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 532771 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=testExecute_shard1_replica_n1&action=CREATE&numShards=1&collection=testExecute&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 532788 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 532992 INFO (zkCallback-248-thread-1-processing-n:127.0.0.1:42025_solr) [n:127.0.0.1:42025_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
[junit4] 2> 532992 INFO (zkCallback-232-thread-2-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
[junit4] 2> 532992 INFO (zkCallback-232-thread-1-processing-n:127.0.0.1:42412_solr) [n:127.0.0.1:42412_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
[junit4] 2> 533008 INFO (zkCallback-248-thread-2-processing-n:127.0.0.1:42025_solr) [n:127.0.0.1:42025_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testExecute/state.json] for collection [testExecute] has occurred - updating... (live nodes size: [2])
[junit4] 2> 533839 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 533911 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.s.IndexSchema [testExecute_shard1_replica_n2] Schema name=minimal
[junit4] 2> 533913 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 533913 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n2' using configuration from collection testExecute, trusted=true
[junit4] 2> 533914 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42412.solr.core.testExecute.shard1.replica_n2' (registry 'solr.core.testExecute.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 533914 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 533914 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.c.SolrCore [[testExecute_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node2/testExecute_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node2/./testExecute_shard1_replica_n2/data/]
[junit4] 2> 533930 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 534001 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.s.IndexSchema [testExecute_shard1_replica_n1] Schema name=minimal
[junit4] 2> 534003 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 534003 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'testExecute_shard1_replica_n1' using configuration from collection testExecute, trusted=true
[junit4] 2> 534004 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_42025.solr.core.testExecute.shard1.replica_n1' (registry 'solr.core.testExecute.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@26c653a4
[junit4] 2> 534057 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 534057 INFO (qtp1671960088-1308) [n:127.0.0.1:42025_solr c:testExecute s:shard1 r:core_node3 x:testExecute_shard1_replica_n1] o.a.s.c.SolrCore [[testExecute_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node3/testExecute_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.autoscaling.ExecutePlanActionTest_F06683C6E6B2D1AB-001/tempDir-001/node3/./testExecute_shard1_replica_n1/data/]
[junit4] 2> 534203 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 534203 INFO (qtp939522241-1214) [n:127.0.0.1:42412_solr c:testExecute s:shard1 r:core_node4 x:testExecute_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 534204 INFO (qtp939522241-1214) [n:127.0.0
[...truncated too long message...]
-bit)/cpus=4,threads=5,free=156832400,total=414187520
[junit4] 2> NOTE: All tests run in this JVM: [DocumentAnalysisResponseTest, SolrParamTest, GraphExpressionTest, HyperbolicTangentEvaluatorTest, TestV1toV2ApiMapper, TestHash, StreamExpressionTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=StreamExpressionTest -Dtests.seed=E02D6DA3850E86B3 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=America/Puerto_Rico -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J2 | StreamExpressionTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 8 threads leaked from SUITE scope at org.apache.solr.client.solrj.io.stream.StreamExpressionTest:
[junit4] > 1) Thread[id=750, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 2) Thread[id=1016, name=zkCallback-248-thread-2-EventThread, state=WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
[junit4] > 3) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 5) Thread[id=749, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 7) Thread[id=743, name=Connection evictor, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=4125, name=zkCallback-248-thread-10, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 2) Thread[id=1015, name=zkCallback-248-thread-2-SendThread(127.0.0.1:39059), state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 3) Thread[id=1990, name=zkCallback-248-thread-8, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=4126, name=zkCallback-248-thread-11, state=TIMED_WAITING, group=TGRP-StreamExpressionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([E02D6DA3850E86B3]:0)
[junit4] Completed [128/145 (1!)] on J2 in 557.63s, 121 tests, 1 failure, 3 errors <<< FAILURES!
[...truncated 46069 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2119 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2119/
5 tests failed.
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<1> but was:<0>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<0>
at __randomizedtesting.SeedInfo.seed([1F0F4531096B9C4:1DF189DE6533C757]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:916)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:490)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.snapshots.TestSolrCloudSnapshots.testSnapshots
Error Message:
Could not load collection from ZK: SolrCloudSnapshots
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: SolrCloudSnapshots
at __randomizedtesting.SeedInfo.seed([1F0F4531096B9C4:37BC70CC65CFBB8B]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getDocCollection(CloudSolrClient.java:1227)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:484)
at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:448)
at org.apache.solr.core.snapshots.TestSolrCloudSnapshots.testSnapshots(TestSolrCloudSnapshots.java:158)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/SolrCloudSnapshots/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 47 more
FAILED: org.apache.solr.cloud.LeaderElectionContextKeyTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([1F0F4531096B9C4:89A4CB89BE6AD43C]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.LeaderElectionContextKeyTest.test(LeaderElectionContextKeyTest.java:88)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
expected:<1> but was:<2>
Stack Trace:
java.lang.AssertionError: expected:<1> but was:<2>
at __randomizedtesting.SeedInfo.seed([1F0F4531096B9C4:F8BD67FC2CE3F44E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit(ShardSplitTest.java:279)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
Error from server at https://127.0.0.1:39967/solr: Could not restore core
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:39967/solr: Could not restore core
at __randomizedtesting.SeedInfo.seed([1F0F4531096B9C4:89A4CB89BE6AD43C]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:275)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12246 lines...]
[junit4] Suite: org.apache.solr.core.snapshots.TestSolrCloudSnapshots
[junit4] 2> 2239500 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/init-core-data-001
[junit4] 2> 2239500 WARN (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=8 numCloses=8
[junit4] 2> 2239500 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2239534 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=None)
[junit4] 2> 2239535 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001
[junit4] 2> 2239535 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2239542 INFO (Thread-2099) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2239542 INFO (Thread-2099) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2239587 ERROR (Thread-2099) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2239651 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:41865
[junit4] 2> 2239705 INFO (jetty-launcher-1906-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2239725 INFO (jetty-launcher-1906-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2239741 INFO (jetty-launcher-1906-thread-4) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2239753 INFO (jetty-launcher-1906-thread-3) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 2239850 INFO (jetty-launcher-1906-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fd98a2d{/solr,null,AVAILABLE}
[junit4] 2> 2239851 INFO (jetty-launcher-1906-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@c151975{HTTP/1.1,[http/1.1]}{127.0.0.1:37712}
[junit4] 2> 2239851 INFO (jetty-launcher-1906-thread-1) [ ] o.e.j.s.Server Started @2251930ms
[junit4] 2> 2239851 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37712}
[junit4] 2> 2239852 ERROR (jetty-launcher-1906-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2239852 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2239852 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2239852 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2239852 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-12T12:29:37.752Z
[junit4] 2> 2239879 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2240199 INFO (jetty-launcher-1906-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4cf6c56f{/solr,null,AVAILABLE}
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@154a12e9{HTTP/1.1,[http/1.1]}{127.0.0.1:39391}
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.e.j.s.Server Started @2252278ms
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39391}
[junit4] 2> 2240200 ERROR (jetty-launcher-1906-thread-4) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2240200 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-12T12:29:38.100Z
[junit4] 2> 2240284 INFO (jetty-launcher-1906-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35cc33e4{/solr,null,AVAILABLE}
[junit4] 2> 2240298 INFO (jetty-launcher-1906-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41865/solr
[junit4] 2> 2240378 INFO (jetty-launcher-1906-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@30bcbd42{HTTP/1.1,[http/1.1]}{127.0.0.1:41148}
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.e.j.s.Server Started @2252513ms
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41148}
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2240435 ERROR (jetty-launcher-1906-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2240435 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-12T12:29:38.335Z
[junit4] 2> 2240406 INFO (jetty-launcher-1906-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4e0a825f{/solr,null,AVAILABLE}
[junit4] 2> 2240451 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f108fc13e0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2240471 INFO (jetty-launcher-1906-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1d5bb0c1{HTTP/1.1,[http/1.1]}{127.0.0.1:44960}
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.e.j.s.Server Started @2252550ms
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44960}
[junit4] 2> 2240472 ERROR (jetty-launcher-1906-thread-3) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 2240472 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-12T12:29:38.372Z
[junit4] 2> 2240524 INFO (jetty-launcher-1906-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41865/solr
[junit4] 2> 2240617 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2240690 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f108fc13e0004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2240764 INFO (jetty-launcher-1906-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41865/solr
[junit4] 2> 2240783 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2240846 INFO (jetty-launcher-1906-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:41865/solr
[junit4] 2> 2241142 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2241252 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37712_solr
[junit4] 2> 2241253 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.c.Overseer Overseer (id=98815926433873925-127.0.0.1:37712_solr-n_0000000000) starting
[junit4] 2> 2241324 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2241357 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37712_solr
[junit4] 2> 2241357 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2241358 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41148_solr
[junit4] 2> 2241358 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44960_solr
[junit4] 2> 2241378 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2241381 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2241397 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2241418 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2241430 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (3)
[junit4] 2> 2241434 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 2241635 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37712.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2241687 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37712.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2241688 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37712.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2241688 INFO (jetty-launcher-1906-thread-1) [n:127.0.0.1:37712_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node1/.
[junit4] 2> 2242015 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 2242018 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44960.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242091 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44960.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242092 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44960.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242125 INFO (jetty-launcher-1906-thread-3) [n:127.0.0.1:44960_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node4/.
[junit4] 2> 2242135 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41148.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242162 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2242163 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39391_solr
[junit4] 2> 2242164 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2242164 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2242198 INFO (zkCallback-1915-thread-2-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2242226 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 2242227 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41148.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242228 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41148.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2242228 INFO (jetty-launcher-1906-thread-2) [n:127.0.0.1:41148_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node2/.
[junit4] 2> 2242984 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39391.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2243129 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39391.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2243129 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39391.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2243130 INFO (jetty-launcher-1906-thread-4) [n:127.0.0.1:39391_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node3/.
[junit4] 2> 2243649 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 2243649 INFO (SUITE-TestSolrCloudSnapshots-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:41865/solr ready
[junit4] 2> 2243802 INFO (TEST-TestSolrCloudSnapshots.testSnapshots-seed#[1F0F4531096B9C4]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testSnapshots
[junit4] 2> 2243849 INFO (qtp1301533120-8728) [n:127.0.0.1:37712_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf1&name=SolrCloudSnapshots&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2243994 INFO (OverseerThreadFactory-2938-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.CreateCollectionCmd Create collection SolrCloudSnapshots
[junit4] 2> 2244583 INFO (OverseerStateUpdate-98815926433873925-127.0.0.1:37712_solr-n_0000000000) [n:127.0.0.1:37712_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"SolrCloudSnapshots",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"SolrCloudSnapshots_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:41148/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2244585 INFO (OverseerStateUpdate-98815926433873925-127.0.0.1:37712_solr-n_0000000000) [n:127.0.0.1:37712_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"SolrCloudSnapshots",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"SolrCloudSnapshots_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:44960/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2244586 INFO (OverseerStateUpdate-98815926433873925-127.0.0.1:37712_solr-n_0000000000) [n:127.0.0.1:37712_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"SolrCloudSnapshots",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"SolrCloudSnapshots_shard2_replica_n4",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:37712/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2244657 INFO (OverseerStateUpdate-98815926433873925-127.0.0.1:37712_solr-n_0000000000) [n:127.0.0.1:37712_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"SolrCloudSnapshots",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"SolrCloudSnapshots_shard2_replica_n6",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39391/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 2244990 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n1&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2244990 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2245050 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n4&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2245100 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2245158 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n2&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2245159 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2245159 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n6&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2245159 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2245863 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245867 INFO (zkCallback-1915-thread-2-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245867 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245867 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245867 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245879 INFO (zkCallback-1920-thread-2-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245920 INFO (zkCallback-1930-thread-2-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2245920 INFO (zkCallback-1929-thread-2-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2246438 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2246547 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2246558 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2246563 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.s.IndexSchema [SolrCloudSnapshots_shard1_replica_n1] Schema name=minimal
[junit4] 2> 2246766 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2246766 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'SolrCloudSnapshots_shard1_replica_n1' using configuration from collection SolrCloudSnapshots, trusted=true
[junit4] 2> 2246766 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41148.solr.core.SolrCloudSnapshots.shard1.replica_n1' (registry 'solr.core.SolrCloudSnapshots.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2246766 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2246767 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.SolrCore [[SolrCloudSnapshots_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node2/SolrCloudSnapshots_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node2/./SolrCloudSnapshots_shard1_replica_n1/data/]
[junit4] 2> 2246782 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 2246795 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.s.IndexSchema [SolrCloudSnapshots_shard2_replica_n6] Schema name=minimal
[junit4] 2> 2246797 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2246797 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.CoreContainer Creating SolrCore 'SolrCloudSnapshots_shard2_replica_n6' using configuration from collection SolrCloudSnapshots, trusted=true
[junit4] 2> 2246832 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.s.IndexSchema [SolrCloudSnapshots_shard1_replica_n2] Schema name=minimal
[junit4] 2> 2246834 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2246834 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'SolrCloudSnapshots_shard1_replica_n2' using configuration from collection SolrCloudSnapshots, trusted=true
[junit4] 2> 2246834 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39391.solr.core.SolrCloudSnapshots.shard2.replica_n6' (registry 'solr.core.SolrCloudSnapshots.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2246834 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2246839 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.s.IndexSchema [SolrCloudSnapshots_shard2_replica_n4] Schema name=minimal
[junit4] 2> 2246841 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 2246841 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.CoreContainer Creating SolrCore 'SolrCloudSnapshots_shard2_replica_n4' using configuration from collection SolrCloudSnapshots, trusted=true
[junit4] 2> 2246856 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37712.solr.core.SolrCloudSnapshots.shard2.replica_n4' (registry 'solr.core.SolrCloudSnapshots.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2246856 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2246856 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SolrCore [[SolrCloudSnapshots_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node1/SolrCloudSnapshots_shard2_replica_n4], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node1/./SolrCloudSnapshots_shard2_replica_n4/data/]
[junit4] 2> 2246867 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44960.solr.core.SolrCloudSnapshots.shard1.replica_n2' (registry 'solr.core.SolrCloudSnapshots.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7b9f5399
[junit4] 2> 2246867 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2246867 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SolrCore [[SolrCloudSnapshots_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node4/SolrCloudSnapshots_shard1_replica_n2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node4/./SolrCloudSnapshots_shard1_replica_n2/data/]
[junit4] 2> 2246924 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.SolrCore [[SolrCloudSnapshots_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node3/SolrCloudSnapshots_shard2_replica_n6], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.core.snapshots.TestSolrCloudSnapshots_1F0F4531096B9C4-001/tempDir-001/node3/./SolrCloudSnapshots_shard2_replica_n6/data/]
[junit4] 2> 2247655 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2247655 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2247656 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2247656 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2247658 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@11e11cf6[SolrCloudSnapshots_shard1_replica_n2] main]
[junit4] 2> 2247691 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2247692 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2247692 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2247703 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2247703 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2247704 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2247704 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2247706 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b124c01[SolrCloudSnapshots_shard1_replica_n1] main]
[junit4] 2> 2247711 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581054831478439936
[junit4] 2> 2247801 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2247801 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2247802 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2247802 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581054831573860352
[junit4] 2> 2247824 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 2247858 INFO (searcherExecutor-2947-thread-1-processing-n:127.0.0.1:41148_solr x:SolrCloudSnapshots_shard1_replica_n1 s:shard1 c:SolrCloudSnapshots r:core_node3) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.SolrCore [SolrCloudSnapshots_shard1_replica_n1] Registered new searcher Searcher@6b124c01[SolrCloudSnapshots_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2247859 INFO (searcherExecutor-2949-thread-1-processing-n:127.0.0.1:44960_solr x:SolrCloudSnapshots_shard1_replica_n2 s:shard1 c:SolrCloudSnapshots r:core_node5) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SolrCore [SolrCloudSnapshots_shard1_replica_n2] Registered new searcher Searcher@11e11cf6[SolrCloudSnapshots_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2247886 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2247886 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2247887 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2247887 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2247906 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a5c537f[SolrCloudSnapshots_shard2_replica_n4] main]
[junit4] 2> 2247923 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2247923 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2247923 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2247943 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247943 INFO (zkCallback-1915-thread-2-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247944 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2247944 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2247947 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247947 INFO (zkCallback-1929-thread-2-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247947 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247947 INFO (zkCallback-1930-thread-2-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247960 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2247960 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2247961 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.s.SolrIndexSearcher Opening [Searcher@70b4504a[SolrCloudSnapshots_shard2_replica_n6] main]
[junit4] 2> 2247962 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 2247963 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 2247996 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581054831777284096
[junit4] 2> 2247998 INFO (zkCallback-1920-thread-2-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2247998 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248033 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2248034 INFO (qtp636268109-8752) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1581054831817129984
[junit4] 2> 2248041 INFO (searcherExecutor-2950-thread-1-processing-n:127.0.0.1:37712_solr x:SolrCloudSnapshots_shard2_replica_n4 s:shard2 c:SolrCloudSnapshots r:core_node7) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SolrCore [SolrCloudSnapshots_shard2_replica_n4] Registered new searcher Searcher@1a5c537f[SolrCloudSnapshots_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2248055 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2248055 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2248055 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37712/solr/SolrCloudSnapshots_shard2_replica_n4/
[junit4] 2> 2248055 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=SolrCloudSnapshots_shard2_replica_n4 url=http://127.0.0.1:37712/solr START replicas=[http://127.0.0.1:39391/solr/SolrCloudSnapshots_shard2_replica_n6/] nUpdates=100
[junit4] 2> 2248078 INFO (searcherExecutor-2948-thread-1-processing-n:127.0.0.1:39391_solr x:SolrCloudSnapshots_shard2_replica_n6 s:shard2 c:SolrCloudSnapshots r:core_node8) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.SolrCore [SolrCloudSnapshots_shard2_replica_n6] Registered new searcher Searcher@70b4504a[SolrCloudSnapshots_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2248079 INFO (qtp636268109-8750) [n:127.0.0.1:39391_solr c:SolrCloudSnapshots s:shard2 r:core_node8 x:SolrCloudSnapshots_shard2_replica_n6] o.a.s.c.S.Request [SolrCloudSnapshots_shard2_replica_n6] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2248187 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248188 INFO (zkCallback-1915-thread-3-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248188 INFO (zkCallback-1930-thread-2-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248188 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248199 INFO (zkCallback-1920-thread-2-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248199 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248203 INFO (zkCallback-1929-thread-2-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248203 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248333 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2248333 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2248333 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44960/solr/SolrCloudSnapshots_shard1_replica_n2/
[junit4] 2> 2248334 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=SolrCloudSnapshots_shard1_replica_n2 url=http://127.0.0.1:44960/solr START replicas=[http://127.0.0.1:41148/solr/SolrCloudSnapshots_shard1_replica_n1/] nUpdates=100
[junit4] 2> 2248387 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.u.PeerSync PeerSync: core=SolrCloudSnapshots_shard2_replica_n4 url=http://127.0.0.1:37712/solr DONE. We have no versions. sync failed.
[junit4] 2> 2248460 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2248460 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2248460 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2248460 INFO (qtp1372912206-8738) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.c.S.Request [SolrCloudSnapshots_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=86
[junit4] 2> 2248463 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37712/solr/SolrCloudSnapshots_shard2_replica_n4/ shard2
[junit4] 2> 2248639 INFO (zkCallback-1920-thread-2-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248639 INFO (zkCallback-1915-thread-3-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248639 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248639 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248642 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2248642 INFO (zkCallback-1930-thread-2-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248642 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248642 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248642 INFO (zkCallback-1929-thread-2-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248675 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=SolrCloudSnapshots_shard1_replica_n2 url=http://127.0.0.1:44960/solr DONE. We have no versions. sync failed.
[junit4] 2> 2248675 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 2248675 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 2248675 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2248677 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44960/solr/SolrCloudSnapshots_shard1_replica_n2/ shard1
[junit4] 2> 2248695 INFO (qtp1301533120-8726) [n:127.0.0.1:37712_solr c:SolrCloudSnapshots s:shard2 r:core_node7 x:SolrCloudSnapshots_shard2_replica_n4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard2_replica_n4&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3645
[junit4] 2> 2248785 INFO (zkCallback-1920-thread-2-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248785 INFO (zkCallback-1920-thread-1-processing-n:127.0.0.1:39391_solr) [n:127.0.0.1:39391_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248785 INFO (zkCallback-1915-thread-1-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248786 INFO (zkCallback-1915-thread-3-processing-n:127.0.0.1:37712_solr) [n:127.0.0.1:37712_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248788 INFO (zkCallback-1929-thread-2-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248788 INFO (zkCallback-1929-thread-1-processing-n:127.0.0.1:41148_solr) [n:127.0.0.1:41148_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248788 INFO (zkCallback-1930-thread-1-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248789 INFO (zkCallback-1930-thread-2-processing-n:127.0.0.1:44960_solr) [n:127.0.0.1:44960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/SolrCloudSnapshots/state.json] for collection [SolrCloudSnapshots] has occurred - updating... (live nodes size: [4])
[junit4] 2> 2248841 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2248842 INFO (qtp1167565639-8764) [n:127.0.0.1:44960_solr c:SolrCloudSnapshots s:shard1 r:core_node5 x:SolrCloudSnapshots_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n2&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3683
[junit4] 2> 2248916 INFO (qtp1372912206-8737) [n:127.0.0.1:41148_solr c:SolrCloudSnapshots s:shard1 r:core_node3 x:SolrCloudSnapshots_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf1&newCollection=true&name=SolrCloudSnapshots_shard1_replica_n1&action=CREATE&numShards=2&collection=SolrCloudSnapshots&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3925
[junit4] 2> 2249029 IN
[...truncated too long message...]
1:44110_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 5210378 INFO (jetty-closer-5508-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 5210396 INFO (jetty-closer-5508-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98816108327534598-127.0.0.1:44110_solr-n_0000000000) closing
[junit4] 2> 5210397 INFO (OverseerStateUpdate-98816108327534598-127.0.0.1:44110_solr-n_0000000000) [n:127.0.0.1:44110_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44110_solr
[junit4] 2> 5210417 WARN (OverseerAutoScalingTriggerThread-98816108327534598-127.0.0.1:44110_solr-n_0000000000) [n:127.0.0.1:44110_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 5211880 WARN (zkCallback-5576-thread-2-processing-n:127.0.0.1:37566_solr) [n:127.0.0.1:37566_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 5211881 INFO (jetty-closer-5508-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7773e785{/solr,null,UNAVAILABLE}
[junit4] 2> 5211934 WARN (zkCallback-5520-thread-7-processing-n:127.0.0.1:44110_solr) [n:127.0.0.1:44110_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 5211935 INFO (jetty-closer-5508-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@55ba79cb{/solr,null,UNAVAILABLE}
[junit4] 2> 5211935 ERROR (SUITE-TestTlogReplica-seed#[1F0F4531096B9C4]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 5211936 INFO (SUITE-TestTlogReplica-seed#[1F0F4531096B9C4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35567 35567
[junit4] 2> 5212099 INFO (Thread-4947) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35567 35567
[junit4] 2> 5212100 WARN (Thread-4947) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/configs/conf
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 60 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 39 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 31 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 31 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 23 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 22 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 8 /solr/overseer_elect/election/98816108327534598-127.0.0.1:44110_solr-n_0000000000
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98816108327534598-core_node4-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98816108327534596-core_node16-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/collections
[junit4] 2> 3 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_1F0F4531096B9C4-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {foo=PostingsFormat(name=Asserting), title_s=PostingsFormat(name=Asserting), foo_s=PostingsFormat(name=Asserting), id=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Lucene70), inplace_updatable_int=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=988, maxMBSortInHeap=5.952285218223172, sim=RandomSimilarity(queryNorm=false): {}, locale=sr-Latn, timezone=America/Tegucigalpa
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=132003576,total=523763712
[junit4] 2> NOTE: All tests run in this JVM: [TestNRTOpen, TestJavabinTupleStreamParser, ForceLeaderTest, TestHttpShardHandlerFactory, TestIndexSearcher, TestNumericTerms32, QueryEqualityTest, TestRestManager, TestConfigSetImmutable, FullSolrCloudDistribCmdsTest, TestReloadDeadlock, TestChildDocTransformer, TestReversedWildcardFilterFactory, OverseerTest, RecoveryZkTest, StressHdfsTest, SuggesterFSTTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, DistributedQueueTest, RulesTest, ResponseLogComponentTest, TlogReplayBufferedWhileIndexingTest, TestRestoreCore, MinimalSchemaTest, TestLFUCache, TestCloudInspectUtil, TestConfigSetsAPI, TestSlowCompositeReaderWrapper, HLLSerializationTest, AnalyticsMergeStrategyTest, AtomicUpdatesTest, MultiTermTest, TestHashQParserPlugin, TestTrie, VersionInfoTest, PathHierarchyTokenizerFactoryTest, TestFreeTextSuggestions, TestSmileRequest, TestRawTransformer, SuggesterTest, TestSolrFieldCacheBean, TestQueryUtils, SignatureUpdateProcessorFactoryTest, TestJmxIntegration, BadCopyFieldTest, TestSimpleTextCodec, TestSubQueryTransformerDistrib, ClassificationUpdateProcessorTest, TestMacroExpander, TestLeaderElectionWithEmptyReplica, MissingSegmentRecoveryTest, BasicDistributedZk2Test, TestFieldResource, TestDFISimilarityFactory, ResponseHeaderTest, TestHdfsBackupRestoreCore, AutoScalingHandlerTest, SimpleCollectionCreateDeleteTest, FastVectorHighlighterTest, TestLMJelinekMercerSimilarityFactory, TestAuthorizationFramework, ReturnFieldsTest, SolrJmxReporterCloudTest, TestTrieFacet, TimeZoneUtilsTest, LargeFieldTest, StatsComponentTest, HdfsLockFactoryTest, TestTolerantSearch, ShowFileRequestHandlerTest, DeleteReplicaTest, TestCoreAdminApis, MetricUtilsTest, DirectoryFactoryTest, SecurityConfHandlerTest, SortByFunctionTest, TestCodecSupport, HdfsAutoAddReplicasIntegrationTest, SortSpecParsingTest, TestMaxTokenLenTokenizer, URLClassifyProcessorTest, TestHalfAndHalfDocValues, TestDistributedMissingSort, NodeLostTriggerTest, PreAnalyzedFieldTest, SolrMetricsIntegrationTest, TestQuerySenderListener, TestDownShardTolerantSearch, SearchHandlerTest, SolrCloudReportersTest, TestSolrCloudSnapshots, TestEmbeddedSolrServerConstructors, DistributedFacetPivotSmallAdvancedTest, TestSolrCloudWithHadoopAuthPlugin, RemoteQueryErrorTest, TestSchemaNameResource, SolrCoreCheckLockOnStartupTest, DocumentBuilderTest, MoveReplicaTest, SolrXmlInZkTest, TestSolrDeletionPolicy2, CopyFieldTest, TestLegacyNumericUtils, BitVectorTest, DistributedQueryComponentCustomSortTest, FacetPivotSmallTest, TestDFRSimilarityFactory, TestSolrCoreProperties, TestCorePropertiesReload, EnumFieldTest, TestSha256AuthenticationProvider, JavabinLoaderTest, CleanupOldIndexTest, NotRequiredUniqueKeyTest, SpellPossibilityIteratorTest, TestSchemaVersionResource, TestPseudoReturnFields, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, TestReplicationHandler, LeaderElectionTest, TestZkChroot, TestDistributedSearch, AutoCommitTest, TestRecovery, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressReorder, TestReload, HardAutoCommitTest, DistributedTermsComponentTest, SimpleFacetsTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestFunctionQuery, DirectUpdateHandlerTest, HighlighterTest, SoftAutoCommitTest, TestStressLucene, SuggesterWFSTTest, PolyFieldTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, SolrInfoBeanTest, DebugComponentTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, PrimitiveFieldTypeTest, TestOmitPositions, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestCSVResponseWriter, MBeansHandlerTest, TestComponentsName, SearchHandlerTest, SampleTest, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, TestPostingsSolrHighlighter, TestPhraseSuggestions, TestIBSimilarityFactory, OpenExchangeRatesOrgProviderTest, ChaosMonkeyNothingIsSafeTest, AsyncCallRequestStatusResponseTest, CdcrReplicationDistributedZkTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DistributedVersionInfoTest, MoveReplicaHDFSFailoverTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverTest, SolrCloudExampleTest, TestCryptoKeys, TestExclusionRuleCollectionAccess, TestLeaderElectionZkExpiry, TestLocalFSCloudBackupRestore, TestOnReconnectListenerSupport, TestPullReplica, TestReplicaProperties, TestShortCircuitedRequests, TestSolrCloudWithKerberosAlt, TestStressLiveNodes, TestTlogReplica]
[junit4] Completed [566/745 (5!)] on J2 in 197.43s, 13 tests, 1 failure <<< FAILURES!
[...truncated 47544 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2118 - Still Unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2118/
8 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZkTest: 1) Thread[id=21591, name=zkCallback-3203-thread-1, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.BasicDistributedZkTest:
1) Thread[id=21591, name=zkCallback-3203-thread-1, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.BasicDistributedZkTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=21591, name=zkCallback-3203-thread-1, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=21591, name=zkCallback-3203-thread-1, state=TIMED_WAITING, group=TGRP-BasicDistributedZkTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A]:0)
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
expected:<COMPLETED> but was:<RUNNING>
Stack Trace:
java.lang.AssertionError: expected:<COMPLETED> but was:<RUNNING>
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A:DE46AED5D4BE54B2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:231)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ZkSolrClientTest.testMultipleWatchesAsync
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A:3EA442ADEFA638D4]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.ZkSolrClientTest.testMultipleWatchesAsync(ZkSolrClientTest.java:257)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple
Error Message:
Could not load collection from ZK: testSimple1
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: testSimple1
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A:6EA1B5F15DB1ED9B]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.getReplacedSharedFsReplicas(AutoAddReplicasIntegrationTest.java:164)
at org.apache.solr.cloud.autoscaling.AutoAddReplicasIntegrationTest.testSimple(AutoAddReplicasIntegrationTest.java:85)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testSimple1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 44 more
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeAdded/127.0.0.1:42635_solr wasn't created
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeAdded/127.0.0.1:42635_solr wasn't created
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A:4EA819037477F4A5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:909)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestSolrConfigHandlerCloud.test
Error Message:
{ "responseHeader":{ "status":500, "QTime":30102}, "errorMessages":["4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]\n"], "WARNING":"This response format is experimental. It is likely to change in the future.", "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","org.apache.solr.common.SolrException"], "msg":"4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]", "trace":"org.apache.solr.common.SolrException: 4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2484)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:720)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n", "code":500}}
Stack Trace:
java.lang.AssertionError: {
"responseHeader":{
"status":500,
"QTime":30102},
"errorMessages":["4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]\n"],
"WARNING":"This response format is experimental. It is likely to change in the future.",
"error":{
"metadata":[
"error-class","org.apache.solr.common.SolrException",
"root-error-class","org.apache.solr.common.SolrException"],
"msg":"4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]",
"trace":"org.apache.solr.common.SolrException: 4 out of 5 the property overlay to be of version 8 within 30 seconds! Failed cores: [https://127.0.0.1:53315/collection1_shard2_replica_n41/, https://127.0.0.1:37929/collection1_shard2_replica_n45/, https://127.0.0.1:45579/collection1_shard1_replica_n43/, https://127.0.0.1:45858/collection1_shard1_replica_n47/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2484)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:720)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n",
"code":500}}
at __randomizedtesting.SeedInfo.seed([5612910F7A42394A:DE46AED5D4BE54B2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.core.TestSolrConfigHandler.runConfigCommand(TestSolrConfigHandler.java:185)
at org.apache.solr.core.TestSolrConfigHandler.reqhandlertests(TestSolrConfigHandler.java:318)
at org.apache.solr.handler.TestSolrConfigHandlerCloud.testReqHandlerAPIs(TestSolrConfigHandlerCloud.java:97)
at org.apache.solr.handler.TestSolrConfigHandlerCloud.test(TestSolrConfigHandlerCloud.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure
Error Message:
Did not see a fully active cluster after 30 seconds
Stack Trace:
java.lang.AssertionError: Did not see a fully active cluster after 30 seconds
at __randomizedtesting.SeedInfo.seed([AD638E0B3870CED8:25552C58E0DF26CA]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.common.cloud.TestCollectionStateWatchers.testWaitForStateWatcherIsRetainedOnPredicateFailure(TestCollectionStateWatchers.java:250)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11895 lines...]
[junit4] Suite: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest
[junit4] 2> 1798805 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/init-core-data-001
[junit4] 2> 1798805 WARN (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
[junit4] 2> 1798805 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1798832 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 1798833 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/tempDir-001
[junit4] 2> 1798833 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1798851 INFO (Thread-956) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1798851 INFO (Thread-956) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1798971 ERROR (Thread-956) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1799066 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:46826
[junit4] 2> 1801191 INFO (jetty-launcher-586-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1801215 INFO (jetty-launcher-586-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1801288 INFO (jetty-launcher-586-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4a36866c{/solr,null,AVAILABLE}
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@712592f0{HTTP/1.1,[http/1.1]}{127.0.0.1:51836}
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.e.j.s.Server Started @1819311ms
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=51836}
[junit4] 2> 1801289 ERROR (jetty-launcher-586-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1801289 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-11T06:01:32.743Z
[junit4] 2> 1801515 INFO (jetty-launcher-586-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@135e9c97{/solr,null,AVAILABLE}
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@31df004f{HTTP/1.1,[http/1.1]}{127.0.0.1:59440}
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.e.j.s.Server Started @1819538ms
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=59440}
[junit4] 2> 1801516 ERROR (jetty-launcher-586-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1801516 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-11T06:01:32.970Z
[junit4] 2> 1801806 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1801810 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1801826 INFO (jetty-launcher-586-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46826/solr
[junit4] 2> 1801845 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f0a060fc10001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1802079 INFO (jetty-launcher-586-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46826/solr
[junit4] 2> 1803561 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1803577 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:59440_solr
[junit4] 2> 1803577 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.Overseer Overseer (id=98808737975828486-127.0.0.1:59440_solr-n_0000000000) starting
[junit4] 2> 1803581 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59440_solr
[junit4] 2> 1803608 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1804343 INFO (OverseerStateUpdate-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1804343 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 1
[junit4] 2> 1804344 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:59440_solr]
[junit4] 2> 1804345 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion -1
[junit4] 2> 1804345 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 1
[junit4] 2> 1804379 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1804379 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 1, lastZnodeVersion 1
[junit4] 2> 1804380 DEBUG (ScheduledTrigger-1787-thread-1) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:59440_solr]
[junit4] 2> 1804892 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1804910 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1804911 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51836_solr
[junit4] 2> 1805127 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1805332 INFO (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1805438 DEBUG (ScheduledTrigger-1787-thread-1) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr]
[junit4] 2> 1805621 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59440.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1805804 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59440.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1805805 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_59440.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1805873 INFO (jetty-launcher-586-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/tempDir-001/node2/.
[junit4] 2> 1806457 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51836.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1806535 DEBUG (ScheduledTrigger-1787-thread-2) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr]
[junit4] 2> 1806574 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51836.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1806574 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_51836.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1806586 INFO (jetty-launcher-586-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/tempDir-001/node1/.
[junit4] 2> 1807163 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1807164 INFO (SUITE-TriggerIntegrationTest-seed#[5612910F7A42394A]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46826/solr ready
[junit4] 2> 1807376 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testEventFromRestoredState
[junit4] 2> 1807376 DEBUG (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 2
[junit4] 2> 1807376 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.a.TriggerIntegrationTest /autoscaling.json reset, new znode version 2
[junit4] 2> 1807388 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 2
[junit4] 2> 1807393 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1807409 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeAdded markers
[junit4] 2> 1807409 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 2, lastZnodeVersion 2
[junit4] 2> 1807924 INFO (qtp1601938787-4293) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1807924 INFO (qtp1601938787-4293) [n:127.0.0.1:59440_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46826/solr ready
[junit4] 2> 1808016 INFO (qtp99498140-4284) [n:127.0.0.1:51836_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1808017 INFO (qtp1601938787-4291) [n:127.0.0.1:59440_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/metrics params={prefix=CORE.coreName&wt=javabin&version=2&group=solr.core} status=0 QTime=0
[junit4] 2> 1808017 DEBUG (qtp1601938787-4293) [n:127.0.0.1:59440_solr ] o.a.s.c.a.AutoScalingHandler Verified autoscaling configuration
[junit4] 2> 1808020 INFO (qtp1601938787-4293) [n:127.0.0.1:59440_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/cluster/autoscaling params={wt=javabin&version=2} status=0 QTime=378
[junit4] 2> 1808020 DEBUG (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 3
[junit4] 2> 1808079 DEBUG (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:59440_solr, 127.0.0.1:51836_solr]
[junit4] 2> 1808079 DEBUG (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 1808090 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 3
[junit4] 2> 1808091 INFO (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 1808093 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread -- clean old nodeLost markers
[junit4] 2> 1808093 DEBUG (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 3, lastZnodeVersion 3
[junit4] 2> 1808111 INFO (qtp99498140-4282) [n:127.0.0.1:51836_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :overseerstatus with params action=OVERSEERSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1808094 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1808111 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr]
[junit4] 2> 1808132 INFO (qtp99498140-4282) [n:127.0.0.1:51836_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={action=OVERSEERSTATUS&wt=javabin&version=2} status=0 QTime=20
[junit4] 2> 1808139 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1808143 INFO (OverseerCollectionConfigSetProcessor-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1808147 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d71f718{/solr,null,AVAILABLE}
[junit4] 2> 1808148 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@669d7a5b{HTTP/1.1,[http/1.1]}{127.0.0.1:60506}
[junit4] 2> 1808148 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.Server Started @1826170ms
[junit4] 2> 1808148 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60506}
[junit4] 2> 1808148 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1808170 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1808170 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1808170 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1808170 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-11T06:01:39.624Z
[junit4] 2> 1808215 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1808254 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46826/solr
[junit4] 2> 1808835 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1808905 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1808931 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60506_solr
[junit4] 2> 1808935 INFO (zkCallback-598-thread-2-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1808935 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1808973 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1809017 INFO (zkCallback-612-thread-1-processing-n:127.0.0.1:60506_solr) [n:127.0.0.1:60506_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1809113 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1809114 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1809114 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:60506_solr at time 1507701700568000000
[junit4] 2> 1809322 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60506.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1809427 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60506.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1809427 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60506.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1809448 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:60506_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/tempDir-001/node3/.
[junit4] 2> 1810122 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1810123 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1811130 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1811131 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1812203 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1812203 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1813372 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1813372 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1814378 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1814379 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1815649 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1815649 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1816658 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1816659 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1817666 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1817667 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1818671 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1818671 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1819673 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1819673 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1819674 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:60506_solr] added at times [1507701700568000000]
[junit4] 2> 1820940 INFO (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1820941 INFO (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:46826/solr ready
[junit4] 2> 1820959 INFO (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.SystemLogListener Collection .system does not exist, disabling logging.
[junit4] 2> 1820988 DEBUG (AutoscalingActionExecutor-1788-thread-1-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for NodeAddedEvent{id='14ec6eb5619ba600Td5p33ddsu9iq1h6gxaxj98k8b', source='node_added_trigger', eventTime=1507701700568000000, properties={eventTimes=[1507701700568000000], _enqueue_time_=1507701711128000000, nodeNames=[127.0.0.1:60506_solr]}}
[junit4] 2> 1820990 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 1821035 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@418e61fe{/solr,null,AVAILABLE}
[junit4] 2> 1821035 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6627e311{HTTP/1.1,[http/1.1]}{127.0.0.1:47242}
[junit4] 2> 1821035 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.Server Started @1839057ms
[junit4] 2> 1821035 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=47242}
[junit4] 2> 1821036 ERROR (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1821036 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 1821036 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1821036 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1821036 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-11T06:01:52.490Z
[junit4] 2> 1821223 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 1822655 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1822655 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1823739 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1823739 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1823805 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:46826/solr
[junit4] 2> 1824035 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1824039 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1824064 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47242_solr
[junit4] 2> 1824065 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1824065 INFO (zkCallback-612-thread-1-processing-n:127.0.0.1:60506_solr) [n:127.0.0.1:60506_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1824065 INFO (zkCallback-598-thread-1-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1824065 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1824447 INFO (zkCallback-622-thread-1-processing-n:127.0.0.1:47242_solr) [n:127.0.0.1:47242_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1824822 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1824822 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1824823 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Tracking new node: 127.0.0.1:47242_solr at time 1507701716277000000
[junit4] 2> 1825855 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1825855 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1826900 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47242.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1826977 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47242.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1826977 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_47242.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4f9b4b52
[junit4] 2> 1826978 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [n:127.0.0.1:47242_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_5612910F7A42394A-001/tempDir-001/node4/.
[junit4] 2> 1827471 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1827471 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1828473 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1828474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1829474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1829474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1830474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1830474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1831474 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1831475 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1832482 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1832482 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1833484 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1833484 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1834487 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1834487 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1835487 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1835487 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1835487 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger firing registered processor for nodes: [127.0.0.1:47242_solr] added at times [1507701716277000000]
[junit4] 2> 1835495 DEBUG (AutoscalingActionExecutor-1788-thread-1-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.a.ScheduledTriggers -- processing actions for NodeAddedEvent{id='14ec6eb909eff740Td5p33ddsu9iq1h6gxaxj98k8d', source='node_added_trigger', eventTime=1507701716277000000, properties={eventTimes=[1507701716277000000], _enqueue_time_=1507701726941000000, nodeNames=[127.0.0.1:47242_solr]}}
[junit4] 2> 1835495 INFO (AutoscalingActionExecutor-1788-thread-1-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.ActionThrottle The last action attempt started 14506ms ago.
[junit4] 2> 1836563 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1836563 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1837474 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@31df004f{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 1837527 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1653307411
[junit4] 2> 1837527 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1837528 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14769a33: rootName = solr_59440, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@44b88dc4
[junit4] 2> 1837533 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1837533 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7d8c5a74: rootName = solr_59440, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@21dd76d3
[junit4] 2> 1837557 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1837558 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5fdc0255: rootName = solr_59440, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@7cd011a6
[junit4] 2> 1837601 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1837794 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1837794 DEBUG (ScheduledTrigger-1787-thread-3) [n:127.0.0.1:59440_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:47242_solr, 127.0.0.1:51836_solr, 127.0.0.1:59440_solr, 127.0.0.1:60506_solr]
[junit4] 2> 1837797 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 1837797 INFO (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.Overseer Overseer (id=98808737975828486-127.0.0.1:59440_solr-n_0000000000) closing
[junit4] 2> 1837797 INFO (OverseerStateUpdate-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:59440_solr
[junit4] 2> 1837920 DEBUG (TEST-TriggerIntegrationTest.testEventFromRestoredState-seed#[5612910F7A42394A]) [ ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread has been closed explicitly
[junit4] 2> 1837922 WARN (OverseerAutoScalingTriggerThread-98808737975828486-127.0.0.1:59440_solr-n_0000000000) [n:127.0.0.1:59440_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1837948 INFO (zkCallback-622-thread-1-processing-n:127.0.0.1:47242_solr) [n:127.0.0.1:47242_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1837948 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:51836_solr
[junit4] 2> 1837948 INFO (zkCallback-604-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1837949 INFO (zkCallback-597-thread-1-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.Overseer Overseer (id=98808737975828485-127.0.0.1:51836_solr-n_0000000001) starting
[junit4] 2> 1837951 INFO (zkCallback-597-thread-2-processing-n:127.0.0.1:51836_solr) [n:127.0.0.1:51836_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1837996 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.OverseerTriggerThread Adding .autoAddReplicas trigger
[junit4] 2> 1837997 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.OverseerTriggerThread Refreshing /autoscaling.json with znode version 4
[junit4] 2> 1837997 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger Initial livenodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1837997 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger NodeAddedTrigger node_added_trigger instantiated with properties: {event=nodeAdded, waitFor=10, actions=[{name=test, class=org.apache.solr.cloud.autoscaling.TriggerIntegrationTest$TestTriggerAction}], enabled=true}
[junit4] 2> 1837998 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeLostTrigger Initial livenodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1837998 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion -1
[junit4] 2> 1837998 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.OverseerTriggerThread Processed trigger updates upto znodeVersion 4
[junit4] 2> 1838015 INFO (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.TriggerIntegrationTest TestTriggerAction init
[junit4] 2> 1838016 DEBUG (ScheduledTrigger-1808-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1838018 DEBUG (OverseerAutoScalingTriggerThread-98808737975828485-127.0.0.1:51836_solr-n_0000000001) [n:127.0.0.1:51836_solr ] o.a.s.c.a.OverseerTriggerThread Current znodeVersion 4, lastZnodeVersion 4
[junit4] 2> 1838019 DEBUG (ScheduledTrigger-1808-thread-2) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1838019 DEBUG (ScheduledTrigger-1808-thread-2) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1838375 INFO (zkCallback-612-thread-1-processing-n:127.0.0.1:60506_solr) [n:127.0.0.1:60506_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1839039 DEBUG (ScheduledTrigger-1808-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeLostTrigger Running NodeLostTrigger: .auto_add_replicas with currently live nodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1839039 DEBUG (ScheduledTrigger-1808-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger Running NodeAddedTrigger node_added_trigger
[junit4] 2> 1839039 DEBUG (ScheduledTrigger-1808-thread-1) [n:127.0.0.1:51836_solr ] o.a.s.c.a.NodeAddedTrigger Found livenodes: [127.0.0.1:51836_solr, 127.0.0.1:60506_solr, 127.0.0.1:47242_solr]
[junit4] 2> 1839448 WARN (zkCallback-598-thread-1-processing-n:127.0.0.1:59440_solr) [n:127.0.0.1:59440_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[j
[...truncated too long message...]
r /live_nodes]
[junit4] 2> 184127 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f0a4eb662000b, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 184128 INFO (zkCallback-41-thread-2-processing-n:127.0.0.1:35510_solr) [n:127.0.0.1:35510_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 184128 INFO (zkCallback-41-thread-3-processing-n:127.0.0.1:35510_solr) [n:127.0.0.1:35510_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35510_solr
[junit4] 2> 184135 INFO (zkCallback-47-thread-4-processing-n:127.0.0.1:48666_solr) [n:127.0.0.1:48666_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 184139 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15f0a4eb6620018, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 184143 INFO (jetty-closer-3-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3a6c622a{/solr,null,UNAVAILABLE}
[junit4] 2> 184143 INFO (zkCallback-41-thread-1-processing-n:127.0.0.1:35510_solr) [n:127.0.0.1:35510_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 184155 INFO (jetty-closer-3-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 184259 INFO (coreCloseExecutor-147-thread-1) [n:127.0.0.1:35510_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n5] o.a.s.c.SolrCore [falsepredicate_shard4_replica_n5] CLOSING SolrCore org.apache.solr.core.SolrCore@ebc81fa
[junit4] 2> 184259 INFO (coreCloseExecutor-147-thread-1) [n:127.0.0.1:35510_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.falsepredicate.shard4.replica_n5, tag=247235066
[junit4] 2> 184259 INFO (coreCloseExecutor-147-thread-1) [n:127.0.0.1:35510_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n5] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6804ef5: rootName = solr_35510, domain = solr.core.falsepredicate.shard4.replica_n5, service url = null, agent id = null] for registry solr.core.falsepredicate.shard4.replica_n5 / com.codahale.metrics.MetricRegistry@4784d0be
[junit4] 2> 184263 INFO (coreCloseExecutor-147-thread-2) [n:127.0.0.1:35510_solr c:currentstate s:shard1 r:core_node2 x:currentstate_shard1_replica_n1] o.a.s.c.SolrCore [currentstate_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@504e7c61
[junit4] 2> 184519 INFO (coreCloseExecutor-147-thread-3) [n:127.0.0.1:35510_solr c:testcollection s:shard4 r:core_node8 x:testcollection_shard4_replica_n6] o.a.s.c.SolrCore [testcollection_shard4_replica_n6] CLOSING SolrCore org.apache.solr.core.SolrCore@1e44702d
[junit4] 2> 184545 INFO (coreCloseExecutor-147-thread-1) [n:127.0.0.1:35510_solr c:falsepredicate s:shard4 r:core_node8 x:falsepredicate_shard4_replica_n5] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.falsepredicate.shard4.leader, tag=247235066
[junit4] 2> 184547 INFO (coreCloseExecutor-147-thread-2) [n:127.0.0.1:35510_solr c:currentstate s:shard1 r:core_node2 x:currentstate_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.currentstate.shard1.replica_n1, tag=1347320929
[junit4] 2> 184547 INFO (coreCloseExecutor-147-thread-2) [n:127.0.0.1:35510_solr c:currentstate s:shard1 r:core_node2 x:currentstate_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3945bbb6: rootName = solr_35510, domain = solr.core.currentstate.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.currentstate.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@db20391
[junit4] 2> 184842 INFO (coreCloseExecutor-147-thread-2) [n:127.0.0.1:35510_solr c:currentstate s:shard1 r:core_node2 x:currentstate_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.currentstate.shard1.leader, tag=1347320929
[junit4] 2> 184858 INFO (coreCloseExecutor-147-thread-3) [n:127.0.0.1:35510_solr c:testcollection s:shard4 r:core_node8 x:testcollection_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.testcollection.shard4.replica_n6, tag=507801645
[junit4] 2> 184859 INFO (coreCloseExecutor-147-thread-3) [n:127.0.0.1:35510_solr c:testcollection s:shard4 r:core_node8 x:testcollection_shard4_replica_n6] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1e25d134: rootName = solr_35510, domain = solr.core.testcollection.shard4.replica_n6, service url = null, agent id = null] for registry solr.core.testcollection.shard4.replica_n6 / com.codahale.metrics.MetricRegistry@67a39654
[junit4] 2> 184893 INFO (coreCloseExecutor-147-thread-3) [n:127.0.0.1:35510_solr c:testcollection s:shard4 r:core_node8 x:testcollection_shard4_replica_n6] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testcollection.shard4.leader, tag=507801645
[junit4] 2> 185643 WARN (zkCallback-47-thread-1-processing-n:127.0.0.1:48666_solr) [n:127.0.0.1:48666_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 186028 INFO (jetty-closer-3-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6e8391b3{/solr,null,UNAVAILABLE}
[junit4] 2> 186591 WARN (zkCallback-41-thread-3-processing-n:127.0.0.1:35510_solr) [n:127.0.0.1:35510_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 186591 INFO (jetty-closer-3-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5107debf{/solr,null,UNAVAILABLE}
[junit4] 2> 186615 ERROR (SUITE-TestCollectionStateWatchers-seed#[AD638E0B3870CED8]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 186635 INFO (SUITE-TestCollectionStateWatchers-seed#[AD638E0B3870CED8]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48276 48276
[junit4] 2> 186760 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48276 48276
[junit4] 2> 186767 WARN (Thread-1) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 7 /solr/security.json
[junit4] 2> 6 /solr/configs/config
[junit4] 2> 4 /solr/collections/stateformat1/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 71 /solr/collections/falsepredicate/state.json
[junit4] 2> 34 /solr/collections/testcollection/state.json
[junit4] 2> 21 /solr/collections/waitforstate/state.json
[junit4] 2> 11 /solr/collections/currentstate/state.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/delayed/state.json
[junit4] 2> 6 /solr/collections/tobedeleted/state.json
[junit4] 2> 5 /solr/collections/stateformat1/state.json
[junit4] 2> 2 /solr/overseer_elect/election/98809050009042956-127.0.0.1:34120_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/98809050009042954-127.0.0.1:44606_solr-n_0000000000
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections
[junit4] 2> 8 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J1/temp/solr.common.cloud.TestCollectionStateWatchers_AD638E0B3870CED8-001
[junit4] 2> Oct 11, 2017 7:23:56 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=647, maxMBSortInHeap=5.320522305188987, sim=RandomSimilarity(queryNorm=true): {}, locale=be, timezone=America/Argentina/La_Rioja
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=171139912,total=360710144
[junit4] 2> NOTE: All tests run in this JVM: [ArcCosineEvaluatorTest, OperationsTest, SolrDocumentTest, TestCollectionStateWatchers]
[junit4] Completed [21/145 (1!)] on J1 in 190.82s, 9 tests, 1 failure <<< FAILURES!
[...truncated 46318 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2117 - Still unstable
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2117/
4 tests failed.
FAILED: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test
Error Message:
Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n1","base_url":"http://127.0.0.1:42282","node_name":"127.0.0.1:42282_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node4":{ "core":"c8n_1x3_lf_shard1_replica_n2", "base_url":"http://127.0.0.1:40934", "node_name":"127.0.0.1:40934_", "state":"down", "type":"NRT"}, "core_node5":{ "core":"c8n_1x3_lf_shard1_replica_n1", "base_url":"http://127.0.0.1:42282", "node_name":"127.0.0.1:42282_", "state":"active", "type":"NRT", "leader":"true"}, "core_node6":{ "state":"down", "base_url":"http://127.0.0.1:36926", "core":"c8n_1x3_lf_shard1_replica_n3", "node_name":"127.0.0.1:36926_", "type":"NRT"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"3", "tlogReplicas":"0"}
Stack Trace:
java.lang.AssertionError: Expected 2 of 3 replicas to be active but only found 1; [core_node5:{"core":"c8n_1x3_lf_shard1_replica_n1","base_url":"http://127.0.0.1:42282","node_name":"127.0.0.1:42282_","state":"active","type":"NRT","leader":"true"}]; clusterState: DocCollection(c8n_1x3_lf//collections/c8n_1x3_lf/state.json/17)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node4":{
"core":"c8n_1x3_lf_shard1_replica_n2",
"base_url":"http://127.0.0.1:40934",
"node_name":"127.0.0.1:40934_",
"state":"down",
"type":"NRT"},
"core_node5":{
"core":"c8n_1x3_lf_shard1_replica_n1",
"base_url":"http://127.0.0.1:42282",
"node_name":"127.0.0.1:42282_",
"state":"active",
"type":"NRT",
"leader":"true"},
"core_node6":{
"state":"down",
"base_url":"http://127.0.0.1:36926",
"core":"c8n_1x3_lf_shard1_replica_n3",
"node_name":"127.0.0.1:36926_",
"type":"NRT"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"3",
"tlogReplicas":"0"}
at __randomizedtesting.SeedInfo.seed([E723C400875A14DB:6F77FBDA29A67923]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.testRf3WithLeaderFailover(LeaderFailoverAfterPartitionTest.java:169)
at org.apache.solr.cloud.LeaderFailoverAfterPartitionTest.test(LeaderFailoverAfterPartitionTest.java:56)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index: 0, Size: 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at __randomizedtesting.SeedInfo.seed([E723C400875A14DB:F36B9F55A45DA9C5]:0)
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream
Error Message:
Could not load collection from ZK: mainCorpus
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: mainCorpus
at __randomizedtesting.SeedInfo.seed([FA630FF4AC6498E6:D8A38E0F8F0EB2F6]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream(StreamExpressionTest.java:7570)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/mainCorpus/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 43 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<3>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<3>
at __randomizedtesting.SeedInfo.seed([E723C400875A14DB:FB22B98DF2FF6A48]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11602 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderFailoverAfterPartitionTest
[junit4] 2> 64407 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[E723C400875A14DB]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/init-core-data-001
[junit4] 2> 64408 WARN (SUITE-LeaderFailoverAfterPartitionTest-seed#[E723C400875A14DB]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
[junit4] 2> 64482 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[E723C400875A14DB]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 64484 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[E723C400875A14DB]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 64484 INFO (SUITE-LeaderFailoverAfterPartitionTest-seed#[E723C400875A14DB]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 64541 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 64576 INFO (Thread-4) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 64576 INFO (Thread-4) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 64593 ERROR (Thread-4) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 64689 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkTestServer start zk server on port:35971
[junit4] 2> 65037 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 65054 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 65055 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 65090 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 65092 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 65148 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 65178 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 65179 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 65181 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 65198 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 65200 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 65288 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 70518 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 70846 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@183edb87{/,null,AVAILABLE}
[junit4] 2> 70938 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5322bdd9{HTTP/1.1,[http/1.1]}{127.0.0.1:36816}
[junit4] 2> 70938 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server Started @83794ms
[junit4] 2> 70938 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=45540, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/control-001/cores}
[junit4] 2> 71232 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 71304 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 71330 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 71379 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 71379 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T23:44:04.118Z
[junit4] 2> 71380 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
[junit4] 2> 71718 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 71795 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/control-001/solr.xml
[junit4] 2> 71908 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 71908 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 71963 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 72305 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35971/solr
[junit4] 2> 74561 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 74614 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45540_
[junit4] 2> 74632 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.c.Overseer Overseer (id=98801591080124420-127.0.0.1:45540_-n_0000000000) starting
[junit4] 2> 74671 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45540_
[junit4] 2> 74706 INFO (zkCallback-14-thread-1-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 76226 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 76260 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 76261 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 76314 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:45540_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/control-001/cores
[junit4] 2> 77323 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 77324 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35971/solr ready
[junit4] 2> 78692 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42006,localport=45540], receiveBufferSize:531000
[junit4] 2> 78782 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36816,localport=38412], receiveBufferSize=530904
[junit4] 2> 80184 INFO (qtp1928146655-78) [n:127.0.0.1:45540_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45540_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 80555 INFO (OverseerThreadFactory-25-thread-1-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 81412 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42018,localport=45540], receiveBufferSize:531000
[junit4] 2> 81427 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36816,localport=38424], receiveBufferSize=530904
[junit4] 2> 81597 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 81614 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 81903 INFO (zkCallback-14-thread-1-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 82910 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 83496 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 84719 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 85145 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 85165 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 85165 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 85165 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 85219 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=46.478515625, floorSegmentMB=1.7861328125, forceMergeDeletesPctAllowed=19.705185625487676, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4247668875642049
[junit4] 2> 85349 WARN (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 85804 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 85824 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 85826 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 85826 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 85917 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=138237850, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 85919 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@704484a7[control_collection_shard1_replica_n1] main]
[junit4] 2> 85955 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 85956 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 85957 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 85970 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580825479698448384
[junit4] 2> 86110 INFO (searcherExecutor-28-thread-1-processing-n:127.0.0.1:45540_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@704484a7[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 86130 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 86131 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 86131 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45540/control_collection_shard1_replica_n1/
[junit4] 2> 86131 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 86131 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45540/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 86131 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 86181 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45540/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 86185 INFO (zkCallback-14-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 86238 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 86240 INFO (qtp1928146655-76) [n:127.0.0.1:45540_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4645
[junit4] 2> 86365 INFO (zkCallback-14-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 86659 INFO (OverseerCollectionConfigSetProcessor-98801591080124420-127.0.0.1:45540_-n_0000000000) [n:127.0.0.1:45540_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 86689 INFO (qtp1928146655-78) [n:127.0.0.1:45540_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 86690 INFO (qtp1928146655-78) [n:127.0.0.1:45540_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:45540_&wt=javabin&version=2} status=0 QTime=6541
[junit4] 2> 87332 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 87478 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35971/solr ready
[junit4] 2> 87480 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 87486 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42036,localport=45540], receiveBufferSize:531000
[junit4] 2> 87499 INFO (SocketProxy-Acceptor-45540) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36816,localport=38442], receiveBufferSize=530904
[junit4] 2> 87552 INFO (qtp1928146655-79) [n:127.0.0.1:45540_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 87796 INFO (OverseerThreadFactory-25-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 87849 WARN (OverseerThreadFactory-25-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 88492 INFO (qtp1928146655-79) [n:127.0.0.1:45540_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 88508 INFO (qtp1928146655-79) [n:127.0.0.1:45540_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=955
[junit4] 2> 89162 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001 of type NRT
[junit4] 2> 89180 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 89254 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7bf10de3{/,null,AVAILABLE}
[junit4] 2> 89255 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5cdeee0f{HTTP/1.1,[http/1.1]}{127.0.0.1:39602}
[junit4] 2> 89293 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server Started @102149ms
[junit4] 2> 89293 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/tempDir-001/jetty1, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=36926, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001/cores}
[junit4] 2> 89294 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 89294 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 89305 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 89305 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 89305 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T23:44:22.044Z
[junit4] 2> 89549 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 89549 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001/solr.xml
[junit4] 2> 89588 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 89588 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 89625 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 89664 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35971/solr
[junit4] 2> 89968 INFO (OverseerCollectionConfigSetProcessor-98801591080124420-127.0.0.1:45540_-n_0000000000) [n:127.0.0.1:45540_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 90014 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 90016 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 90060 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36926_
[junit4] 2> 90061 INFO (zkCallback-14-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 90366 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 90378 INFO (zkCallback-21-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 91054 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 91187 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 91199 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 91202 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:36926_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001/cores
[junit4] 2> 91738 INFO (SocketProxy-Acceptor-36926) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42072,localport=36926], receiveBufferSize:531000
[junit4] 2> 91883 INFO (SocketProxy-Acceptor-36926) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=39602,localport=39734], receiveBufferSize=530904
[junit4] 2> 91957 INFO (qtp2074699024-131) [n:127.0.0.1:36926_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36926_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 92001 INFO (OverseerThreadFactory-25-thread-3-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:36926_ for creating new replica
[junit4] 2> 92102 INFO (SocketProxy-Acceptor-36926) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=42076,localport=36926], receiveBufferSize:531000
[junit4] 2> 92155 INFO (SocketProxy-Acceptor-36926) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=39602,localport=39738], receiveBufferSize=530904
[junit4] 2> 92265 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 92266 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 92329 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 93467 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 93633 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema [collection1_shard2_replica_n41] Schema name=test
[junit4] 2> 94785 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 95042 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n41' using configuration from collection collection1, trusted=true
[junit4] 2> 95095 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n41' (registry 'solr.core.collection1.shard2.replica_n41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 95095 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 95096 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [[collection1_shard2_replica_n41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001/cores/collection1_shard2_replica_n41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-1-001/cores/collection1_shard2_replica_n41/data/]
[junit4] 2> 95132 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=46.478515625, floorSegmentMB=1.7861328125, forceMergeDeletesPctAllowed=19.705185625487676, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4247668875642049
[junit4] 2> 95413 WARN (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 95985 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 95985 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 96003 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 96058 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 96060 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=138237850, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 96061 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.SolrIndexSearcher Opening [Searcher@68b32ee8[collection1_shard2_replica_n41] main]
[junit4] 2> 96071 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 96221 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 96222 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 96330 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580825490561695744
[junit4] 2> 96583 INFO (searcherExecutor-39-thread-1-processing-n:127.0.0.1:36926_ x:collection1_shard2_replica_n41 s:shard2 c:collection1) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SolrCore [collection1_shard2_replica_n41] Registered new searcher Searcher@68b32ee8[collection1_shard2_replica_n41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 96607 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 96643 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 96643 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36926/collection1_shard2_replica_n41/
[junit4] 2> 96679 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 96680 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.SyncStrategy http://127.0.0.1:36926/collection1_shard2_replica_n41/ has no replicas
[junit4] 2> 96680 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 96683 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36926/collection1_shard2_replica_n41/ shard2
[junit4] 2> 96870 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 96936 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 96937 INFO (qtp2074699024-129) [n:127.0.0.1:36926_ c:collection1 s:shard2 x:collection1_shard2_replica_n41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4672
[junit4] 2> 96995 INFO (qtp2074699024-131) [n:127.0.0.1:36926_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36926_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=5037
[junit4] 2> 97156 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 98001 INFO (OverseerCollectionConfigSetProcessor-98801591080124420-127.0.0.1:45540_-n_0000000000) [n:127.0.0.1:45540_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 98202 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001 of type NRT
[junit4] 2> 98203 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 98337 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@225460e2{/,null,AVAILABLE}
[junit4] 2> 98338 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4bd09f4f{HTTP/1.1,[http/1.1]}{127.0.0.1:38200}
[junit4] 2> 98338 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server Started @111194ms
[junit4] 2> 98338 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=40934, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001/cores}
[junit4] 2> 98416 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 98506 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 98506 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 98506 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 98506 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T23:44:31.245Z
[junit4] 2> 98653 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 98653 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001/solr.xml
[junit4] 2> 98741 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 98774 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 98775 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 98795 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35971/solr
[junit4] 2> 99105 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 99150 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 99166 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40934_
[junit4] 2> 99185 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 99185 INFO (zkCallback-14-thread-1-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 99311 INFO (zkCallback-21-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 99381 INFO (zkCallback-32-thread-1-processing-n:127.0.0.1:40934_) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 100769 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 100936 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 100936 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 100972 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:40934_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001/cores
[junit4] 2> 101766 INFO (qtp2074699024-132) [n:127.0.0.1:36926_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40934_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 102093 INFO (OverseerThreadFactory-25-thread-4-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40934_ for creating new replica
[junit4] 2> 102110 INFO (SocketProxy-Acceptor-40934) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=44882,localport=40934], receiveBufferSize:531000
[junit4] 2> 102218 INFO (SocketProxy-Acceptor-40934) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38200,localport=54560], receiveBufferSize=530904
[junit4] 2> 102252 INFO (qtp966644287-166) [n:127.0.0.1:40934_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 102253 INFO (qtp966644287-166) [n:127.0.0.1:40934_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 102459 INFO (zkCallback-32-thread-1-processing-n:127.0.0.1:40934_) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 102460 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 103523 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 103795 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema [collection1_shard1_replica_n43] Schema name=test
[junit4] 2> 105366 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 105536 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n43' using configuration from collection collection1, trusted=true
[junit4] 2> 105570 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n43' (registry 'solr.core.collection1.shard1.replica_n43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 105606 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 105607 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [[collection1_shard1_replica_n43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001/cores/collection1_shard1_replica_n43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-2-001/cores/collection1_shard1_replica_n43/data/]
[junit4] 2> 105610 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=46.478515625, floorSegmentMB=1.7861328125, forceMergeDeletesPctAllowed=19.705185625487676, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4247668875642049
[junit4] 2> 105645 WARN (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 106201 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 106201 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 106203 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 106203 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 106204 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=138237850, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 106222 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.SolrIndexSearcher Opening [Searcher@140433aa[collection1_shard1_replica_n43] main]
[junit4] 2> 106230 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 106230 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 106231 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 106231 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580825500943646720
[junit4] 2> 106370 INFO (searcherExecutor-50-thread-1-processing-n:127.0.0.1:40934_ x:collection1_shard1_replica_n43 s:shard1 c:collection1) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SolrCore [collection1_shard1_replica_n43] Registered new searcher Searcher@140433aa[collection1_shard1_replica_n43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40934/collection1_shard1_replica_n43/
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.SyncStrategy http://127.0.0.1:40934/collection1_shard1_replica_n43/ has no replicas
[junit4] 2> 106426 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 106442 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40934/collection1_shard1_replica_n43/ shard1
[junit4] 2> 106457 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 106462 INFO (zkCallback-32-thread-1-processing-n:127.0.0.1:40934_) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 106497 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 106506 INFO (qtp966644287-166) [n:127.0.0.1:40934_ c:collection1 s:shard1 x:collection1_shard1_replica_n43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4254
[junit4] 2> 106563 INFO (qtp2074699024-132) [n:127.0.0.1:36926_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40934_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=4797
[junit4] 2> 106681 INFO (zkCallback-32-thread-1-processing-n:127.0.0.1:40934_) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 106689 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 107884 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-3-001 of type NRT
[junit4] 2> 107885 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 107952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@393e0f46{/,null,AVAILABLE}
[junit4] 2> 107952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6d36336c{HTTP/1.1,[http/1.1]}{127.0.0.1:38880}
[junit4] 2> 107952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.e.j.s.Server Started @120808ms
[junit4] 2> 107952 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=42282, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-3-001/cores}
[junit4] 2> 107952 ERROR (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 108001 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 108034 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 108034 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 108034 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T23:44:40.773Z
[junit4] 2> 108075 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 108075 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-3-001/solr.xml
[junit4] 2> 108095 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 108095 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 108097 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 108113 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35971/solr
[junit4] 2> 108356 INFO (OverseerCollectionConfigSetProcessor-98801591080124420-127.0.0.1:45540_-n_0000000000) [n:127.0.0.1:45540_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 108444 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 108462 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 108464 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42282_
[junit4] 2> 108465 INFO (zkCallback-26-thread-1-processing-n:127.0.0.1:36926_) [n:127.0.0.1:36926_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 108474 INFO (zkCallback-21-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 108518 INFO (zkCallback-38-thread-1-processing-n:127.0.0.1:42282_) [n:127.0.0.1:42282_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 108534 INFO (zkCallback-14-thread-2-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 108535 INFO (zkCallback-32-thread-1-processing-n:127.0.0.1:40934_) [n:127.0.0.1:40934_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 109677 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 109990 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 109990 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6f5cb9b1
[junit4] 2> 109992 INFO (TEST-LeaderFailoverAfterPartitionTest.test-seed#[E723C400875A14DB]) [n:127.0.0.1:42282_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.LeaderFailoverAfterPartitionTest_E723C400875A14DB-001/shard-3-001/cores
[junit4] 2> 110856 INFO (qtp2074699024-135) [n:127.0.0.1:36926_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:42282_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 110911 INFO (OverseerThreadFactory-25-thread-5-processing-n:127.0.0.1:45540_) [n:127.0.0.1:45540_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:42282_ for creating new replica
[junit4] 2> 110932 INFO (SocketProxy-Acceptor-42282) [ ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43690,localport=42282], receiveBufferSize:531000
[junit4] 2> 111006 INFO (SocketProxy-Acceptor-42282) [ ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38880,localport=51244], receiveBufferSize=530904
[junit4] 2> 111088 INFO (qtp97
[...truncated too long message...]
rred - updating... (live nodes size: [4])
[junit4] 2> 545842 INFO (zkCallback-21-thread-5-processing-n:127.0.0.1:40056_solr) [n:127.0.0.1:40056_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/workQueue/state.json] for collection [workQueue] has occurred - updating... (live nodes size: [4])
[junit4] 2> 545915 INFO (zkCallback-23-thread-6-processing-n:127.0.0.1:37988_solr) [n:127.0.0.1:37988_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/workQueue/state.json] for collection [workQueue] has occurred - updating... (live nodes size: [4])
[junit4] 2> 545916 INFO (zkCallback-23-thread-5-processing-n:127.0.0.1:37988_solr) [n:127.0.0.1:37988_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/workQueue/state.json] for collection [workQueue] has occurred - updating... (live nodes size: [4])
[junit4] 2> 545949 INFO (jetty-closer-2-thread-4) [ ] o.a.s.c.Overseer Overseer (id=98802023856078857-127.0.0.1:41121_solr-n_0000000000) closing
[junit4] 2> 545954 INFO (OverseerStateUpdate-98802023856078857-127.0.0.1:41121_solr-n_0000000000) [n:127.0.0.1:41121_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41121_solr
[junit4] 2> 545966 INFO (coreCloseExecutor-212-thread-1) [n:127.0.0.1:40056_solr c:workQueue s:shard2 r:core_node4 x:workQueue_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.workQueue.shard2.leader, tag=1540401362
[junit4] 2> 545988 INFO (zkCallback-20-thread-4-processing-n:127.0.0.1:41121_solr) [n:127.0.0.1:41121_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 545997 INFO (zkCallback-22-thread-6-processing-n:127.0.0.1:32856_solr) [n:127.0.0.1:32856_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mainCorpus/state.json] for collection [mainCorpus] has occurred - updating... (live nodes size: [4])
[junit4] 2> 545997 WARN (zkCallback-22-thread-6-processing-n:127.0.0.1:32856_solr) [n:127.0.0.1:32856_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /collections/mainCorpus/state.json]
[junit4] 2> 546057 INFO (jetty-closer-2-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@79a22eef{/solr,null,UNAVAILABLE}
[junit4] 2> 546065 WARN (OverseerAutoScalingTriggerThread-98802023856078857-127.0.0.1:41121_solr-n_0000000000) [n:127.0.0.1:41121_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 546150 INFO (zkCallback-21-thread-1-processing-n:127.0.0.1:40056_solr) [n:127.0.0.1:40056_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (2)
[junit4] 2> 546200 INFO (jetty-closer-2-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6f4c4dac{/solr,null,UNAVAILABLE}
[junit4] 2> 546204 WARN (zkCallback-21-thread-1-processing-n:127.0.0.1:40056_solr) [n:127.0.0.1:40056_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 546229 INFO (jetty-closer-2-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2b8b6ee1{/solr,null,UNAVAILABLE}
[junit4] 2> 547453 WARN (zkCallback-22-thread-5-processing-n:127.0.0.1:32856_solr) [n:127.0.0.1:32856_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 547453 INFO (jetty-closer-2-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@41baf43a{/solr,null,UNAVAILABLE}
[junit4] 2> 547458 ERROR (SUITE-StreamExpressionTest-seed#[FA630FF4AC6498E6]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 547459 INFO (SUITE-StreamExpressionTest-seed#[FA630FF4AC6498E6]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38537 38537
[junit4] 2> 547603 INFO (Thread-1) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:38537 38537
[junit4] 2> 547657 WARN (Thread-1) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 99 /solr/aliases.json
[junit4] 2> 99 /solr/clusterprops.json
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 8 /solr/configs/ml
[junit4] 2> 4 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 99 /solr/clusterstate.json
[junit4] 2> 48 /solr/collections/destinationCollection/state.json
[junit4] 2> 34 /solr/collections/parallelDestinationCollection1/state.json
[junit4] 2> 26 /solr/collections/parallelDestinationCollection/state.json
[junit4] 2> 17 /solr/collections/mainCorpus/state.json
[junit4] 2> 16 /solr/collections/collection1/state.json
[junit4] 2> 16 /solr/collections/workQueue/state.json
[junit4] 2> 14 /solr/collections/workQueue1/state.json
[junit4] 2> 14 /solr/collections/uknownCollection/state.json
[junit4] 2> 12 /solr/collections/mainCorpus1/state.json
[junit4] 2> 12 /solr/collections/destination1/state.json
[junit4] 2> 12 /solr/collections/modelCollection/state.json
[junit4] 2> 12 /solr/collections/checkpointCollection/state.json
[junit4] 2> 2 /solr/overseer_elect/election/98802023856078857-127.0.0.1:41121_solr-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 99 /solr/live_nodes
[junit4] 2> 99 /solr/collections
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_FA630FF4AC6498E6-001
[junit4] 2> Oct 10, 2017 1:42:57 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {expr_s=PostingsFormat(name=Memory), name_s=PostingsFormat(name=Memory), terms_ss=FST50, join2_s=FST50, field_s=Lucene50(blocksize=128), multiDefault=FST50, subject=FST50, a1_s=Lucene50(blocksize=128), a2_s=PostingsFormat(name=Memory), level1_s=PostingsFormat(name=Memory), body_t=PostingsFormat(name=Memory), s_multi=PostingsFormat(name=Memory), col_s=Lucene50(blocksize=128), level2_s=Lucene50(blocksize=128), a_ss=FST50, a_s=PostingsFormat(name=Memory), tv_text=Lucene50(blocksize=128), term_s=FST50, a_t=FST50, text_s=PostingsFormat(name=Memory), id=PostingsFormat(name=Memory), text=PostingsFormat(name=Memory), featureSet_s=Lucene50(blocksize=128), checkpoint_ss=PostingsFormat(name=Memory), test_t=PostingsFormat(name=Memory), ident_s=Lucene50(blocksize=128), whitetok=PostingsFormat(name=Memory), side_s=PostingsFormat(name=Memory)}, docValues:{expr_s=DocValuesFormat(name=Lucene70), name_s=DocValuesFormat(name=Direct), iteration_i=DocValuesFormat(name=Direct), terms_ss=DocValuesFormat(name=Memory), join2_s=DocValuesFormat(name=Memory), multiDefault=DocValuesFormat(name=Memory), intDefault=DocValuesFormat(name=Asserting), a_f=DocValuesFormat(name=Asserting), falseNegative_i=DocValuesFormat(name=Asserting), a2_s=DocValuesFormat(name=Lucene70), a_i=DocValuesFormat(name=Direct), level1_s=DocValuesFormat(name=Lucene70), a_s=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Direct), alpha_d=DocValuesFormat(name=Direct), i_multi=DocValuesFormat(name=Direct), idf_d=DocValuesFormat(name=Asserting), b_ls=DocValuesFormat(name=Asserting), checkpoint_ss=DocValuesFormat(name=Direct), ident_s=DocValuesFormat(name=Asserting), order_i=DocValuesFormat(name=Memory), error_d=DocValuesFormat(name=Lucene70), side_s=DocValuesFormat(name=Direct), truePositive_i=DocValuesFormat(name=Lucene70), miles_i=DocValuesFormat(name=Asserting), field_s=DocValuesFormat(name=Asserting), price_f=DocValuesFormat(name=Memory), a1_s=DocValuesFormat(name=Asserting), join1_i=DocValuesFormat(name=Lucene70), join3_i=DocValuesFormat(name=Direct), test_i=DocValuesFormat(name=Memory), falsePositive_i=DocValuesFormat(name=Asserting), field_i=DocValuesFormat(name=Memory), s_multi=DocValuesFormat(name=Lucene70), col_s=DocValuesFormat(name=Asserting), level2_s=DocValuesFormat(name=Asserting), a_ss=DocValuesFormat(name=Memory), score_f=DocValuesFormat(name=Lucene70), term_s=DocValuesFormat(name=Memory), text_s=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Memory), idfs_ds=DocValuesFormat(name=Memory), weights_ds=DocValuesFormat(name=Direct), featureSet_s=DocValuesFormat(name=Asserting), trueNegative_i=DocValuesFormat(name=Lucene70), index_i=DocValuesFormat(name=Asserting), test_dt=DocValuesFormat(name=Lucene70), out_i=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1897, maxMBSortInHeap=6.889811279727588, sim=RandomSimilarity(queryNorm=true): {}, locale=en-NZ, timezone=ACT
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=88151912,total=377487360
[junit4] 2> NOTE: All tests run in this JVM: [TestV1toV2ApiMapper, TestHash, ReverseEvaluatorTest, TestJavaBinCodec, StreamExpressionTest]
[junit4] Completed [117/145 (1!)] on J2 in 538.18s, 121 tests, 1 error <<< FAILURES!
[...truncated 46024 lines...]
[JENKINS] Lucene-Solr-Tests-master - Build # 2116 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2116/
1 tests failed.
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<4>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<4>
at __randomizedtesting.SeedInfo.seed([36AFB67EEA691A9D:2AAECBF39FCC640E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11811 lines...]
[junit4] Suite: org.apache.solr.cloud.TestTlogReplica
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/init-core-data-001
[junit4] 2> 880007 WARN (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5
[junit4] 2> 880007 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 880021 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
[junit4] 2> 880021 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 880042 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001
[junit4] 2> 880042 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 880058 INFO (Thread-467) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 880058 INFO (Thread-467) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 880131 ERROR (Thread-467) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 880180 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:35932
[junit4] 2> 880292 INFO (jetty-launcher-444-thread-1) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 880293 INFO (jetty-launcher-444-thread-2) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 880294 INFO (jetty-launcher-444-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@222a119f{/solr,null,AVAILABLE}
[junit4] 2> 880343 INFO (jetty-launcher-444-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4711ca24{/solr,null,AVAILABLE}
[junit4] 2> 880345 INFO (jetty-launcher-444-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5fbf7624{HTTP/1.1,[http/1.1]}{127.0.0.1:39132}
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.e.j.s.Server Started @894424ms
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39132}
[junit4] 2> 880346 ERROR (jetty-launcher-444-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 880346 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T05:57:52.889Z
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@af0e26d{HTTP/1.1,[http/1.1]}{127.0.0.1:34715}
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.e.j.s.Server Started @894458ms
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34715}
[junit4] 2> 880380 ERROR (jetty-launcher-444-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 880380 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-09T05:57:52.923Z
[junit4] 2> 880432 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 880441 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 880514 INFO (jetty-launcher-444-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35932/solr
[junit4] 2> 880599 INFO (jetty-launcher-444-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35932/solr
[junit4] 2> 881030 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 881048 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39132_solr
[junit4] 2> 881049 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.c.Overseer Overseer (id=98797399088955398-127.0.0.1:39132_solr-n_0000000000) starting
[junit4] 2> 881181 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39132_solr
[junit4] 2> 881303 INFO (zkCallback-457-thread-1-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 881942 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 881943 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 881944 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34715_solr
[junit4] 2> 881989 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39132.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 881994 INFO (zkCallback-457-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 882054 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39132.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 882054 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39132.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 882067 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 882088 INFO (jetty-launcher-444-thread-2) [n:127.0.0.1:39132_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node2/.
[junit4] 2> 882498 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34715.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 882590 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34715.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 882590 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34715.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 882648 INFO (jetty-launcher-444-thread-1) [n:127.0.0.1:34715_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node1/.
[junit4] 2> 883149 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 883149 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35932/solr ready
[junit4] 2> 883151 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.TestTlogReplica Using legacyCloud?: false
[junit4] 2> 883169 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :clusterprop with params val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 883170 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={val=false&name=legacyCloud&action=CLUSTERPROP&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 883297 INFO (TEST-TestTlogReplica.testDeleteById-seed#[36AFB67EEA691A9D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testDeleteById
[junit4] 2> 883298 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 883396 INFO (OverseerThreadFactory-863-thread-1-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_delete_by_id
[junit4] 2> 883589 INFO (OverseerStateUpdate-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34715/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 883624 INFO (OverseerStateUpdate-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_delete_by_id",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_delete_by_id_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39132/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 884028 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 884029 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 884100 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 884100 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 884210 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 884211 INFO (zkCallback-457-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 884212 INFO (zkCallback-455-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 884221 INFO (zkCallback-457-thread-1-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 885158 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 885381 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 885403 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t1] Schema name=minimal
[junit4] 2> 885454 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_delete_by_id_shard1_replica_t2] Schema name=minimal
[junit4] 2> 885456 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 885456 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t2' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 885457 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39132.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 885457 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 885474 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node2/tlog_replica_test_delete_by_id_shard1_replica_t2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node2/./tlog_replica_test_delete_by_id_shard1_replica_t2/data/]
[junit4] 2> 885511 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 885511 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_delete_by_id_shard1_replica_t1' using configuration from collection tlog_replica_test_delete_by_id, trusted=true
[junit4] 2> 885563 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34715.solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 885563 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 885564 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_delete_by_id_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node1/tlog_replica_test_delete_by_id_shard1_replica_t1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node1/./tlog_replica_test_delete_by_id_shard1_replica_t1/data/]
[junit4] 2> 885836 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 885836 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 885837 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 885837 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 885838 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e9759d7[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 885839 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 885856 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 885857 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 885858 INFO (searcherExecutor-869-thread-1-processing-n:127.0.0.1:34715_solr x:tlog_replica_test_delete_by_id_shard1_replica_t1 s:shard1 c:tlog_replica_test_delete_by_id r:core_node3) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@1e9759d7[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 885858 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580758391483006976
[junit4] 2> 885859 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 885859 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 885860 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 885860 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 885874 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@63b1673e[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 885875 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 885875 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 885876 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 885910 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 885911 INFO (searcherExecutor-868-thread-1-processing-n:127.0.0.1:39132_solr x:tlog_replica_test_delete_by_id_shard1_replica_t2 s:shard1 c:tlog_replica_test_delete_by_id r:core_node4) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@63b1673e[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 885911 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580758391538581504
[junit4] 2> 886048 INFO (zkCallback-455-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886048 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886048 INFO (zkCallback-457-thread-1-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886048 INFO (zkCallback-457-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886414 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 886414 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 886414 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/
[junit4] 2> 886414 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=http://127.0.0.1:34715/solr START replicas=[http://127.0.0.1:39132/solr/tlog_replica_test_delete_by_id_shard1_replica_t2/] nUpdates=100
[junit4] 2> 886439 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 886730 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.PeerSync PeerSync: core=tlog_replica_test_delete_by_id_shard1_replica_t1 url=http://127.0.0.1:34715/solr DONE. We have no versions. sync failed.
[junit4] 2> 886730 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 886731 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 886731 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 886731 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 886733 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/ shard1
[junit4] 2> 886991 INFO (zkCallback-455-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886991 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886991 INFO (zkCallback-457-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 886991 INFO (zkCallback-457-thread-1-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 887044 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 starting background replication from leader
[junit4] 2> 887044 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
[junit4] 2> 887060 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
[junit4] 2> 887060 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 887060 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 887061 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2961
[junit4] 2> 887062 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_delete_by_id_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_delete_by_id&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3033
[junit4] 2> 887117 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 887394 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 887394 INFO (zkCallback-455-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 887394 INFO (zkCallback-457-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 887394 INFO (zkCallback-457-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 887468 INFO (OverseerCollectionConfigSetProcessor-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 888128 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_delete_by_id&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=4829
[junit4] 2> 888203 INFO (qtp550280759-2768) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1580758393903120384&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{deleteByQuery=*:* (-1580758393903120384)} 0 0
[junit4] 2> 888261 INFO (qtp550280759-2764) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 888295 INFO (qtp1555183162-2757) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580758394038386688,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 888295 INFO (qtp1555183162-2757) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 888312 INFO (qtp1555183162-2757) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 888319 INFO (qtp1555183162-2757) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 24
[junit4] 2> 888347 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&commit=true&wt=javabin&version=2}{deleteByQuery=*:* (-1580758393903120384),commit=} 0 182
[junit4] 2> 888371 INFO (qtp550280759-2764) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{add=[1 (1580758394115981312)]} 0 0
[junit4] 2> 888371 INFO (qtp1555183162-2759) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&wt=javabin&version=2}{add=[1 (1580758394115981312)]} 0 3
[junit4] 2> 888385 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 888385 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580758394132758528,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 888386 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@79592b88 commitCommandVersion:1580758394132758528
[junit4] 2> 888422 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@5319bba5[tlog_replica_test_delete_by_id_shard1_replica_t1] main]
[junit4] 2> 888423 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 888431 INFO (searcherExecutor-869-thread-1-processing-n:127.0.0.1:34715_solr x:tlog_replica_test_delete_by_id_shard1_replica_t1 s:shard1 c:tlog_replica_test_delete_by_id r:core_node3) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] Registered new searcher Searcher@5319bba5[tlog_replica_test_delete_by_id_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 888432 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 46
[junit4] 2> 888441 INFO (qtp1555183162-2759) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={_stateVer_=tlog_replica_test_delete_by_id:5&commit=true&wt=javabin&version=2}{commit=} 0 57
[junit4] 2> 888444 INFO (qtp1555183162-2758) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 888459 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 888567 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 888678 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 888787 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 888897 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889007 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889112 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889225 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889335 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889441 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889599 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/
[junit4] 2> 889624 INFO (qtp1555183162-2756) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
[junit4] 2> 889626 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Master's generation: 2
[junit4] 2> 889626 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Master's version: 1507528680929
[junit4] 2> 889626 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Slave's generation: 1
[junit4] 2> 889626 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Slave's version: 0
[junit4] 2> 889626 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Starting replication process
[junit4] 2> 889644 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889645 INFO (qtp1555183162-2756) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=18
[junit4] 2> 889645 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Number of files in latest index in master: 15
[junit4] 2> 889661 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@282f9fe4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4fa936d)
[junit4] 2> 889661 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.si&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889736 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.doc&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889753 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889771 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tim&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889771 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Direct_0.dvdd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889772 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.pos&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889773 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889808 INFO (qtp1555183162-2752) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdx&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889809 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene50_0.tip&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889831 INFO (qtp1555183162-2756) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fdt&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889855 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 889891 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889892 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Lucene70_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889893 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.nvm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889894 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0_Direct_0.dvdm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889894 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=_0.fnm&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889907 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/replication params={generation=2&qt=/replication&file=segments_2&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
[junit4] 2> 889908 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.h.IndexFetcher Total time taken for download (fullCopy=false,bytesDownloaded=2273) : 0 secs (null bytes/sec) to MockDirectoryWrapper(RAMDirectory@282f9fe4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4fa936d)
[junit4] 2> 889929 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
[junit4] 2> 889944 INFO (indexFetcher-879-thread-1) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@18f20902[tlog_replica_test_delete_by_id_shard1_replica_t2] main]
[junit4] 2> 889946 INFO (searcherExecutor-868-thread-1-processing-n:127.0.0.1:39132_solr x:tlog_replica_test_delete_by_id_shard1_replica_t2 s:shard1 c:tlog_replica_test_delete_by_id r:core_node4) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] Registered new searcher Searcher@18f20902[tlog_replica_test_delete_by_id_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
[junit4] 2> 889965 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0
[junit4] 2> 890019 INFO (qtp550280759-2767) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:34715/solr/tlog_replica_test_delete_by_id_shard1_replica_t1/&wt=javabin&version=2}{delete=[1 (-1580758395802091520)]} 0 18
[junit4] 2> 890033 INFO (qtp1555183162-2758) [n:127.0.0.1:34715_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node3 x:tlog_replica_test_delete_by_id_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [tlog_replica_test_delete_by_id_shard1_replica_t1] webapp=/solr path=/update params={wt=javabin&version=2}{delete=[1 (-1580758395802091520)]} 0 56
[junit4] 2> 890087 INFO (qtp550280759-2765) [n:127.0.0.1:39132_solr c:tlog_replica_test_delete_by_id s:shard1 r:core_node4 x:tlog_replica_test_delete_by_id_shard1_replica_t2] o.a.s.c.S.Request [tlog_replica_test_delete_by_id_shard1_replica_t2] webapp=/solr path=/get params={distrib=false&qt=/get&id=1&wt=javabin&version=2} status=0 QTime=16
[junit4] 2> 890087 INFO (TEST-TestTlogReplica.testDeleteById-seed#[36AFB67EEA691A9D]) [ ] o.a.s.c.TestTlogReplica tearDown deleting collection
[junit4] 2> 890087 INFO (qtp550280759-2768) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 890187 INFO (OverseerThreadFactory-863-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
[junit4] 2> 890191 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=null
[junit4] 2> 890191 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@fd5b713: rootName = solr_34715, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1 / com.codahale.metrics.MetricRegistry@12574307
[junit4] 2> 890240 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=null
[junit4] 2> 890240 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@57ed3713: rootName = solr_39132, domain = solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, service url = null, agent id = null] for registry solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2 / com.codahale.metrics.MetricRegistry@48198d71
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t1 stopping background replication from leader
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t1] CLOSING SolrCore org.apache.solr.core.SolrCore@32d0a1bd
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t1, tag=852533693
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=852533693
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 890292 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@79592b88 commitCommandVersion:0
[junit4] 2> 890379 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.c.ZkController tlog_replica_test_delete_by_id_shard1_replica_t2 stopping background replication from leader
[junit4] 2> 890418 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.c.SolrCore [tlog_replica_test_delete_by_id_shard1_replica_t2] CLOSING SolrCore org.apache.solr.core.SolrCore@23294784
[junit4] 2> 890418 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.tlog_replica_test_delete_by_id.shard1.replica_t2, tag=589907844
[junit4] 2> 890418 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.tlog_replica_test_delete_by_id.shard1.leader, tag=589907844
[junit4] 2> 890418 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter close.
[junit4] 2> 890418 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@19054ea3 commitCommandVersion:0
[junit4] 2> 890460 WARN (zkCallback-457-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.LeaderElector
[junit4] 2> org.apache.solr.common.SolrException: SolrCore not found:tlog_replica_test_delete_by_id_shard1_replica_t2 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:309)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 890461 INFO (qtp1555183162-2755) [n:127.0.0.1:34715_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=270
[junit4] 2> 890481 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.c.ShardLeaderElectionContextBase No version found for ephemeral leader parent node, won't remove previous leader registration.
[junit4] 2> 890481 INFO (qtp550280759-2762) [n:127.0.0.1:39132_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&core=tlog_replica_test_delete_by_id_shard1_replica_t2&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=0 QTime=277
[junit4] 2> 890481 INFO (zkCallback-462-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 890612 INFO (zkCallback-462-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/tlog_replica_test_delete_by_id/state.json] for collection [tlog_replica_test_delete_by_id] has occurred - updating... (live nodes size: [2])
[junit4] 2> 891221 INFO (qtp550280759-2768) [n:127.0.0.1:39132_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=tlog_replica_test_delete_by_id&action=DELETE&wt=javabin&version=2} status=0 QTime=1133
[junit4] 2> 891222 INFO (TEST-TestTlogReplica.testDeleteById-seed#[36AFB67EEA691A9D]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testDeleteById
[junit4] 2> 891577 INFO (TEST-TestTlogReplica.testOutOfOrderDBQWithInPlaceUpdates-seed#[36AFB67EEA691A9D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testOutOfOrderDBQWithInPlaceUpdates
[junit4] 2> 891578 INFO (qtp550280759-2766) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=conf&maxShardsPerNode=100&name=tlog_replica_test_out_of_order_db_qwith_in_place_updates&nrtReplicas=0&action=CREATE&numShards=1&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 891617 INFO (OverseerThreadFactory-863-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.CreateCollectionCmd Create collection tlog_replica_test_out_of_order_db_qwith_in_place_updates
[junit4] 2> 891627 INFO (OverseerCollectionConfigSetProcessor-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 891782 INFO (OverseerStateUpdate-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_out_of_order_db_qwith_in_place_updates",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:34715/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 891797 INFO (OverseerStateUpdate-98797399088955398-127.0.0.1:39132_solr-n_0000000000) [n:127.0.0.1:39132_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"tlog_replica_test_out_of_order_db_qwith_in_place_updates",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:39132/solr",
[junit4] 2> "type":"TLOG"}
[junit4] 2> 892040 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1&action=CREATE&numShards=1&collection=tlog_replica_test_out_of_order_db_qwith_in_place_updates&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 892040 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2&action=CREATE&numShards=1&collection=tlog_replica_test_out_of_order_db_qwith_in_place_updates&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 892186 INFO (zkCallback-455-thread-1-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json] for collection [tlog_replica_test_out_of_order_db_qwith_in_place_updates] has occurred - updating... (live nodes size: [2])
[junit4] 2> 892186 INFO (zkCallback-455-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json] for collection [tlog_replica_test_out_of_order_db_qwith_in_place_updates] has occurred - updating... (live nodes size: [2])
[junit4] 2> 892186 INFO (zkCallback-457-thread-2-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json] for collection [tlog_replica_test_out_of_order_db_qwith_in_place_updates] has occurred - updating... (live nodes size: [2])
[junit4] 2> 892186 INFO (zkCallback-457-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json] for collection [tlog_replica_test_out_of_order_db_qwith_in_place_updates] has occurred - updating... (live nodes size: [2])
[junit4] 2> 893136 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 893429 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.s.IndexSchema [tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] Schema name=minimal
[junit4] 2> 893484 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 893484 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1' using configuration from collection tlog_replica_test_out_of_order_db_qwith_in_place_updates, trusted=true
[junit4] 2> 893485 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34715.solr.core.tlog_replica_test_out_of_order_db_qwith_in_place_updates.shard1.replica_t1' (registry 'solr.core.tlog_replica_test_out_of_order_db_qwith_in_place_updates.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 893485 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 893485 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.SolrCore [[tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node1/tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node1/./tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1/data/]
[junit4] 2> 893527 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 893619 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.s.IndexSchema [tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] Schema name=minimal
[junit4] 2> 893621 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 893621 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2' using configuration from collection tlog_replica_test_out_of_order_db_qwith_in_place_updates, trusted=true
[junit4] 2> 893654 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39132.solr.core.tlog_replica_test_out_of_order_db_qwith_in_place_updates.shard1.replica_t2' (registry 'solr.core.tlog_replica_test_out_of_order_db_qwith_in_place_updates.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@70de3c52
[junit4] 2> 893655 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 893655 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.c.SolrCore [[tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node2/tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001/tempDir-001/node2/./tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2/data/]
[junit4] 2> 893817 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 893817 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 893830 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 893830 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 893849 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@791210f2[tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] main]
[junit4] 2> 893850 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 893851 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 893851 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 893939 INFO (searcherExecutor-881-thread-1-processing-n:127.0.0.1:34715_solr x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1 s:shard1 c:tlog_replica_test_out_of_order_db_qwith_in_place_updates r:core_node3) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.SolrCore [tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] Registered new searcher Searcher@791210f2[tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 893939 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580758399956549632
[junit4] 2> 893999 INFO (qtp1555183162-2753) [n:127.0.0.1:34715_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node3 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 894030 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 894030 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 894086 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 894086 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 894087 INFO (qtp550280759-2761) [n:127.0.0.1:39132_solr c:tlog_replica_test_out_of_order_db_qwith_in_place_updates s:shard1 r:core_node4 x:tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@3f5ac3e0[tlog_replica_test_out_of_order_db_qwith_in_place_updates_shard1_replica_t2] main]
[junit4] 2> 894088 INFO (qtp550280759-2761) [n:127.0.0.1:391
[...truncated too long message...]
NFO (jetty-closer-445-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5d1b9db: rootName = solr_34715, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56af5a61
[junit4] 2> 1070146 INFO (jetty-closer-445-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1070173 INFO (jetty-closer-445-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=382885011
[junit4] 2> 1070173 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 1070173 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@772282c8: rootName = solr_39132, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@368b596b
[junit4] 2> 1070190 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1070190 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@61c58634: rootName = solr_39132, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@40351d11
[junit4] 2> 1070210 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1070210 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@475948c: rootName = solr_39132, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@56af5a61
[junit4] 2> 1070225 INFO (jetty-closer-445-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98797399088955409-127.0.0.1:34715_solr-n_0000000004) closing
[junit4] 2> 1070225 INFO (OverseerStateUpdate-98797399088955409-127.0.0.1:34715_solr-n_0000000004) [n:127.0.0.1:34715_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34715_solr
[junit4] 2> 1070227 INFO (jetty-closer-445-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1070234 WARN (OverseerAutoScalingTriggerThread-98797399088955409-127.0.0.1:34715_solr-n_0000000004) [n:127.0.0.1:34715_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 1070283 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15effb6056e0011, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1071783 WARN (zkCallback-512-thread-3-processing-n:127.0.0.1:39132_solr) [n:127.0.0.1:39132_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1071791 INFO (jetty-closer-445-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4e808c5a{/solr,null,UNAVAILABLE}
[junit4] 2> 1071799 WARN (zkCallback-484-thread-2-processing-n:127.0.0.1:34715_solr) [n:127.0.0.1:34715_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1071807 INFO (jetty-closer-445-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@22c3de70{/solr,null,UNAVAILABLE}
[junit4] 2> 1071815 ERROR (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1071816 INFO (SUITE-TestTlogReplica-seed#[36AFB67EEA691A9D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35932 35932
[junit4] 2> 1072107 INFO (Thread-467) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:35932 35932
[junit4] 2> 1072119 WARN (Thread-467) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/configs/conf
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2> 3 /solr/clusterprops.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 52 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 39 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 31 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 23 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 16 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 4 /solr/overseer_elect/election/98797399088955409-127.0.0.1:34715_solr-n_0000000004
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98797399088955409-core_node4-n_0000000000
[junit4] 2> 4 /solr/overseer_elect/election/98797399088955398-127.0.0.1:39132_solr-n_0000000000
[junit4] 2> 3 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98797399088955403-core_node16-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98797399088955403-core_node13-n_0000000001
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/98797399088955403-core_node8-n_0000000001
[junit4] 2> 2 /solr/collections/tlog_replica_test_kill_tlog_replica/leader_elect/shard1/election/98797399088955398-core_node4-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/collections
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.TestTlogReplica_36AFB67EEA691A9D-001
[junit4] 2> Oct 09, 2017 6:01:04 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {foo=PostingsFormat(name=MockRandom), title_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=Lucene50(blocksize=128), foo_s=PostingsFormat(name=MockRandom)}, docValues:{_version_=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Direct), inplace_updatable_int=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=646, maxMBSortInHeap=6.941431284770113, sim=RandomSimilarity(queryNorm=false): {}, locale=ja-JP, timezone=GB
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=261683648,total=465043456
[junit4] 2> NOTE: All tests run in this JVM: [MetricUtilsTest, TestUtils, TestClusterProperties, DistribCursorPagingTest, TestCloudPseudoReturnFields, V2ApiIntegrationTest, TestPullReplicaErrorHandling, TestScoreJoinQPNoScore, DeleteInactiveReplicaTest, SimpleCollectionCreateDeleteTest, SaslZkACLProviderTest, TestOrdValues, TestLocalFSCloudBackupRestore, BadCopyFieldTest, SpellPossibilityIteratorTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, DirectUpdateHandlerOptimizeTest, TestSolrCloudWithDelegationTokens, ForceLeaderTest, TestCloudInspectUtil, AddBlockUpdateTest, TestCloudManagedSchema, TestTlogReplica]
[junit4] Completed [82/745 (1!)] on J2 in 192.86s, 13 tests, 1 failure <<< FAILURES!
[...truncated 49116 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:706: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:693: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* lucene/licenses/morfologik-ukrainian-search-3.7.5.jar.sha1
Total time: 275 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2115 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2115/
2 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey
Error Message:
There are still nodes recoverying - waited for 330 seconds
Stack Trace:
java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
at __randomizedtesting.SeedInfo.seed([76FDCC75F0B376BF:FDDA1FA4B1B5DD3B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:185)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:908)
at org.apache.solr.cloud.ShardSplitTest.testSplitWithChaosMonkey(ShardSplitTest.java:436)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<1>
at __randomizedtesting.SeedInfo.seed([76FDCC75F0B376BF:6AFCB1F88516082C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11781 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/init-core-data-001
[junit4] 2> 234129 INFO (SUITE-ShardSplitTest-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 234130 INFO (SUITE-ShardSplitTest-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 234130 INFO (SUITE-ShardSplitTest-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 234130 INFO (SUITE-ShardSplitTest-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 234350 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 234469 INFO (Thread-98) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 234489 INFO (Thread-98) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 235129 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkTestServer start zk server on port:40646
[junit4] 2> 236494 ERROR (Thread-98) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 237497 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 237519 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 237535 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 237537 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 237667 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 237738 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 237739 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 237754 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 237756 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 237829 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 237863 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 237866 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 239299 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 239301 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@293e292{/,null,AVAILABLE}
[junit4] 2> 239389 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@32ca4e91{HTTP/1.1,[http/1.1]}{127.0.0.1:35814}
[junit4] 2> 239404 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server Started @251259ms
[junit4] 2> 239404 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/tempDir-001/control/data, hostContext=/, hostPort=35814, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/control-001/cores}
[junit4] 2> 239405 ERROR (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 239406 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 239406 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 239406 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 239407 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-08T09:18:54.130Z
[junit4] 2> 239498 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 239498 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/control-001/solr.xml
[junit4] 2> 239588 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 239588 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 239516 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15efb47a40c0002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 239802 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 239837 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40646/solr
[junit4] 2> 242873 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 242908 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35814_
[junit4] 2> 242909 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.c.Overseer Overseer (id=98792526962229252-127.0.0.1:35814_-n_0000000000) starting
[junit4] 2> 243601 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35814_
[junit4] 2> 243817 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 246456 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 246913 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 246913 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 247075 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35814_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/control-001/cores
[junit4] 2> 247731 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 247732 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40646/solr ready
[junit4] 2> 248125 INFO (qtp570468063-319) [n:127.0.0.1:35814_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35814_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 248244 INFO (OverseerThreadFactory-230-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 248608 INFO (qtp570468063-317) [n:127.0.0.1:35814_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 248661 INFO (qtp570468063-317) [n:127.0.0.1:35814_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 249154 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 250341 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 250732 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 252142 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 252376 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 252391 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 252392 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 252392 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 252466 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 252648 WARN (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 253504 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 253504 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 253505 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 253505 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 253507 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=91.4794921875, floorSegmentMB=1.72265625, forceMergeDeletesPctAllowed=24.2587726566871, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18168239024385502
[junit4] 2> 253638 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@67a61c46[control_collection_shard1_replica_n1] main]
[junit4] 2> 253653 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 253653 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 253687 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 253708 INFO (searcherExecutor-233-thread-1-processing-n:127.0.0.1:35814_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@67a61c46[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 253708 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580680450860384256
[junit4] 2> 253966 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 253967 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 253967 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35814/control_collection_shard1_replica_n1/
[junit4] 2> 253968 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 253968 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:35814/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 253968 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 254148 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35814/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 254292 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 254312 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 254384 INFO (qtp570468063-317) [n:127.0.0.1:35814_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=5776
[junit4] 2> 254624 INFO (qtp570468063-319) [n:127.0.0.1:35814_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 254676 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 255653 INFO (qtp570468063-319) [n:127.0.0.1:35814_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:35814_&wt=javabin&version=2} status=0 QTime=7530
[junit4] 2> 255727 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15efb47a40c0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 256177 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 256207 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:40646/solr ready
[junit4] 2> 256209 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 256475 INFO (qtp570468063-320) [n:127.0.0.1:35814_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 256539 INFO (OverseerCollectionConfigSetProcessor-98792526962229252-127.0.0.1:35814_-n_0000000000) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 256555 INFO (OverseerThreadFactory-230-thread-2-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 256684 WARN (OverseerThreadFactory-230-thread-2-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 257269 INFO (qtp570468063-320) [n:127.0.0.1:35814_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 257269 INFO (qtp570468063-320) [n:127.0.0.1:35814_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=794
[junit4] 2> 258282 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001 of type TLOG
[junit4] 2> 258336 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 258338 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10fecbcd{/,null,AVAILABLE}
[junit4] 2> 258338 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1c30e61f{HTTP/1.1,[http/1.1]}{127.0.0.1:46042}
[junit4] 2> 258338 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server Started @270193ms
[junit4] 2> 258338 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=46042, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001/cores}
[junit4] 2> 258338 ERROR (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 258339 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 258339 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 258339 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 258339 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-08T09:19:13.062Z
[junit4] 2> 258639 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 258639 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001/solr.xml
[junit4] 2> 258675 INFO (OverseerCollectionConfigSetProcessor-98792526962229252-127.0.0.1:35814_-n_0000000000) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 258712 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 258712 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 258713 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 258803 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40646/solr
[junit4] 2> 259116 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 259189 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 259295 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46042_
[junit4] 2> 259297 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 259392 INFO (zkCallback-54-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 259604 INFO (zkCallback-59-thread-1-processing-n:127.0.0.1:46042_) [n:127.0.0.1:46042_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 260433 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 260615 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 260615 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 260649 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:46042_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001/cores
[junit4] 2> 261121 INFO (qtp570468063-321) [n:127.0.0.1:35814_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46042_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 261288 INFO (OverseerThreadFactory-230-thread-3-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46042_ for creating new replica
[junit4] 2> 261931 INFO (qtp7341290-365) [n:127.0.0.1:46042_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 261931 INFO (qtp7341290-365) [n:127.0.0.1:46042_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 263254 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 263327 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 264090 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 267312 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 267346 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 267346 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 267346 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 267384 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 267530 WARN (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 268003 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 268003 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 268004 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 268004 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 268006 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=91.4794921875, floorSegmentMB=1.72265625, forceMergeDeletesPctAllowed=24.2587726566871, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18168239024385502
[junit4] 2> 268007 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@576c045b[collection1_shard2_replica_t41] main]
[junit4] 2> 268041 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 268042 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 268042 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 268043 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580680465891721216
[junit4] 2> 268260 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 268276 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 268407 INFO (searcherExecutor-244-thread-1-processing-n:127.0.0.1:46042_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@576c045b[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 268276 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46042/collection1_shard2_replica_t41/
[junit4] 2> 268408 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 268408 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:46042/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 268408 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 268422 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 268444 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46042/collection1_shard2_replica_t41/ shard2
[junit4] 2> 268515 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 268518 INFO (qtp7341290-365) [n:127.0.0.1:46042_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=6586
[junit4] 2> 268554 INFO (qtp570468063-321) [n:127.0.0.1:35814_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46042_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=7432
[junit4] 2> 269309 INFO (OverseerCollectionConfigSetProcessor-98792526962229252-127.0.0.1:35814_-n_0000000000) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 270059 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001 of type TLOG
[junit4] 2> 270077 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 270079 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@65a9a994{/,null,AVAILABLE}
[junit4] 2> 270080 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@13f95355{HTTP/1.1,[http/1.1]}{127.0.0.1:35468}
[junit4] 2> 270080 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server Started @281935ms
[junit4] 2> 270080 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=35468, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001/cores}
[junit4] 2> 270080 ERROR (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 270130 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 270130 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 270130 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 270130 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-08T09:19:24.853Z
[junit4] 2> 270153 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 270153 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001/solr.xml
[junit4] 2> 270169 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 270169 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 270186 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 270190 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40646/solr
[junit4] 2> 270263 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 270277 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 270296 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35468_
[junit4] 2> 270349 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 270390 INFO (zkCallback-59-thread-1-processing-n:127.0.0.1:46042_) [n:127.0.0.1:46042_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 270390 INFO (zkCallback-54-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 270479 INFO (zkCallback-65-thread-1-processing-n:127.0.0.1:35468_) [n:127.0.0.1:35468_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 271832 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 271973 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 271974 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 271976 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35468_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001/cores
[junit4] 2> 272267 INFO (qtp903643061-395) [n:127.0.0.1:35468_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35468_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 272304 INFO (OverseerThreadFactory-230-thread-4-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35468_ for creating new replica
[junit4] 2> 272355 INFO (qtp903643061-393) [n:127.0.0.1:35468_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 272355 INFO (qtp903643061-393) [n:127.0.0.1:35468_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 273472 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 273597 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 274218 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 274328 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 274342 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 274342 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 274342 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 274346 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 274491 WARN (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 274784 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 274785 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 274802 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 274802 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 274818 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=91.4794921875, floorSegmentMB=1.72265625, forceMergeDeletesPctAllowed=24.2587726566871, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18168239024385502
[junit4] 2> 274872 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@4dc8163c[collection1_shard1_replica_t43] main]
[junit4] 2> 274891 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 274894 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 274895 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 274946 INFO (searcherExecutor-255-thread-1-processing-n:127.0.0.1:35468_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@4dc8163c[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 274965 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580680473149964288
[junit4] 2> 274984 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 274984 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 274984 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35468/collection1_shard1_replica_t43/
[junit4] 2> 275017 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 275017 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:35468/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 275017 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 275019 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 275074 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35468/collection1_shard1_replica_t43/ shard1
[junit4] 2> 275075 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 275076 INFO (qtp903643061-393) [n:127.0.0.1:35468_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2721
[junit4] 2> 275094 INFO (qtp903643061-395) [n:127.0.0.1:35468_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35468_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=2827
[junit4] 2> 276319 INFO (OverseerCollectionConfigSetProcessor-98792526962229252-127.0.0.1:35814_-n_0000000000) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 276482 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001 of type TLOG
[junit4] 2> 276484 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 276591 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e05277a{/,null,AVAILABLE}
[junit4] 2> 276591 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@1eb51220{HTTP/1.1,[http/1.1]}{127.0.0.1:35715}
[junit4] 2> 276591 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server Started @288446ms
[junit4] 2> 276592 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=35715, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001/cores}
[junit4] 2> 276592 ERROR (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 276608 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 276608 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 276608 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 276608 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-08T09:19:31.331Z
[junit4] 2> 276739 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 276739 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001/solr.xml
[junit4] 2> 276792 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 276792 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 276793 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 276901 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40646/solr
[junit4] 2> 277215 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 277234 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 277236 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35715_
[junit4] 2> 277323 INFO (zkCallback-71-thread-1-processing-n:127.0.0.1:35715_) [n:127.0.0.1:35715_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 277360 INFO (zkCallback-54-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 277360 INFO (zkCallback-59-thread-1-processing-n:127.0.0.1:46042_) [n:127.0.0.1:46042_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 277360 INFO (zkCallback-65-thread-1-processing-n:127.0.0.1:35468_) [n:127.0.0.1:35468_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 277360 INFO (zkCallback-47-thread-2-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 277839 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 277910 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 277911 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 277931 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:35715_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001/cores
[junit4] 2> 278547 INFO (qtp903643061-396) [n:127.0.0.1:35468_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35715_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 278566 INFO (OverseerThreadFactory-230-thread-5-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35715_ for creating new replica
[junit4] 2> 278841 INFO (qtp230267489-425) [n:127.0.0.1:35715_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 278841 INFO (qtp230267489-425) [n:127.0.0.1:35715_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 279981 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 280087 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 280732 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 280932 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 280986 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e
[junit4] 2> 280986 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 280986 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 280989 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 281077 WARN (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 281552 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 281552 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 281553 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 281553 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 281554 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=91.4794921875, floorSegmentMB=1.72265625, forceMergeDeletesPctAllowed=24.2587726566871, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18168239024385502
[junit4] 2> 281608 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@2952f5c3[collection1_shard2_replica_t45] main]
[junit4] 2> 281610 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 281610 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 281611 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 281611 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580680480118800384
[junit4] 2> 281748 INFO (searcherExecutor-266-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@2952f5c3[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 281794 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 282186 INFO (updateExecutor-68-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 282203 INFO (qtp230267489-425) [n:127.0.0.1:35715_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3362
[junit4] 2> 282223 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 282304 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 282304 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 282304 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 282304 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 282304 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:46042/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:35715/collection1_shard2_replica_t45/]
[junit4] 2> 282357 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46042]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:35715_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 282358 INFO (qtp7341290-363) [n:127.0.0.1:46042_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 282576 INFO (qtp903643061-396) [n:127.0.0.1:35468_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35715_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=4029
[junit4] 2> 282577 INFO (qtp7341290-363) [n:127.0.0.1:46042_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:35715_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:35715","node_name":"127.0.0.1:35715_","state":"down","type":"TLOG"}
[junit4] 2> 282596 INFO (OverseerCollectionConfigSetProcessor-98792526962229252-127.0.0.1:35814_-n_0000000000) [n:127.0.0.1:35814_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 282989 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-4-001 of type TLOG
[junit4] 2> 282990 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 283008 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@282b8cd1{/,null,AVAILABLE}
[junit4] 2> 283008 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4bdcfe8a{HTTP/1.1,[http/1.1]}{127.0.0.1:34803}
[junit4] 2> 283009 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.e.j.s.Server Started @294864ms
[junit4] 2> 283009 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/tempDir-001/jetty4, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=34803, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-4-001/cores}
[junit4] 2> 283009 ERROR (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 283010 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 283010 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 283010 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 283010 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-08T09:19:37.733Z
[junit4] 2> 283082 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 283082 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_76FDCC75F0B376BF-001/shard-4-001/solr.xml
[junit4] 2> 283118 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 283118 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 283120 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fc9487e, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 283136 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40646/solr
[junit4] 2> 283279 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:34803_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 283313 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:34803_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 283315 INFO (TEST-ShardSplitTest.test-seed#[76FDCC75F0B376BF]) [n:127.0.0.1:34803_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34803_
[junit4] 2> 283316 INFO (zkCallback-59-thread-1-processing-n:127.0.0.1:46042_) [n:127.0.0.1:46042_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283329 INFO (zkCallback-71-thread-1-processing-n:127.0.0.1:35715_) [n:127.0.0.1:35715_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283330 INFO (zkCallback-47-thread-1-processing-n:127.0.0.1:35814_) [n:127.0.0.1:35814_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283349 INFO (zkCallback-65-thread-1-processing-n:127.0.0.1:35468_) [n:127.0.0.1:35468_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283350 INFO (zkCallback-78-thread-1-processing-n:127.0.0.1:34803_) [n:127.0.0.1:34803_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283353 INFO (zkCallback-54-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 283584 INFO (qtp7341290-363) [n:127.0.0.1:46042_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:35715_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:35715","node_name":"127.0.0.1:35715_","state":"recovering","type":"TLOG"}
[junit4] 2> 283584 INFO (qtp7341290-363) [n:127.0.0.1:46042_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4] 2> 283585 INFO (qtp7341290-363) [n:127.0.0.1:46042_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:35715_&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1226
[junit4] 2> 284202 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 284203 INFO (recoveryExecutor-69-thread-1-processing-n:127.0.0.1:35715_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35715_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:46042/collection1_shard2_replica_t41/].
[junit4] 2> 284658 I
[...truncated too long message...]
ull, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18f27f01
[junit4] 2> 5843969 INFO (jetty-closer-2040-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 5843985 INFO (jetty-closer-2040-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 5843985 INFO (jetty-closer-2040-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7db0c7bf: rootName = solr_45803, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@18f27f01
[junit4] 2> 5843987 INFO (jetty-closer-2040-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 5843988 INFO (jetty-closer-2040-thread-1) [ ] o.a.s.c.Overseer Overseer (id=98792883491176465-127.0.0.1:45803_solr-n_0000000004) closing
[junit4] 2> 5843988 INFO (OverseerStateUpdate-98792883491176465-127.0.0.1:45803_solr-n_0000000004) [n:127.0.0.1:45803_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45803_solr
[junit4] 2> 5844008 INFO (zkCallback-2080-thread-2-processing-n:127.0.0.1:45803_solr) [n:127.0.0.1:45803_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 5844021 WARN (OverseerAutoScalingTriggerThread-98792883491176465-127.0.0.1:45803_solr-n_0000000004) [n:127.0.0.1:45803_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 5844023 WARN (zkCallback-2080-thread-2-processing-n:127.0.0.1:45803_solr) [n:127.0.0.1:45803_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 5844024 INFO (jetty-closer-2040-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@12490701{/solr,null,UNAVAILABLE}
[junit4] 2> 5845508 WARN (zkCallback-2108-thread-2-processing-n:127.0.0.1:41767_solr) [n:127.0.0.1:41767_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 5845509 INFO (jetty-closer-2040-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@5a2b87bd{/solr,null,UNAVAILABLE}
[junit4] 2> 5845510 ERROR (SUITE-TestTlogReplica-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 5845510 INFO (SUITE-TestTlogReplica-seed#[76FDCC75F0B376BF]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34518 34518
[junit4] 2> 5845640 INFO (Thread-2859) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:34518 34518
[junit4] 2> 5845641 WARN (Thread-2859) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 33 /solr/configs/conf
[junit4] 2> 10 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 40 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 40 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 29 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 25 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 24 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 10 /solr/clusterprops.json
[junit4] 2> 10 /solr/clusterstate.json
[junit4] 2> 6 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98792883491176465-core_node3-n_0000000000
[junit4] 2> 4 /solr/autoscaling.json
[junit4] 2> 4 /solr/overseer_elect/election/98792883491176465-127.0.0.1:45803_solr-n_0000000004
[junit4] 2> 2 /solr/overseer_elect/election/98792883491176452-127.0.0.1:41767_solr-n_0000000000
[junit4] 2> 2 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard1/election/98792883491176452-core_node12-n_0000000001
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 10 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 3 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.TestTlogReplica_76FDCC75F0B376BF-001
[junit4] 2> Oct 08, 2017 10:52:20 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=hi-IN, timezone=CAT
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=297652880,total=524812288
[junit4] 2> NOTE: All tests run in this JVM: [TestLuceneIndexBackCompat, DistributedSpellCheckComponentTest, CoreAdminRequestStatusTest, SpellCheckCollatorTest, TestGeoJSONResponseWriter, SolrGangliaReporterTest, ActionThrottleTest, ShardSplitTest, ExitableDirectoryReaderTest, TestSSLRandomization, BinaryUpdateRequestHandlerTest, TestComponentsName, TestFilteredDocIdSet, TestSolrQueryParser, TestTolerantUpdateProcessorCloud, TestLegacyTerms, SyncSliceTest, TestDocTermOrds, CloneFieldUpdateProcessorFactoryTest, RequestHandlersTest, TestReplicationHandler, TestPivotHelperCode, TestLuceneMatchVersion, DistributedVersionInfoTest, MultiThreadedOCPTest, TestJsonFacets, RAMDirectoryFactoryTest, InfixSuggestersTest, TestBackupRepositoryFactory, TestWordDelimiterFilterFactory, TestFunctionQuery, LeaderFailoverAfterPartitionTest, HighlighterMaxOffsetTest, HighlighterConfigTest, TestInitQParser, TestDefaultStatsCache, SpellingQueryConverterTest, HdfsSyncSliceTest, TestZkAclsWithHadoopAuth, TestFaceting, WordBreakSolrSpellCheckerTest, TestPhraseSuggestions, TestExtendedDismaxParser, TestConfig, DeleteShardTest, LeaderElectionIntegrationTest, CreateCollectionCleanupTest, TestCloudRecovery, OverseerRolesTest, TestMissingGroups, TestRandomFlRTGCloud, TestPrepRecovery, TestBulkSchemaAPI, TestRemoteStreaming, MergeStrategyTest, SuggesterWFSTTest, ExternalFileFieldSortTest, PeerSyncReplicationTest, AnalyticsQueryTest, TestQuerySenderNoQuery, DebugComponentTest, TestBlendedInfixSuggestions, SolrRequestParserTest, TestBlobHandler, TestSolrConfigHandlerConcurrent, TestLMDirichletSimilarityFactory, TestSubQueryTransformer, LeaderInitiatedRecoveryOnShardRestartTest, TestRandomDVFaceting, SolrShardReporterTest, SolrCoreTest, CollectionTooManyReplicasTest, TestOverriddenPrefixQueryForCustomFieldType, MBeansHandlerTest, TestDynamicFieldResource, TestSizeLimitedDistributedMap, UUIDFieldTest, SolrPluginUtilsTest, FieldAnalysisRequestHandlerTest, EchoParamsTest, TestSolr4Spatial, OutputWriterTest, TestRealTimeGet, TestMergePolicyConfig, UninvertDocValuesMergePolicyTest, BasicZkTest, BasicDistributedZkTest, TestHighlightDedupGrouping, DateRangeFieldTest, ChaosMonkeySafeLeaderWithPullReplicasTest, TestJoin, DefaultValueUpdateProcessorTest, TestTestInjection, BasicAuthStandaloneTest, TestDocumentBuilder, BlockJoinFacetRandomTest, TestExclusionRuleCollectionAccess, TestUseDocValuesAsStored, RollingRestartTest, TestDelegationWithHadoopAuth, TestStandardQParsers, SolrMetricManagerTest, TestCloudNestedDocsSort, DeleteLastCustomShardedReplicaTest, TestNumericTerms64, SolrCLIZkUtilsTest, TestCSVResponseWriter, TestConfigSetProperties, DistributedFacetPivotSmallTest, TestIndexingPerformance, DistributedDebugComponentTest, TestExactStatsCache, ConjunctionSolrSpellCheckerTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestInfoStreamLogging, TestRangeQuery, SystemLogListenerTest, TestPKIAuthenticationPlugin, SolrIndexSplitterTest, TestSchemaResource, HdfsChaosMonkeySafeLeaderTest, TestCloudSchemaless, TestFastOutputStream, TestTlogReplica]
[junit4] Completed [539/745 (2!)] on J0 in 171.16s, 13 tests, 1 failure <<< FAILURES!
[...truncated 47623 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:706: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:693: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* lucene/licenses/morfologik-ukrainian-search-3.7.5.jar.sha1
Total time: 283 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2114 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2114/
6 tests failed.
FAILED: org.apache.solr.cloud.ShardSplitTest.test
Error Message:
Could not load collection from ZK: routeFieldColl
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: routeFieldColl
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:301FF1CF17DBDB63]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:154)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:908)
at org.apache.solr.cloud.ShardSplitTest.splitByRouteFieldTest(ShardSplitTest.java:736)
at org.apache.solr.cloud.ShardSplitTest.test(ShardSplitTest.java:101)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/routeFieldColl/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 49 more
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
expected:<COMPLETED> but was:<RUNNING>
Stack Trace:
java.lang.AssertionError: expected:<COMPLETED> but was:<RUNNING>
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:301FF1CF17DBDB63]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:147)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.testBackupAndRestore(AbstractCloudBackupRestoreTestCase.java:277)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration
Error Message:
Path /autoscaling/nodeLost/127.0.0.1:34415_solr exists
Stack Trace:
java.lang.AssertionError: Path /autoscaling/nodeLost/127.0.0.1:34415_solr exists
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:A0F14619B7127B74]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.autoscaling.TriggerIntegrationTest.testNodeMarkersRegistration(TriggerIntegrationTest.java:856)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication
Error Message:
Index: 0, Size: 0
Stack Trace:
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:AC0395409A200B85]:0)
at java.util.ArrayList.rangeCheck(ArrayList.java:653)
at java.util.ArrayList.get(ArrayList.java:429)
at org.apache.solr.handler.TestReplicationHandler.doTestIndexAndConfigReplication(TestReplicationHandler.java:561)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test
Error Message:
Error from server at http://127.0.0.1:39198/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard1 saw state=DocCollection(collection1//collections/collection1/state.json/18)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{ "core_node44":{ "core":"collection1_shard1_replica_t43", "base_url":"http://127.0.0.1:35847", "node_name":"127.0.0.1:35847_", "state":"down", "type":"TLOG"}, "core_node48":{ "core":"collection1_shard1_replica_t47", "base_url":"http://127.0.0.1:44402", "node_name":"127.0.0.1:44402_", "state":"down", "type":"TLOG"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{ "core_node42":{ "core":"collection1_shard2_replica_t41", "base_url":"http://127.0.0.1:38212", "node_name":"127.0.0.1:38212_", "state":"active", "type":"TLOG", "leader":"true"}, "core_node46":{ "core":"collection1_shard2_replica_t45", "base_url":"http://127.0.0.1:39198", "node_name":"127.0.0.1:39198_", "state":"active", "type":"TLOG"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:36912_, 127.0.0.1:38212_, 127.0.0.1:44402_, 127.0.0.1:39198_]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39198/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard1 saw state=DocCollection(collection1//collections/collection1/state.json/18)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{
"core_node44":{
"core":"collection1_shard1_replica_t43",
"base_url":"http://127.0.0.1:35847",
"node_name":"127.0.0.1:35847_",
"state":"down",
"type":"TLOG"},
"core_node48":{
"core":"collection1_shard1_replica_t47",
"base_url":"http://127.0.0.1:44402",
"node_name":"127.0.0.1:44402_",
"state":"down",
"type":"TLOG"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{
"core_node42":{
"core":"collection1_shard2_replica_t41",
"base_url":"http://127.0.0.1:38212",
"node_name":"127.0.0.1:38212_",
"state":"active",
"type":"TLOG",
"leader":"true"},
"core_node46":{
"core":"collection1_shard2_replica_t45",
"base_url":"http://127.0.0.1:39198",
"node_name":"127.0.0.1:39198_",
"state":"active",
"type":"TLOG"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"} with live_nodes=[127.0.0.1:36912_, 127.0.0.1:38212_, 127.0.0.1:44402_, 127.0.0.1:39198_]
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:301FF1CF17DBDB63]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:507)
at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:683)
at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:377)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<3>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<3>
at __randomizedtesting.SeedInfo.seed([B84BCE15B927B69B:A44AB398CC82C808]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 12719 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> 3754785 INFO (SUITE-BasicDistributedZkTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/init-core-data-001
[junit4] 2> 3754786 WARN (SUITE-BasicDistributedZkTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 3754803 INFO (SUITE-BasicDistributedZkTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 3754804 INFO (SUITE-BasicDistributedZkTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 3754804 INFO (SUITE-BasicDistributedZkTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 3754806 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 3754839 INFO (Thread-2157) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 3754839 INFO (Thread-2157) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 3754912 ERROR (Thread-2157) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3754949 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ZkTestServer start zk server on port:39255
[junit4] 2> 3755244 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 3755245 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 3755258 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 3755259 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 3755259 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 3755260 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 3755261 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 3755261 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 3755295 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 3755295 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 3755296 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 3755306 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 3756678 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3756811 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47cc450c{/,null,AVAILABLE}
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2d5ad49e{HTTP/1.1,[http/1.1]}{127.0.0.1:36912}
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server Started @3775626ms
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/tempDir-001/control/data, hostContext=/, hostPort=36912, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/control-001/cores}
[junit4] 2> 3756812 ERROR (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3756812 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-06T13:04:52.800Z
[junit4] 2> 3756847 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3756848 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/control-001/solr.xml
[junit4] 2> 3756851 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 3756851 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 3756864 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3756922 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39255/solr
[junit4] 2> 3759630 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3759630 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36912_
[junit4] 2> 3759630 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.c.Overseer Overseer (id=98782091074863108-127.0.0.1:36912_-n_0000000000) starting
[junit4] 2> 3759657 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36912_
[junit4] 2> 3759701 INFO (OverseerStateUpdate-98782091074863108-127.0.0.1:36912_-n_0000000000) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3759953 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3759990 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3760002 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3760004 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:36912_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/control-001/cores
[junit4] 2> 3760079 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3760096 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39255/solr ready
[junit4] 2> 3760098 INFO (qtp1501889536-11665) [n:127.0.0.1:36912_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36912_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3760177 INFO (OverseerThreadFactory-4429-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 3760459 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 3760459 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3760841 INFO (zkCallback-2876-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3761871 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3761996 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 3763302 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3763615 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 3763615 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3763616 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3763616 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 3763667 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=36.27734375, floorSegmentMB=1.91796875, forceMergeDeletesPctAllowed=5.751706430825443, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3763742 WARN (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3764047 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3764047 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3764065 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3764065 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3764066 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=30.798828125, floorSegmentMB=1.7646484375, forceMergeDeletesPctAllowed=24.473627875811104, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3764066 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@607ec79c[control_collection_shard1_replica_n1] main]
[junit4] 2> 3764068 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3764069 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3764069 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3764071 INFO (searcherExecutor-4432-thread-1-processing-n:127.0.0.1:36912_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@607ec79c[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3764071 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580513466839465984
[junit4] 2> 3764230 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3764230 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3764230 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36912/control_collection_shard1_replica_n1/
[junit4] 2> 3764231 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3764231 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:36912/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 3764231 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3764232 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36912/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 3764392 INFO (zkCallback-2876-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3764412 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3764530 INFO (qtp1501889536-11669) [n:127.0.0.1:36912_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=4071
[junit4] 2> 3764838 INFO (qtp1501889536-11665) [n:127.0.0.1:36912_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3765001 INFO (zkCallback-2876-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 3765844 INFO (qtp1501889536-11665) [n:127.0.0.1:36912_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36912_&wt=javabin&version=2} status=0 QTime=5746
[junit4] 2> 3766109 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3766109 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:39255/solr ready
[junit4] 2> 3766109 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 3766110 INFO (qtp1501889536-11668) [n:127.0.0.1:36912_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3766129 INFO (OverseerThreadFactory-4429-thread-2-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 3766134 INFO (OverseerCollectionConfigSetProcessor-98782091074863108-127.0.0.1:36912_-n_0000000000) [n:127.0.0.1:36912_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3766202 WARN (OverseerThreadFactory-4429-thread-2-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 3766536 INFO (qtp1501889536-11668) [n:127.0.0.1:36912_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 3766537 INFO (qtp1501889536-11668) [n:127.0.0.1:36912_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=426
[junit4] 2> 3766537 INFO (OverseerCollectionConfigSetProcessor-98782091074863108-127.0.0.1:36912_-n_0000000000) [n:127.0.0.1:36912_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3767666 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001 of type TLOG
[junit4] 2> 3767667 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1c40be6d{/,null,AVAILABLE}
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4fb8cce5{HTTP/1.1,[http/1.1]}{127.0.0.1:38212}
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server Started @3786482ms
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=38212, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001/cores}
[junit4] 2> 3767668 ERROR (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3767668 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3767669 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-06T13:05:03.657Z
[junit4] 2> 3767711 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3767711 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001/solr.xml
[junit4] 2> 3767714 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 3767714 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 3767772 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3767825 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39255/solr
[junit4] 2> 3768022 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 3768039 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3768041 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38212_
[junit4] 2> 3768056 INFO (zkCallback-2876-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3768166 INFO (zkCallback-2883-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3768169 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 3768784 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3768916 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3768916 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3768917 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:38212_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001/cores
[junit4] 2> 3769172 INFO (qtp1501889536-11672) [n:127.0.0.1:36912_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38212_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3769187 INFO (OverseerThreadFactory-4429-thread-3-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:38212_ for creating new replica
[junit4] 2> 3769228 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3769228 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3769246 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3770341 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3770466 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 3771343 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3771399 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 3771399 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3771399 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3771399 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 3771434 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=36.27734375, floorSegmentMB=1.91796875, forceMergeDeletesPctAllowed=5.751706430825443, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3771436 WARN (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3772014 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3772014 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3772015 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3772015 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3772016 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=30.798828125, floorSegmentMB=1.7646484375, forceMergeDeletesPctAllowed=24.473627875811104, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3772016 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@8824b4a[collection1_shard2_replica_t41] main]
[junit4] 2> 3772018 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3772018 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3772019 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3772019 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580513475173548032
[junit4] 2> 3772075 INFO (searcherExecutor-4443-thread-1-processing-n:127.0.0.1:38212_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@8824b4a[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38212/collection1_shard2_replica_t41/
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:38212/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3772092 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 3772094 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38212/collection1_shard2_replica_t41/ shard2
[junit4] 2> 3772108 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3772144 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3772146 INFO (qtp175025974-11715) [n:127.0.0.1:38212_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2917
[junit4] 2> 3772147 INFO (qtp1501889536-11672) [n:127.0.0.1:36912_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:38212_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=2975
[junit4] 2> 3772254 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 3772789 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001 of type TLOG
[junit4] 2> 3772790 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 3772843 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@30f64ede{/,null,AVAILABLE}
[junit4] 2> 3772843 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7a12e9fb{HTTP/1.1,[http/1.1]}{127.0.0.1:35847}
[junit4] 2> 3772843 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.e.j.s.Server Started @3791657ms
[junit4] 2> 3772843 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=35847, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001/cores}
[junit4] 2> 3772844 ERROR (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 3772880 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 8.0.0
[junit4] 2> 3772880 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 3772880 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 3772880 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-06T13:05:08.868Z
[junit4] 2> 3772990 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 3772990 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001/solr.xml
[junit4] 2> 3772993 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 3772993 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 3773172 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 3773203 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39255/solr
[junit4] 2> 3773205 INFO (OverseerCollectionConfigSetProcessor-98782091074863108-127.0.0.1:36912_-n_0000000000) [n:127.0.0.1:36912_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 3773531 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 3773532 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 3773546 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35847_
[junit4] 2> 3773551 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3773559 INFO (zkCallback-2883-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3773632 INFO (zkCallback-2876-thread-1-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3773648 INFO (zkCallback-2894-thread-1-processing-n:127.0.0.1:35847_) [n:127.0.0.1:35847_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 3773950 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3774024 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3774025 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3774059 INFO (TEST-BasicDistributedZkTest.test-seed#[B84BCE15B927B69B]) [n:127.0.0.1:35847_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001/cores
[junit4] 2> 3774446 INFO (qtp1987124276-11744) [n:127.0.0.1:35847_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35847_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 3774483 INFO (OverseerThreadFactory-4429-thread-4-processing-n:127.0.0.1:36912_) [n:127.0.0.1:36912_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35847_ for creating new replica
[junit4] 2> 3774490 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 3774490 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 3774613 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3774668 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 3774778 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 3775647 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 3775699 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 3775699 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@16df48a8
[junit4] 2> 3775699 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 3775700 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_B84BCE15B927B69B-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 3775718 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=36.27734375, floorSegmentMB=1.91796875, forceMergeDeletesPctAllowed=5.751706430825443, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3775735 WARN (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 3776035 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 3776036 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 3776037 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 3776037 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 3776038 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=30.798828125, floorSegmentMB=1.7646484375, forceMergeDeletesPctAllowed=24.473627875811104, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 3776038 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b53f242[collection1_shard1_replica_t43] main]
[junit4] 2> 3776084 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 3776084 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 3776085 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 3776085 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580513479437058048
[junit4] 2> 3776145 INFO (searcherExecutor-4454-thread-1-processing-n:127.0.0.1:35847_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@6b53f242[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35847/collection1_shard1_replica_t43/
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:35847/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 3776158 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 3776160 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35847/collection1_shard1_replica_t43/ shard1
[junit4] 2> 3776336 INFO (zkCallback-2894-thread-1-processing-n:127.0.0.1:35847_) [n:127.0.0.1:35847_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3776339 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 3776339 INFO (zkCallback-2888-thread-1-processing-n:127.0.0.1:38212_) [n:127.0.0.1:38212_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 3776358 INFO (qtp1987124276-11742) [n:127.0.0.1:35847_ c:collection1 s:
[...truncated too long message...]
dler Stopped o.e.j.s.ServletContextHandler@44cf2433{/solr,null,UNAVAILABLE}
[junit4] 2> 6934826 INFO (jetty-closer-5339-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 6934827 INFO (jetty-closer-5339-thread-4) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 6936233 WARN (zkCallback-5528-thread-1-processing-n:127.0.0.1:33302_solr) [n:127.0.0.1:33302_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 6936233 INFO (jetty-closer-5339-thread-6) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7eb43acc{/solr,null,UNAVAILABLE}
[junit4] 2> 6936303 WARN (zkCallback-5433-thread-3-processing-n:127.0.0.1:34498_solr) [n:127.0.0.1:34498_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 6936307 INFO (jetty-closer-5339-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7b93c0fe{/solr,null,UNAVAILABLE}
[junit4] 2> 6936343 WARN (zkCallback-5482-thread-2-processing-n:127.0.0.1:42358_solr) [n:127.0.0.1:42358_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 6936344 INFO (jetty-closer-5339-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@74b6165c{/solr,null,UNAVAILABLE}
[junit4] 2> 6936361 ERROR (SUITE-TriggerIntegrationTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 6936361 INFO (SUITE-TriggerIntegrationTest-seed#[B84BCE15B927B69B]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43243 43243
[junit4] 2> 6936730 INFO (Thread-5416) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43243 43243
[junit4] 2> 6936730 WARN (Thread-5416) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 45 /solr/aliases.json
[junit4] 2> 13 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 45 /solr/clusterprops.json
[junit4] 2> 45 /solr/clusterstate.json
[junit4] 2> 5 /solr/autoscaling.json
[junit4] 2> 2 /solr/overseer_elect/election/98782291788300343-127.0.0.1:42358_solr-n_0000000009
[junit4] 2> 2 /solr/overseer_elect/election/98782291788300293-127.0.0.1:36793_solr-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/98782291788300325-127.0.0.1:34498_solr-n_0000000006
[junit4] 2> 2 /solr/overseer_elect/election/98782291788300314-127.0.0.1:38700_solr-n_0000000004
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 45 /solr/collections
[junit4] 2> 38 /solr/live_nodes
[junit4] 2> 5 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 5 /solr/overseer/queue-work
[junit4] 2> 5 /solr/overseer/collection-queue-work
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 3 /solr/autoscaling/events/node_added_trigger
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.autoscaling.TriggerIntegrationTest_B84BCE15B927B69B-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=7, maxDocsPerChunk=580, blockSize=486), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=7, blockSize=486)), sim=RandomSimilarity(queryNorm=true): {}, locale=th, timezone=America/Chihuahua
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=134791568,total=520617984
[junit4] 2> NOTE: All tests run in this JVM: [SolrTestCaseJ4Test, RecoveryZkTest, SortSpecParsingTest, TestHdfsBackupRestoreCore, SuggesterFSTTest, TestReload, QueryEqualityTest, TestSlowCompositeReaderWrapper, TestTrie, DistributedFacetExistsSmallTest, CheckHdfsIndexTest, SuggesterTest, SmileWriterTest, MoveReplicaTest, TestReloadDeadlock, AtomicUpdatesTest, VersionInfoTest, CopyFieldTest, SolrJmxReporterCloudTest, PingRequestHandlerTest, TestChildDocTransformer, MinimalSchemaTest, TestSurroundQueryParser, TestConfigSetsAPI, SignatureUpdateProcessorFactoryTest, TestSolrCloudWithHadoopAuthPlugin, TestOrdValues, TestRebalanceLeaders, MultiTermTest, TestManagedStopFilterFactory, TermVectorComponentDistributedTest, XsltUpdateRequestHandlerTest, TestOnReconnectListenerSupport, SortByFunctionTest, TestStressReorder, SecurityConfHandlerTest, LargeFieldTest, UnloadDistributedZkTest, ResponseLogComponentTest, MissingSegmentRecoveryTest, TestEmbeddedSolrServerConstructors, TestSolrDeletionPolicy2, ShowFileRequestHandlerTest, CollectionStateFormat2Test, ConnectionReuseTest, TestLFUCache, LeaderElectionTest, AutoScalingHandlerTest, TestExactSharedStatsCache, TestUtils, TimeZoneUtilsTest, TestSubQueryTransformerDistrib, TestSchemaNameResource, TestFieldCacheVsDocValues, TestAnalyzeInfixSuggestions, FullSolrCloudDistribCmdsTest, TestRestManager, TestJsonFacetRefinement, GraphQueryTest, TestZkChroot, TestHttpShardHandlerFactory, SaslZkACLProviderTest, TestAuthorizationFramework, TestIndexSearcher, TestJmxIntegration, RulesTest, OverseerTest, RestartWhileUpdatingTest, TestDistributedMissingSort, InfoHandlerTest, ResponseHeaderTest, TestDocBasedVersionConstraints, TestLMJelinekMercerSimilarityFactory, BasicAuthIntegrationTest, TestFieldResource, OutOfBoxZkACLAndCredentialsProvidersTest, DistributedQueryComponentCustomSortTest, TestSimpleTextCodec, PolyFieldTest, FacetPivotSmallTest, TestJavabinTupleStreamParser, BaseCdcrDistributedZkTest, TestRawTransformer, TestExportWriter, OverseerTaskQueueTest, NotRequiredUniqueKeyTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestApiFramework, DistributedQueueTest, TestSolrCLIRunExample, TestRestoreCore, SimpleCollectionCreateDeleteTest, ZkFailoverTest, TermsComponentTest, V2ApiIntegrationTest, TestAnalyzedSuggestions, TestCoreAdminApis, TestSuggestSpellingConverter, TestSolrFieldCacheBean, TestNoOpRegenerator, AddBlockUpdateTest, StatsComponentTest, SolrMetricsIntegrationTest, HdfsRestartWhileUpdatingTest, ClassificationUpdateProcessorTest, SolrCoreMetricManagerTest, SolrCoreCheckLockOnStartupTest, UniqFieldsUpdateProcessorFactoryTest, CdcrReplicationHandlerTest, SolrXmlInZkTest, MetricUtilsTest, TestCloudManagedSchema, DateMathParserTest, QueryResultKeyTest, TestCloudPseudoReturnFields, TestSolrCloudWithDelegationTokens, TestRecovery, TestSolrConfigHandlerCloud, AnalyticsMergeStrategyTest, TestPseudoReturnFields, SyncSliceTest, OpenCloseCoreStressTest, ShardRoutingTest, TestRandomDVFaceting, AutoCommitTest, ZkControllerTest, HardAutoCommitTest, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, TestGroupingSearch, PeerSyncTest, TestSort, TestLazyCores, TestExtendedDismaxParser, CoreAdminHandlerTest, TestStressLucene, WordBreakSolrSpellCheckerTest, TestUpdate, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, TestRemoteStreaming, DistanceFunctionTest, SolrInfoBeanTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestQueryTypes, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, UpdateParamsTest, TestQuerySenderNoQuery, TestConfig, TestSolrCoreProperties, TestPhraseSuggestions, TestCodecSupport, TestFastWriter, ScriptEngineTest, URLClassifyProcessorTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestTolerantSearch, TestLuceneIndexBackCompat, ActionThrottleTest, AliasIntegrationTest, CdcrBootstrapTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CollectionsAPISolrJTest, DistribCursorPagingTest, HealthCheckHandlerTest, HttpPartitionTest, MigrateRouteKeyTest, PeerSyncReplicationTest, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, TestLeaderInitiatedRecoveryThread, TestLockTree, TestPullReplicaErrorHandling, TestRandomFlRTGCloud, TestSkipOverseerOperations, TestTlogReplica, ComputePlanActionTest, SystemLogListenerTest, TriggerIntegrationTest]
[junit4] Completed [576/745 (6!)] on J2 in 116.87s, 10 tests, 1 failure <<< FAILURES!
[...truncated 47452 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:706: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:693: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* lucene/licenses/morfologik-ukrainian-search-3.7.5.jar.sha1
Total time: 365 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2113 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2113/
14 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZkTest.test
Error Message:
Timeout occured while waiting response from server at: http://127.0.0.1:34457/_ps/jb/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:34457/_ps/jb/collection1
at __randomizedtesting.SeedInfo.seed([B21118C8265C7D88:3A45271288A01070]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:637)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:507)
at org.apache.solr.BaseDistributedSearchTestCase.indexDoc(BaseDistributedSearchTestCase.java:496)
at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:172)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.SocketTimeoutException: Read timed out
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.socketRead(SocketInputStream.java:116)
at java.net.SocketInputStream.read(SocketInputStream.java:171)
at java.net.SocketInputStream.read(SocketInputStream.java:141)
at org.apache.http.impl.io.SessionInputBufferImpl.streamRead(SessionInputBufferImpl.java:137)
at org.apache.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:153)
at org.apache.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:282)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:138)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:163)
at org.apache.http.impl.conn.CPoolProxy.receiveResponseHeader(CPoolProxy.java:165)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:272)
at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:185)
at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:89)
at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:111)
at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:185)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:83)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:525)
... 48 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.CdcrBootstrapTest
Error Message:
ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, InternalHttpClient, SolrCore, MockDirectoryWrapper] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92) at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844) at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033) at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947) at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91) at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384) at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174) at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177) at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745) at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726) at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382) at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139) at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759) at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582) at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224) at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180) at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512) at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185) at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112) at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134) at org.eclipse.jetty.server.Server.handle(Server.java:534) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108) at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298) at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:222) at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:260) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:417) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020) at org.apache.solr.core.SolrCore.reload(SolrCore.java:637) at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1281) at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494) at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338) at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768) at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723) at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 6 object(s) that were not released!!! [MockDirectoryWrapper, MockDirectoryWrapper, MockDirectoryWrapper, InternalHttpClient, SolrCore, MockDirectoryWrapper]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.getNewIndexDir(SolrCore.java:350)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:710)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.core.SolrCore.initSnapshotMetaDataManager(SolrCore.java:479)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:929)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.update.SolrIndexWriter.create(SolrIndexWriter.java:92)
at org.apache.solr.core.SolrCore.initIndex(SolrCore.java:742)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:935)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:844)
at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1033)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:947)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)
at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:745)
at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:726)
at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:507)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
at org.eclipse.jetty.server.Server.handle(Server.java:534)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:298)
at org.apache.solr.handler.IndexFetcher.createHttpClient(IndexFetcher.java:222)
at org.apache.solr.handler.IndexFetcher.<init>(IndexFetcher.java:260)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:417)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.core.SolrCore
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1020)
at org.apache.solr.core.SolrCore.reload(SolrCore.java:637)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1281)
at org.apache.solr.handler.IndexFetcher.lambda$reloadCore$0(IndexFetcher.java:910)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.lucene.store.MockDirectoryWrapper
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:348)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:494)
at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:338)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:421)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:768)
at org.apache.solr.handler.CdcrRequestHandler$BootstrapCallable.call(CdcrRequestHandler.java:723)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedCallable.call(InstrumentedExecutorService.java:197)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([B21118C8265C7D88]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.SolrTestCaseJ4.teardownTestCases(SolrTestCaseJ4.java:294)
at sun.reflect.GeneratedMethodAccessor52.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:897)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitStaticIndexReplication
Error Message:
Could not load collection from ZK: control_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: control_collection
at __randomizedtesting.SeedInfo.seed([B21118C8265C7D88:F85B8CC8B7F4528D]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:130)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:110)
at org.apache.solr.cloud.ShardSplitTest.testSplitStaticIndexReplication(ShardSplitTest.java:189)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/control_collection/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 45 more
FAILED: org.apache.solr.cloud.TestAuthenticationFramework.testBasics
Error Message:
Error from server at https://127.0.0.1:37963/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:37963/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([B21118C8265C7D88:8FC9B6E41EB223F8]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestAuthenticationFramework.collectionCreateSearchDeleteTwice(TestAuthenticationFramework.java:126)
at org.apache.solr.cloud.TestAuthenticationFramework.testBasics(TestAuthenticationFramework.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37963/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:590)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection
Error Message:
Error from server at http://127.0.0.1:43908/solr/tlog_replica_test_basic_leader_election: ClusterState says we are the leader (http://127.0.0.1:43908/solr/tlog_replica_test_basic_leader_election_shard1_replica_t2), but locally we don't think so. Request came from null
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:43908/solr/tlog_replica_test_basic_leader_election: ClusterState says we are the leader (http://127.0.0.1:43908/solr/tlog_replica_test_basic_leader_election_shard1_replica_t2), but locally we don't think so. Request came from null
at __randomizedtesting.SeedInfo.seed([B21118C8265C7D88:2499DE80CEC63A72]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.cloud.TestTlogReplica.testBasicLeaderElection(TestTlogReplica.java:634)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testOverwriteOption
Error Message:
Error from server at http://127.0.0.1:39820/solr: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-12207324-453a-4380-b5f7-567c06f2a7d3
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39820/solr: KeeperErrorCode = Session expired for /overseer/collection-map-completed/mn-12207324-453a-4380-b5f7-567c06f2a7d3
at __randomizedtesting.SeedInfo.seed([9661FE67A1868730:7A5A1F8CCFD6F8E6]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.client.solrj.request.CollectionAdminRequest$RequestStatus.waitFor(CollectionAdminRequest.java:1221)
at org.apache.solr.client.solrj.request.CollectionAdminRequest$AsyncCollectionAdminRequest.processAndWait(CollectionAdminRequest.java:190)
at org.apache.solr.client.solrj.request.CollectionAdminRequest$AsyncCollectionAdminRequest.processAndWait(CollectionAdminRequest.java:176)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.testOverwriteOption(CloudSolrClientTest.java:154)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testHandlingOfStaleAlias
Error Message:
Error from server at http://127.0.0.1:37405/solr/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard2 saw state=DocCollection(collection1//collections/collection1/state.json/8)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{"core_node3":{ "core":"collection1_shard1_replica_n1", "base_url":"http://127.0.0.1:37405/solr", "node_name":"127.0.0.1:37405_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{"core_node4":{ "core":"collection1_shard2_replica_n2", "base_url":"http://127.0.0.1:39820/solr", "node_name":"127.0.0.1:39820_solr", "state":"down", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:37405_solr]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37405/solr/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard2 saw state=DocCollection(collection1//collections/collection1/state.json/8)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node3":{
"core":"collection1_shard1_replica_n1",
"base_url":"http://127.0.0.1:37405/solr",
"node_name":"127.0.0.1:37405_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{"core_node4":{
"core":"collection1_shard2_replica_n2",
"base_url":"http://127.0.0.1:39820/solr",
"node_name":"127.0.0.1:39820_solr",
"state":"down",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"} with live_nodes=[127.0.0.1:37405_solr]
at __randomizedtesting.SeedInfo.seed([9661FE67A1868730:861CB9AE546587A7]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.cleanIndex(CloudSolrClientTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.impl.CloudSolrClientTest.testShutdown
Error Message:
Error from server at http://127.0.0.1:37405/solr/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard2 saw state=DocCollection(collection1//collections/collection1/state.json/8)={ "pullReplicas":"0", "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{"core_node3":{ "core":"collection1_shard1_replica_n1", "base_url":"http://127.0.0.1:37405/solr", "node_name":"127.0.0.1:37405_solr", "state":"active", "type":"NRT", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{"core_node4":{ "core":"collection1_shard2_replica_n2", "base_url":"http://127.0.0.1:39820/solr", "node_name":"127.0.0.1:39820_solr", "state":"down", "type":"NRT", "leader":"true"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1", "autoAddReplicas":"false", "nrtReplicas":"1", "tlogReplicas":"0"} with live_nodes=[127.0.0.1:37405_solr]
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37405/solr/collection1: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard2 saw state=DocCollection(collection1//collections/collection1/state.json/8)={
"pullReplicas":"0",
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node3":{
"core":"collection1_shard1_replica_n1",
"base_url":"http://127.0.0.1:37405/solr",
"node_name":"127.0.0.1:37405_solr",
"state":"active",
"type":"NRT",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{"core_node4":{
"core":"collection1_shard2_replica_n2",
"base_url":"http://127.0.0.1:39820/solr",
"node_name":"127.0.0.1:39820_solr",
"state":"down",
"type":"NRT",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1",
"autoAddReplicas":"false",
"nrtReplicas":"1",
"tlogReplicas":"0"} with live_nodes=[127.0.0.1:37405_solr]
at __randomizedtesting.SeedInfo.seed([9661FE67A1868730:7517F7F246FC1242]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.impl.CloudSolrClientTest.cleanIndex(CloudSolrClientTest.java:127)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.graph.GraphExpressionTest.testGatherNodesFriendsStream
Error Message:
org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
Stack Trace:
java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at __randomizedtesting.SeedInfo.seed([9661FE67A1868730:950D86194CA6FF8B]:0)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.constructStreams(CloudSolrStream.java:383)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.open(CloudSolrStream.java:274)
at org.apache.solr.client.solrj.io.graph.GatherNodesStream.open(GatherNodesStream.java:405)
at org.apache.solr.client.solrj.io.graph.GraphExpressionTest.getTuples(GraphExpressionTest.java:930)
at org.apache.solr.client.solrj.io.graph.GraphExpressionTest.testGatherNodesFriendsStream(GraphExpressionTest.java:703)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1170)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:690)
at org.apache.solr.common.cloud.ClusterState.getCollectionsMap(ClusterState.java:146)
at org.apache.solr.client.solrj.io.stream.TupleStream.getSlices(TupleStream.java:167)
at org.apache.solr.client.solrj.io.stream.TupleStream.getShards(TupleStream.java:141)
at org.apache.solr.client.solrj.io.stream.CloudSolrStream.constructStreams(CloudSolrStream.java:368)
... 43 more
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1182)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1168)
... 48 more
FAILED: org.apache.solr.client.solrj.io.graph.GraphExpressionTest.testGatherNodesStream
Error Message:
Could not find a healthy node to handle the request.
Stack Trace:
org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
at __randomizedtesting.SeedInfo.seed([9661FE67A1868730:1F36F9B24F98F1B0]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1115)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:967)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.client.solrj.io.graph.GraphExpressionTest.cleanIndex(GraphExpressionTest.java:96)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.client.solrj.io.graph.GraphExpressionTest.testShortestPathStream
Error Message:
java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException: org.apache.solr.common.SolrException: Could not load collection from ZK: collection1
Stack Trace:
java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.io.IOException
[...truncated too long message...]
cutor-420-thread-7) [n:127.0.0.1:37405_solr c:multicollection1 s:shard1 r:core_node3 x:multicollection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection1.shard1.leader, tag=1090426143
[junit4] 2> 433447 INFO (coreCloseExecutor-420-thread-8) [n:127.0.0.1:37405_solr c:foo s:shard1 r:core_node3 x:foo_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.foo.shard1.replica_n1, tag=563769614
[junit4] 2> 433448 INFO (coreCloseExecutor-420-thread-8) [n:127.0.0.1:37405_solr c:foo s:shard1 r:core_node3 x:foo_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@66094b10: rootName = solr_37405, domain = solr.core.foo.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.foo.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@521850e0
[junit4] 2> 433541 INFO (coreCloseExecutor-421-thread-7) [n:127.0.0.1:39820_solr c:multicollection1 s:shard2 r:core_node4 x:multicollection1_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.multicollection1.shard2.leader, tag=2119427945
[junit4] 2> 433541 INFO (coreCloseExecutor-421-thread-8) [n:127.0.0.1:39820_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.foo.shard1.replica_n4, tag=670722047
[junit4] 2> 433541 INFO (coreCloseExecutor-421-thread-8) [n:127.0.0.1:39820_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@550f908e: rootName = solr_39820, domain = solr.core.foo.shard1.replica_n4, service url = null, agent id = null] for registry solr.core.foo.shard1.replica_n4 / com.codahale.metrics.MetricRegistry@1039b0f7
[junit4] 2> 433626 INFO (jetty-closer-155-thread-2) [ ] o.a.s.c.Overseer Overseer (id=98777686084747278-127.0.0.1:46198_solr-n_0000000003) closing
[junit4] 2> 433626 INFO (OverseerStateUpdate-98777686084747278-127.0.0.1:46198_solr-n_0000000003) [n:127.0.0.1:46198_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:46198_solr
[junit4] 2> 433629 INFO (coreCloseExecutor-421-thread-8) [n:127.0.0.1:39820_solr c:foo s:shard1 r:core_node6 x:foo_shard1_replica_n4] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=670722047
[junit4] 2> 433642 INFO (coreCloseExecutor-421-thread-1) [n:127.0.0.1:39820_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=1401103451
[junit4] 2> 433853 INFO (coreCloseExecutor-420-thread-2) [n:127.0.0.1:37405_solr c:2nd_collection s:shard2 r:core_node4 x:2nd_collection_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.2nd_collection.shard2.leader, tag=742654088
[junit4] 2> 433869 INFO (coreCloseExecutor-420-thread-3) [n:127.0.0.1:37405_solr c:localShardsTestColl s:shard2 r:core_node15 x:localShardsTestColl_shard2_replica_n10] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.localShardsTestColl.shard2.leader, tag=1007718892
[junit4] 2> 433870 INFO (coreCloseExecutor-420-thread-8) [n:127.0.0.1:37405_solr c:foo s:shard1 r:core_node3 x:foo_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.foo.shard1.leader, tag=563769614
[junit4] 2> 434117 WARN (OverseerAutoScalingTriggerThread-98777686084747278-127.0.0.1:46198_solr-n_0000000003) [n:127.0.0.1:46198_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 434357 INFO (zkCallback-170-thread-3-processing-n:127.0.0.1:39820_solr) [n:127.0.0.1:39820_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (1)
[junit4] 2> 434357 INFO (zkCallback-170-thread-6-processing-n:127.0.0.1:39820_solr) [n:127.0.0.1:39820_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39820_solr
[junit4] 2> 435621 WARN (zkCallback-166-thread-3-processing-n:127.0.0.1:37405_solr) [n:127.0.0.1:37405_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 435621 INFO (jetty-closer-155-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@edcc41f{/solr,null,UNAVAILABLE}
[junit4] 2> 435640 WARN (zkCallback-171-thread-5-processing-n:127.0.0.1:46198_solr) [n:127.0.0.1:46198_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 435657 INFO (jetty-closer-155-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@21bb985e{/solr,null,UNAVAILABLE}
[junit4] 2> 435894 WARN (zkCallback-170-thread-3-processing-n:127.0.0.1:39820_solr) [n:127.0.0.1:39820_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 435913 INFO (jetty-closer-155-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4d19c123{/solr,null,UNAVAILABLE}
[junit4] 2> 435933 ERROR (SUITE-CloudSolrClientTest-seed#[9661FE67A1868730]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 435933 INFO (SUITE-CloudSolrClientTest-seed#[9661FE67A1868730]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39943 39943
[junit4] 2> 436096 INFO (Thread-128) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39943 39943
[junit4] 2> 436097 WARN (Thread-128) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 6 /solr/security.json
[junit4] 2> 6 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 27 /solr/collections/localShardsTestColl/state.json
[junit4] 2> 24 /solr/collections/foo/state.json
[junit4] 2> 16 /solr/collections/2nd_collection/state.json
[junit4] 2> 16 /solr/collections/multicollection1/state.json
[junit4] 2> 16 /solr/collections/multicollection2/state.json
[junit4] 2> 14 /solr/collections/collection1/state.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/overwrite/state.json
[junit4] 2> 2 /solr/autoscaling.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections
[junit4] 2> 9 /solr/live_nodes
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/autoscaling/events/.auto_add_replicas
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.impl.CloudSolrClientTest_9661FE67A1868730-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=BlockTreeOrds(blocksize=128), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), title_s=BlockTreeOrds(blocksize=128), id=PostingsFormat(name=Memory), text=PostingsFormat(name=LuceneFixedGap)}, docValues:{_version_=DocValuesFormat(name=Direct), multiDefault=DocValuesFormat(name=Lucene70), title_s=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Direct), id=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=696, maxMBSortInHeap=7.424927238307639, sim=RandomSimilarity(queryNorm=false): {}, locale=id, timezone=America/Argentina/Catamarca
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=108470768,total=372768768
[junit4] 2> NOTE: All tests run in this JVM: [TestSuggesterResponse, FacetFieldTest, TestValidatingJsonMap, ArrayEvaluatorTest, SolrDocumentTest, SolrExampleStreamingBinaryTest, SineEvaluatorTest, TestFastInputStream, LBHttpSolrClientBuilderTest, HyperbolicSineEvaluatorTest, HttpSolrClientBuilderTest, ClientUtilsTest, CloudSolrClientBuilderTest, TestJsonRecordReader, TestCloudSolrClientConnections, CommonParamsTest, DivideEvaluatorTest, SolrExampleEmbeddedTest, CoalesceEvaluatorTest, MergeIndexesEmbeddedTest, TestCollectionStateWatchers, OperationsTest, NormalizeEvaluatorTest, PowerEvaluatorTest, BasicHttpSolrClientTest, CloudSolrClientMultiConstructorTest, CloudSolrClientTest]
[junit4] Completed [117/145 (2!)] on J1 in 132.61s, 15 tests, 3 errors <<< FAILURES!
[...truncated 46008 lines...]
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:706: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:693: Source checkout is dirty (unversioned/missing files) after running tests!!! Offending files:
* lucene/licenses/morfologik-ukrainian-search-3.7.5.jar.sha1
Total time: 379 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2112 - Still Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2112/
12 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testBadActionNames
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:62B2DF2E7E607FA3]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1102)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:323)
at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:320)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:320)
at org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:384)
at org.apache.solr.cloud.MiniSolrCloudCluster.deleteAllCollections(MiniSolrCloudCluster.java:442)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.clearCluster(CollectionsAPIDistributedZkTest.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:968)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup
Error Message:
No registered leader was found after waiting for 4000ms , collection: deletereplica_test slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: deletereplica_test slice: shard1
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:A9BE020297ACC2FF]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:758)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:744)
at org.apache.solr.cloud.DeleteReplicaTest.deleteReplicaAndVerifyDirectoryCleanup(DeleteReplicaTest.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.HealthCheckHandlerTest.testHealthCheckHandlerSolrJ
Error Message:
Error from server at http://127.0.0.1:59629/solr: Host Unavailable: Not connected to zk
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:59629/solr: Host Unavailable: Not connected to zk
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:73AD59AC680523F5]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.HealthCheckHandlerTest.testHealthCheckHandlerSolrJ(HealthCheckHandlerTest.java:78)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.LeaderElectionContextKeyTest.test
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.LeaderElectionContextKeyTest.test(LeaderElectionContextKeyTest.java:88)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.PeerSyncReplicationTest.test
Error Message:
expected:<0> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<0> but was:<1>
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.PeerSyncReplicationTest.test(PeerSyncReplicationTest.java:202)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete
Error Message:
Error from server at http://127.0.0.1:45853/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:45853/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:7AA4281D940B8151]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:167)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:45853/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre> Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.cloud.TestHdfsCloudBackupRestore.test
Error Message:
Could not load collection from ZK: hdfsbackuprestore
Stack Trace:
org.apache.solr.common.SolrException: Could not load collection from ZK: hdfsbackuprestore
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1115)
at org.apache.solr.common.cloud.ZkStateReader$LazyCollectionRef.get(ZkStateReader.java:648)
at org.apache.solr.common.cloud.ClusterState.getCollectionOrNull(ClusterState.java:128)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:108)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.getActiveSliceCount(AbstractCloudBackupRestoreTestCase.java:191)
at org.apache.solr.cloud.AbstractCloudBackupRestoreTestCase.test(AbstractCloudBackupRestoreTestCase.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/hdfsbackuprestore/state.json
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.fetchCollectionState(ZkStateReader.java:1127)
at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:1113)
... 44 more
FAILED: org.apache.solr.cloud.TestSegmentSorting.testSegmentTerminateEarly
Error Message:
Error from server at http://127.0.0.1:47582/solr/testSegmentTerminateEarly_shard1_replica_n2: No registered leader was found after waiting for 4000ms , collection: testSegmentTerminateEarly slice: shard1
Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:47582/solr/testSegmentTerminateEarly_shard1_replica_n2: No registered leader was found after waiting for 4000ms , collection: testSegmentTerminateEarly slice: shard1
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:9F84115CFB1FF9E]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:173)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:138)
at org.apache.solr.client.solrj.SolrClient.add(SolrClient.java:152)
at org.apache.solr.cloud.SegmentTerminateEarlyTestState.addDocuments(SegmentTerminateEarlyTestState.java:85)
at org.apache.solr.cloud.TestSegmentSorting.testSegmentTerminateEarly(TestSegmentSorting.java:106)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.junit.rules.TestWatcher$1.evaluate(TestWatcher.java:47)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:47582/solr/testSegmentTerminateEarly_shard1_replica_n2: No registered leader was found after waiting for 4000ms , collection: testSegmentTerminateEarly slice: shard1
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:627)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
... 1 more
FAILED: org.apache.solr.handler.TestSolrConfigHandlerCloud.test
Error Message:
{ "responseHeader":{ "status":500, "QTime":30445}, "errorMessages":["2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]\n"], "WARNING":"This response format is experimental. It is likely to change in the future.", "error":{ "metadata":[ "error-class","org.apache.solr.common.SolrException", "root-error-class","org.apache.solr.common.SolrException"], "msg":"2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]", "trace":"org.apache.solr.common.SolrException: 2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2483)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:720)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n", "code":500}}
Stack Trace:
java.lang.AssertionError: {
"responseHeader":{
"status":500,
"QTime":30445},
"errorMessages":["2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]\n"],
"WARNING":"This response format is experimental. It is likely to change in the future.",
"error":{
"metadata":[
"error-class","org.apache.solr.common.SolrException",
"root-error-class","org.apache.solr.common.SolrException"],
"msg":"2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]",
"trace":"org.apache.solr.common.SolrException: 2 out of 5 the property overlay to be of version 4 within 30 seconds! Failed cores: [https://127.0.0.1:39460/collection1_shard2_replica_n41/, https://127.0.0.1:41236/collection1_shard2_replica_n45/]\n\tat org.apache.solr.handler.SolrConfigHandler.waitForAllReplicasState(SolrConfigHandler.java:772)\n\tat org.apache.solr.handler.SolrConfigHandler.access$400(SolrConfigHandler.java:102)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handleCommands(SolrConfigHandler.java:503)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.handlePOST(SolrConfigHandler.java:346)\n\tat org.apache.solr.handler.SolrConfigHandler$Command.access$100(SolrConfigHandler.java:159)\n\tat org.apache.solr.handler.SolrConfigHandler.handleRequestBody(SolrConfigHandler.java:137)\n\tat org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:177)\n\tat org.apache.solr.core.SolrCore.execute(SolrCore.java:2483)\n\tat org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:720)\n\tat org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:526)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:382)\n\tat org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)\n\tat org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)\n\tat org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)\n\tat org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)\n\tat org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)\n\tat org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)\n\tat org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:426)\n\tat org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)\n\tat org.eclipse.jetty.server.Server.handle(Server.java:534)\n\tat org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)\n\tat org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)\n\tat org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)\n\tat org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)\n\tat org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)\n\tat org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)\n\tat org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)\n\tat java.lang.Thread.run(Thread.java:748)\n",
"code":500}}
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNull(Assert.java:551)
at org.apache.solr.core.TestSolrConfigHandler.runConfigCommand(TestSolrConfigHandler.java:185)
at org.apache.solr.core.TestSolrConfigHandler.reqhandlertests(TestSolrConfigHandler.java:272)
at org.apache.solr.handler.TestSolrConfigHandlerCloud.testReqHandlerAPIs(TestSolrConfigHandlerCloud.java:97)
at org.apache.solr.handler.TestSolrConfigHandlerCloud.test(TestSolrConfigHandlerCloud.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.security.TestPKIAuthenticationPlugin.test
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.apache.solr.security.TestPKIAuthenticationPlugin.test(TestPKIAuthenticationPlugin.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.update.TestInPlaceUpdatesDistrib.test
Error Message:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39550/fx/r/collection1: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /fx/r/collection1/update. Reason: <pre> Can not find: /fx/r/collection1/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html>
Stack Trace:
java.lang.RuntimeException: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39550/fx/r/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /fx/r/collection1/update. Reason:
<pre> Can not find: /fx/r/collection1/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:510AB962BD1F060C]:0)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.clearIndex(TestInPlaceUpdatesDistrib.java:1203)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.reorderedDBQIndividualReplicaTest(TestInPlaceUpdatesDistrib.java:258)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.test(TestInPlaceUpdatesDistrib.java:149)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:39550/fx/r/collection1: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /fx/r/collection1/update. Reason:
<pre> Can not find: /fx/r/collection1/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
at org.apache.solr.update.TestInPlaceUpdatesDistrib.clearIndex(TestInPlaceUpdatesDistrib.java:1198)
... 43 more
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<3>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<3>
at __randomizedtesting.SeedInfo.seed([D95E86B813E36BF4:C55FFB3566461567]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11629 lines...]
[junit4] Suite: org.apache.solr.cloud.PeerSyncReplicationTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/init-core-data-001
[junit4] 2> 208774 INFO (SUITE-PeerSyncReplicationTest-seed#[D95E86B813E36BF4]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 208776 INFO (SUITE-PeerSyncReplicationTest-seed#[D95E86B813E36BF4]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 208902 INFO (SUITE-PeerSyncReplicationTest-seed#[D95E86B813E36BF4]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 208902 INFO (SUITE-PeerSyncReplicationTest-seed#[D95E86B813E36BF4]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 208912 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 208948 INFO (Thread-156) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 208994 INFO (Thread-156) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 209497 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.ZkTestServer start zk server on port:52481
[junit4] 2> 210061 ERROR (Thread-156) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 213576 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 213654 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 213674 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 213676 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 213694 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 213696 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 213715 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 213716 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 213739 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 213794 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 213796 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 214254 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 218272 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 219088 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@8b9c862{/,null,AVAILABLE}
[junit4] 2> 219317 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35b53e35{SSL,[ssl, http/1.1]}{127.0.0.1:40767}
[junit4] 2> 219317 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.e.j.s.Server Started @234998ms
[junit4] 2> 219317 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/tempDir-001/control/data, hostContext=/, hostPort=40767, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/control-001/cores}
[junit4] 2> 219457 ERROR (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 219457 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 219457 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 219457 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 219467 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-03T20:18:01.705Z
[junit4] 2> 219548 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 219548 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/control-001/solr.xml
[junit4] 2> 219810 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d6c6328, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 219916 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:52481/solr
[junit4] 2> 221759 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 221767 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40767_
[junit4] 2> 221786 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.c.Overseer Overseer (id=98766806835396613-127.0.0.1:40767_-n_0000000000) starting
[junit4] 2> 224056 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40767_
[junit4] 2> 224094 INFO (OverseerStateUpdate-98766806835396613-127.0.0.1:40767_-n_0000000000) [n:127.0.0.1:40767_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 226341 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d6c6328
[junit4] 2> 226447 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d6c6328
[junit4] 2> 226447 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d6c6328
[junit4] 2> 226526 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [n:127.0.0.1:40767_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/control-001/cores
[junit4] 2> 228183 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 228195 INFO (TEST-PeerSyncReplicationTest.test-seed#[D95E86B813E36BF4]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:52481/solr ready
[junit4] 2> 234484 INFO (qtp187247419-303) [n:127.0.0.1:40767_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40767_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 234699 INFO (OverseerThreadFactory-76-thread-1-processing-n:127.0.0.1:40767_) [n:127.0.0.1:40767_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 236824 INFO (qtp187247419-304) [n:127.0.0.1:40767_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 236838 INFO (qtp187247419-304) [n:127.0.0.1:40767_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 237260 INFO (zkCallback-19-thread-1-processing-n:127.0.0.1:40767_) [n:127.0.0.1:40767_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 238340 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 239860 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 241619 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 241935 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 242887 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d6c6328
[junit4] 2> 242931 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 242931 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.PeerSyncReplicationTest_D95E86B813E36BF4-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 243049 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=21, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3787023999478504]
[junit4] 2> 243323 WARN (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 244049 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 244049 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=1000 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 244146 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 244146 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 244169 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=29, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5199534843933459]
[junit4] 2> 244218 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1ab3debf[control_collection_shard1_replica_n1] main]
[junit4] 2> 244246 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 244266 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 244267 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 244310 INFO (searcherExecutor-79-thread-1-processing-n:127.0.0.1:40767_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1ab3debf[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 244372 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580268945785487360
[junit4] 2> 244676 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 244676 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 244677 INFO (qtp187247419-304) [n:127.0.0.1:40767_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0
[...truncated too long message...]
ShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 8952150 INFO (SUITE-TestTlogReplica-seed#[D95E86B813E36BF4]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43106 43106
[junit4] 2> 8952235 INFO (Thread-6690) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43106 43106
[junit4] 2> 8952236 WARN (Thread-6690) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 34 /solr/configs/conf
[junit4] 2> 11 /solr/aliases.json
[junit4] 2> 9 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 42 /solr/collections/tlog_replica_test_create_delete/state.json
[junit4] 2> 40 /solr/collections/tlog_replica_test_recovery/state.json
[junit4] 2> 31 /solr/collections/tlog_replica_test_add_remove_tlog_replica/state.json
[junit4] 2> 30 /solr/collections/tlog_replica_test_remove_leader/state.json
[junit4] 2> 28 /solr/collections/tlog_replica_test_out_of_order_db_qwith_in_place_updates/state.json
[junit4] 2> 28 /solr/collections/tlog_replica_test_kill_leader/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_basic_leader_election/state.json
[junit4] 2> 26 /solr/collections/tlog_replica_test_kill_tlog_replica/state.json
[junit4] 2> 16 /solr/collections/tlog_replica_test_only_leader_indexes/state.json
[junit4] 2> 15 /solr/collections/tlog_replica_test_add_docs/state.json
[junit4] 2> 14 /solr/collections/tlog_replica_test_delete_by_id/state.json
[junit4] 2> 13 /solr/collections/tlog_replica_test_real_time_get/state.json
[junit4] 2> 11 /solr/clusterprops.json
[junit4] 2> 11 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/tlog_replica_test_recovery/leader_elect/shard1/election/98767363739942917-core_node4-n_0000000000
[junit4] 2> 4 /solr/overseer_elect/election/98767363739942917-127.0.0.1:37653_solr-n_0000000001
[junit4] 2> 3 /solr/collections/tlog_replica_test_create_delete/leader_elect/shard2/election/98767363739942917-core_node16-n_0000000001
[junit4] 2> 2 /solr/overseer_elect/election/98767363739942933-127.0.0.1:36272_solr-n_0000000005
[junit4] 2> 2 /solr/collections/tlog_replica_test_kill_tlog_replica/leader_elect/shard1/election/98767363739942933-core_node4-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/collections
[junit4] 2> 4 /solr/overseer/queue
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/overseer/collection-queue-work
[junit4] 2> 2 /solr/overseer/queue-work
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J1/temp/solr.cloud.TestTlogReplica_D95E86B813E36BF4-001
[junit4] 2> Oct 03, 2017 10:43:38 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {foo=PostingsFormat(name=LuceneFixedGap), title_s=PostingsFormat(name=Memory), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), foo_s=PostingsFormat(name=LuceneFixedGap)}, docValues:{_version_=DocValuesFormat(name=Memory), id=DocValuesFormat(name=Direct), inplace_updatable_int=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=152, maxMBSortInHeap=7.0170853800763595, sim=RandomSimilarity(queryNorm=false): {}, locale=es, timezone=America/Scoresbysund
[junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=216946488,total=510656512
[junit4] 2> NOTE: All tests run in this JVM: [SolrCmdDistributorTest, DocValuesMultiTest, TestJettySolrRunner, LoggingHandlerTest, SolrCoreMetricManagerTest, OverseerCollectionConfigSetProcessorTest, CollectionReloadTest, MoreLikeThisHandlerTest, AnalyticsMergeStrategyTest, TestHttpShardHandlerFactory, TestFieldCacheReopen, TestCharFilters, TestAtomicUpdateErrorCases, TestOrdValues, DocValuesTest, MetricUtilsTest, CdcrVersionReplicationTest, TestHashPartitioner, CacheHeaderTest, SolrMetricsIntegrationTest, TestExclusionRuleCollectionAccess, ZkCLITest, TestValueSourceCache, TestSchemaVersionResource, TestDFISimilarityFactory, CheckHdfsIndexTest, TestSweetSpotSimilarityFactory, ResourceLoaderTest, HdfsRecoveryZkTest, TestSystemCollAutoCreate, TestConfigSets, TestAnalyzeInfixSuggestions, SmileWriterTest, CloudMLTQParserTest, TestConfigOverlay, TestFieldSortValues, DistanceFunctionTest, CSVRequestHandlerTest, TestNoOpRegenerator, LukeRequestHandlerTest, DistribJoinFromCollectionTest, CurrencyFieldTypeTest, AsyncCallRequestStatusResponseTest, ShardRoutingTest, TestCloudManagedSchema, TestPostingsSolrHighlighter, CoreAdminHandlerTest, TestComplexPhraseLeadingWildcard, TolerantUpdateProcessorTest, TestSolrCLIRunExample, TestPerFieldSimilarity, CdcrReplicationDistributedZkTest, TestRTGBase, TestLRUCache, TestSolrXml, ClassificationUpdateProcessorTest, SolrCloudReportersTest, ResponseHeaderTest, TestRawTransformer, MoveReplicaHDFSUlogDirTest, DirectSolrConnectionTest, TestSha256AuthenticationProvider, DistributedFacetPivotSmallAdvancedTest, BasicFunctionalityTest, TriLevelCompositeIdRoutingTest, TestLockTree, SampleTest, ConfigSetsAPITest, TestInPlaceUpdatesDistrib, ScriptEngineTest, TestMacroExpander, ConvertedLegacyTest, TestReplicaProperties, ZkSolrClientTest, CoreSorterTest, DistributedTermsComponentTest, TestNumericTerms32, TestManagedStopFilterFactory, TestStressInPlaceUpdates, JsonLoaderTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestPrepRecovery, HdfsDirectoryFactoryTest, JavabinLoaderTest, TestSolrJ, TestXIncludeConfig, SliceStateTest, TestReqParamsAPI, HLLSerializationTest, TestChildDocTransformer, TestFiltering, SolrCLIZkUtilsTest, TestSolrCloudWithHadoopAuthPlugin, SpellCheckComponentTest, TestFuzzyAnalyzedSuggestions, TestAuthenticationFramework, TestFastLRUCache, AlternateDirectoryTest, SortSpecParsingTest, DirectSolrSpellCheckerTest, TestExportWriter, AtomicUpdatesTest, TestSolrCloudWithKerberosAlt, TestSubQueryTransformerDistrib, SharedFSAutoReplicaFailoverTest, TestRestManager, RecoveryAfterSoftCommitTest, TestJsonFacetRefinement, TermVectorComponentTest, StatelessScriptUpdateProcessorFactoryTest, SpatialFilterTest, CoreAdminCreateDiscoverTest, TestAuthorizationFramework, TestSolrIndexConfig, HdfsCollectionsAPIDistributedZkTest, TestEmbeddedSolrServerAdminHandler, BitVectorTest, InfoHandlerTest, DistributedFacetExistsSmallTest, SuggesterTSTTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, ClusterStateUpdateTest, TestRandomFaceting, AutoCommitTest, TestRecovery, TestStressVersions, SimpleFacetsTest, TestGroupingSearch, PeerSyncTest, TestBadConfig, SoftAutoCommitTest, WordBreakSolrSpellCheckerTest, TestUpdate, SortByFunctionTest, TestSolrDeletionPolicy1, IndexBasedSpellCheckerTest, TestWriterPerf, DocumentBuilderTest, RequiredFieldsTest, TestSolrQueryParser, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, TestCSVResponseWriter, BinaryUpdateRequestHandlerTest, SOLR749Test, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, DistributedIntervalFacetingTest, AliasIntegrationTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CleanupOldIndexTest, CollectionsAPISolrJTest, HealthCheckHandlerTest, HttpPartitionTest, MoveReplicaTest, NodeMutatorTest, OverseerRolesTest, OverseerTaskQueueTest, ReplaceNodeTest, SharedFSAutoReplicaFailoverUtilsTest, SolrXmlInZkTest, TestCloudRecovery, TestCloudSearcherWarming, TestCollectionAPI, TestConfigSetsAPI, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestLocalFSCloudBackupRestore, TestPullReplicaErrorHandling, TestRandomFlRTGCloud, TestRequestStatusCollectionAPI, TestSSLRandomization, TestTlogReplica]
[junit4] Completed [574/735 (12!)] on J1 in 249.56s, 13 tests, 1 failure <<< FAILURES!
[...truncated 46904 lines...]
-documentation-lint:
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/docs/quickstart.html
[exec] BAD EXTERNAL LINK: https://lucene.apache.org/solr/guide/solr-tutorial.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:101: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:669: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build.xml:682: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2570: exec returned: 1
Total time: 382 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-Tests-master - Build # 2111 - Failure
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-Tests-master/2111/
3 tests failed.
FAILED: org.apache.solr.cloud.RecoveryZkTest.test
Error Message:
Stack Trace:
java.util.concurrent.TimeoutException
at __randomizedtesting.SeedInfo.seed([FE1B883B99B87E41:764FB7E1374413B9]:0)
at org.apache.solr.common.cloud.ZkStateReader.waitForState(ZkStateReader.java:1268)
at org.apache.solr.client.solrj.impl.CloudSolrClient.waitForState(CloudSolrClient.java:438)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.ShardSplitTest.testSplitAfterFailedSplit
Error Message:
KeeperErrorCode = Session expired for /clusterstate.json
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /clusterstate.json
at __randomizedtesting.SeedInfo.seed([FE1B883B99B87E41:7561B94A5CD33CB]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkStateReader.refreshLegacyClusterState(ZkStateReader.java:542)
at org.apache.solr.common.cloud.ZkStateReader.forceUpdateCollection(ZkStateReader.java:310)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:674)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.updateMappingsFromZk(AbstractFullDistribZkTestBase.java:669)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:464)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:991)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes
Error Message:
expected:<2> but was:<3>
Stack Trace:
java.lang.AssertionError: expected:<2> but was:<3>
at __randomizedtesting.SeedInfo.seed([FE1B883B99B87E41:E21AF5B6EC1D00D2]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.TestTlogReplica.assertCopyOverOldUpdates(TestTlogReplica.java:909)
at org.apache.solr.cloud.TestTlogReplica.testOnlyLeaderIndexes(TestTlogReplica.java:501)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11873 lines...]
[junit4] Suite: org.apache.solr.cloud.ShardSplitTest
[junit4] 2> 847805 INFO (SUITE-ShardSplitTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/init-core-data-001
[junit4] 2> 847806 WARN (SUITE-ShardSplitTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 847806 INFO (SUITE-ShardSplitTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 847808 INFO (SUITE-ShardSplitTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 847808 INFO (SUITE-ShardSplitTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 847878 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 847898 INFO (Thread-344) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 847898 INFO (Thread-344) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 847935 ERROR (Thread-344) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 848008 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkTestServer start zk server on port:37919
[junit4] 2> 848157 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 848171 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 848172 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 848173 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 848174 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 848191 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 848228 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 848229 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 848230 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 848230 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 848231 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 848293 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
[junit4] 2> 849664 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 849789 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e9b7e2{/,null,AVAILABLE}
[junit4] 2> 849791 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2314274{HTTP/1.1,[http/1.1]}{127.0.0.1:44518}
[junit4] 2> 849791 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server Started @865361ms
[junit4] 2> 849791 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/tempDir-001/control/data, hostContext=/, hostPort=44518, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/control-001/cores}
[junit4] 2> 849791 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 849792 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 849792 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 849792 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 849792 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T14:39:42.827Z
[junit4] 2> 849883 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 849883 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/control-001/solr.xml
[junit4] 2> 849920 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 849975 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37919/solr
[junit4] 2> 851023 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 851024 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44518_
[junit4] 2> 851057 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.c.Overseer Overseer (id=98759814738673668-127.0.0.1:44518_-n_0000000000) starting
[junit4] 2> 851169 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44518_
[junit4] 2> 851207 INFO (zkCallback-298-thread-1-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 852450 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 852560 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 852560 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 852561 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:44518_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/control-001/cores
[junit4] 2> 852793 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 852794 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37919/solr ready
[junit4] 2> 852888 INFO (qtp392002913-1849) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44518_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 852890 INFO (OverseerThreadFactory-682-thread-1-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 853034 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 853034 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 853216 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 854371 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 854461 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 855374 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 855484 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 855484 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 855521 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 855524 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 855632 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.4990234375, floorSegmentMB=0.26953125, forceMergeDeletesPctAllowed=25.992045265657552, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.356210993937081
[junit4] 2> 855773 WARN (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 856206 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 856206 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 856219 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 856220 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 856221 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=32.8564453125, floorSegmentMB=1.0244140625, forceMergeDeletesPctAllowed=17.924682452050128, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5572508202602302
[junit4] 2> 856242 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@65ba3e9b[control_collection_shard1_replica_n1] main]
[junit4] 2> 856258 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 856258 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 856258 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 856295 INFO (searcherExecutor-685-thread-1-processing-n:127.0.0.1:44518_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@65ba3e9b[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 856295 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580157044606894080
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44518/control_collection_shard1_replica_n1/
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44518/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 856299 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 856359 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44518/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 856375 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 856484 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 856519 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 856520 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3486
[junit4] 2> 856523 INFO (qtp392002913-1849) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 856630 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 856938 INFO (OverseerCollectionConfigSetProcessor-98759814738673668-127.0.0.1:44518_-n_0000000000) [n:127.0.0.1:44518_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 857523 INFO (qtp392002913-1849) [n:127.0.0.1:44518_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44518_&wt=javabin&version=2} status=0 QTime=4635
[junit4] 2> 857593 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 857593 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37919/solr ready
[junit4] 2> 857593 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 857594 INFO (qtp392002913-1846) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 857707 INFO (OverseerThreadFactory-682-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 857779 WARN (OverseerThreadFactory-682-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 858049 INFO (qtp392002913-1846) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 858050 INFO (qtp392002913-1846) [n:127.0.0.1:44518_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=455
[junit4] 2> 859126 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001 of type TLOG
[junit4] 2> 859127 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 859251 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@101f0553{/,null,AVAILABLE}
[junit4] 2> 859255 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6f13d903{HTTP/1.1,[http/1.1]}{127.0.0.1:35599}
[junit4] 2> 859255 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server Started @874824ms
[junit4] 2> 859255 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=35599, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001/cores}
[junit4] 2> 859256 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 859279 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 859279 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 859279 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 859279 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T14:39:52.314Z
[junit4] 2> 859353 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 859353 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001/solr.xml
[junit4] 2> 859358 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 859386 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37919/solr
[junit4] 2> 859440 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 859474 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 859476 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35599_
[junit4] 2> 859477 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 859550 INFO (zkCallback-310-thread-1-processing-n:127.0.0.1:35599_) [n:127.0.0.1:35599_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 859550 INFO (zkCallback-305-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 859783 INFO (OverseerCollectionConfigSetProcessor-98759814738673668-127.0.0.1:44518_-n_0000000000) [n:127.0.0.1:44518_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 860196 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 860391 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 860392 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 860406 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:35599_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001/cores
[junit4] 2> 860719 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35599_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 860779 INFO (OverseerThreadFactory-682-thread-3-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35599_ for creating new replica
[junit4] 2> 860849 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 860849 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 860976 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 861087 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
[junit4] 2> 861671 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 861762 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
[junit4] 2> 861762 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 861762 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 861762 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
[junit4] 2> 861782 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.4990234375, floorSegmentMB=0.26953125, forceMergeDeletesPctAllowed=25.992045265657552, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.356210993937081
[junit4] 2> 861891 WARN (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 862182 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 862182 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 862183 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 862183 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 862184 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=32.8564453125, floorSegmentMB=1.0244140625, forceMergeDeletesPctAllowed=17.924682452050128, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5572508202602302
[junit4] 2> 862185 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@46f9bbb3[collection1_shard2_replica_t41] main]
[junit4] 2> 862185 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 862198 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 862198 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 862199 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580157050797686784
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:35599/collection1_shard2_replica_t41/
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:35599/collection1_shard2_replica_t41/ has no replicas
[junit4] 2> 862238 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 862256 INFO (searcherExecutor-696-thread-1-processing-n:127.0.0.1:35599_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@46f9bbb3[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 862256 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
[junit4] 2> 862258 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:35599/collection1_shard2_replica_t41/ shard2
[junit4] 2> 862419 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 862440 INFO (qtp1095260853-1891) [n:127.0.0.1:35599_ c:collection1 s:shard2 x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1591
[junit4] 2> 862444 INFO (qtp392002913-1847) [n:127.0.0.1:44518_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35599_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1725
[junit4] 2> 862804 INFO (OverseerCollectionConfigSetProcessor-98759814738673668-127.0.0.1:44518_-n_0000000000) [n:127.0.0.1:44518_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 863316 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001 of type TLOG
[junit4] 2> 863317 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 863411 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@79649cd4{/,null,AVAILABLE}
[junit4] 2> 863411 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@712854fd{HTTP/1.1,[http/1.1]}{127.0.0.1:39450}
[junit4] 2> 863411 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server Started @878981ms
[junit4] 2> 863411 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=39450, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001/cores}
[junit4] 2> 863412 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 863430 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 863430 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 863430 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 863430 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T14:39:56.465Z
[junit4] 2> 863540 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 863540 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001/solr.xml
[junit4] 2> 863634 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 863651 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37919/solr
[junit4] 2> 863871 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 863872 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 863905 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39450_
[junit4] 2> 863949 INFO (zkCallback-298-thread-1-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864022 INFO (zkCallback-316-thread-1-processing-n:127.0.0.1:39450_) [n:127.0.0.1:39450_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864030 INFO (zkCallback-305-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864030 INFO (zkCallback-310-thread-1-processing-n:127.0.0.1:35599_) [n:127.0.0.1:35599_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 864352 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 864390 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 864390 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 864407 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:39450_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001/cores
[junit4] 2> 864959 INFO (qtp392002913-1849) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:39450_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 864980 INFO (OverseerThreadFactory-682-thread-4-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:39450_ for creating new replica
[junit4] 2> 865025 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 865025 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 866158 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 866212 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
[junit4] 2> 866890 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 867062 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
[junit4] 2> 867063 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 867063 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 867063 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
[junit4] 2> 867080 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.4990234375, floorSegmentMB=0.26953125, forceMergeDeletesPctAllowed=25.992045265657552, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.356210993937081
[junit4] 2> 867189 WARN (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 867671 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 867671 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 867672 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 867672 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 867674 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=32.8564453125, floorSegmentMB=1.0244140625, forceMergeDeletesPctAllowed=17.924682452050128, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5572508202602302
[junit4] 2> 867686 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@5473277b[collection1_shard1_replica_t43] main]
[junit4] 2> 867687 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 867687 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 867688 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 867689 INFO (searcherExecutor-707-thread-1-processing-n:127.0.0.1:39450_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@5473277b[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 867690 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580157056555417600
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39450/collection1_shard1_replica_t43/
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:39450/collection1_shard1_replica_t43/ has no replicas
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 867723 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
[junit4] 2> 867725 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39450/collection1_shard1_replica_t43/ shard1
[junit4] 2> 867901 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 867934 INFO (qtp1165210234-1921) [n:127.0.0.1:39450_ c:collection1 s:shard1 x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2908
[junit4] 2> 867976 INFO (qtp392002913-1849) [n:127.0.0.1:44518_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:39450_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=3016
[junit4] 2> 868825 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001 of type TLOG
[junit4] 2> 868826 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server jetty-9.3.20.v20170531
[junit4] 2> 868867 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3d45b4f{/,null,AVAILABLE}
[junit4] 2> 868867 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2055e1e{HTTP/1.1,[http/1.1]}{127.0.0.1:37862}
[junit4] 2> 868867 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.e.j.s.Server Started @884437ms
[junit4] 2> 868867 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=37862, coreRootDirectory=/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001/cores}
[junit4] 2> 868867 ERROR (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 868887 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 8.0.0
[junit4] 2> 868887 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 868887 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 868992 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-10-02T14:40:01.922Z
[junit4] 2> 869029 INFO (OverseerCollectionConfigSetProcessor-98759814738673668-127.0.0.1:44518_-n_0000000000) [n:127.0.0.1:44518_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 869030 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 869030 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001/solr.xml
[junit4] 2> 869067 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 869087 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37919/solr
[junit4] 2> 869226 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 869227 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 869242 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37862_
[junit4] 2> 869248 INFO (zkCallback-305-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 869301 INFO (zkCallback-316-thread-1-processing-n:127.0.0.1:39450_) [n:127.0.0.1:39450_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 869248 INFO (zkCallback-310-thread-1-processing-n:127.0.0.1:35599_) [n:127.0.0.1:35599_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 869341 INFO (zkCallback-298-thread-2-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 869349 INFO (zkCallback-322-thread-1-processing-n:127.0.0.1:37862_) [n:127.0.0.1:37862_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 869550 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 869588 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 869588 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 869606 INFO (TEST-ShardSplitTest.testSplitWithChaosMonkey-seed#[FE1B883B99B87E41]) [n:127.0.0.1:37862_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001/cores
[junit4] 2> 869978 INFO (qtp392002913-1850) [n:127.0.0.1:44518_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37862_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 870025 INFO (OverseerThreadFactory-682-thread-5-processing-n:127.0.0.1:44518_) [n:127.0.0.1:44518_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37862_ for creating new replica
[junit4] 2> 870081 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
[junit4] 2> 870081 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 871246 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
[junit4] 2> 871465 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
[junit4] 2> 872354 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 872483 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
[junit4] 2> 872484 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7904f20
[junit4] 2> 872484 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 872484 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/../../../../../../../../../../home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J0/temp/solr.cloud.ShardSplitTest_FE1B883B99B87E41-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
[junit4] 2> 872499 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=49.4990234375, floorSegmentMB=0.26953125, forceMergeDeletesPctAllowed=25.992045265657552, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.356210993937081
[junit4] 2> 872662 WARN (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 873021 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 873021 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 873022 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 873022 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 873024 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=32.8564453125, floorSegmentMB=1.0244140625, forceMergeDeletesPctAllowed=17.924682452050128, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5572508202602302
[junit4] 2> 873024 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@61dc6f08[collection1_shard2_replica_t45] main]
[junit4] 2> 873094 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 873110 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 873111 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 873111 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1580157062239748096
[junit4] 2> 873131 INFO (searcherExecutor-718-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@61dc6f08[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 873135 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
[junit4] 2> 873155 INFO (updateExecutor-319-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 873155 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 873171 INFO (qtp1041955071-1951) [n:127.0.0.1:37862_ c:collection1 s:shard2 x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=3090
[junit4] 2> 873175 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 873175 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
[junit4] 2> 873175 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
[junit4] 2> 873175 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 873175 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:35599/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:37862/collection1_shard2_replica_t45/]
[junit4] 2> 873228 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:35599]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:37862_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 873237 INFO (qtp392002913-1850) [n:127.0.0.1:44518_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:37862_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=3258
[junit4] 2> 873355 INFO (qtp1095260853-1889) [n:127.0.0.1:35599_ ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 873464 INFO (qtp1095260853-1889) [n:127.0.0.1:35599_ ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:37862_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:37862","node_name":"127.0.0.1:37862_","state":"recovering","type":"TLOG"}
[junit4] 2> 873464 INFO (qtp1095260853-1889) [n:127.0.0.1:35599_ ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 873464 INFO (qtp1095260853-1889) [n:127.0.0.1:35599_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:37862_&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=109
[junit4] 2> 874016 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
[junit4] 2> 874016 INFO (recoveryExecutor-320-thread-1-processing-n:127.0.0.1:37862_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37862_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:35599/collection1_shard2_replica_t41/].
[junit4] 2> 874033 INFO (qtp1095260853-1893) [n:127.0.0.1:35599_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1580157063206535168,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 874033 INFO (qtp1095260853-1893) [n:127.0.0.1:35599_ c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 874034 INFO (qtp1095260853-1893) [n:127.0.0.1:35599_ c:collection1
[...truncated too long message...]
ica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.SolrCore [recoverytest_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@6b067e75
[junit4] 2> 3915087 INFO (recoveryExecutor-3254-thread-1-processing-n:127.0.0.1:33474_solr x:recoverytest_shard1_replica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.recoverytest.shard1.replica_n2, tag=1795587701
[junit4] 2> 3915087 INFO (recoveryExecutor-3254-thread-1-processing-n:127.0.0.1:33474_solr x:recoverytest_shard1_replica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@570e8dea: rootName = solr_33474, domain = solr.core.recoverytest.shard1.replica_n2, service url = null, agent id = null] for registry solr.core.recoverytest.shard1.replica_n2 / com.codahale.metrics.MetricRegistry@2a975f04
[junit4] 2> 3915126 INFO (recoveryExecutor-3254-thread-1-processing-n:127.0.0.1:33474_solr x:recoverytest_shard1_replica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.recoverytest.shard1.leader, tag=1795587701
[junit4] 2> 3915136 WARN (recoveryExecutor-3254-thread-1-processing-n:127.0.0.1:33474_solr x:recoverytest_shard1_replica_n2 s:shard1 c:recoverytest r:core_node4) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.c.RecoveryStrategy Stopping recovery for core=[recoverytest_shard1_replica_n2] coreNodeName=[core_node4]
[junit4] 2> 3915160 WARN (updateExecutor-3253-thread-2-processing-n:127.0.0.1:33474_solr) [n:127.0.0.1:33474_solr c:recoverytest s:shard1 r:core_node4 x:recoverytest_shard1_replica_n2] o.a.s.u.DefaultSolrCoreState Skipping recovery because Solr is shutdown
[junit4] 2> 3915176 WARN (zkCallback-3256-thread-5-processing-n:127.0.0.1:33474_solr) [n:127.0.0.1:33474_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 3915177 INFO (jetty-closer-3234-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@6c39da43{/solr,null,UNAVAILABLE}
[junit4] 2> 3915197 ERROR (SUITE-RecoveryZkTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 3915197 INFO (SUITE-RecoveryZkTest-seed#[FE1B883B99B87E41]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43692 43692
[junit4] 2> 3915250 INFO (Thread-3796) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:43692 43692
[junit4] 2> 3915250 WARN (Thread-3796) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 3 /solr/security.json
[junit4] 2> 3 /solr/configs/conf
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 26 /solr/collections/recoverytest/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 2 /solr/overseer_elect/election/98760006403555334-127.0.0.1:44807_solr-n_0000000000
[junit4] 2> 2 /solr/collections/recoverytest/leader_elect/shard1/election/98760006403555334-core_node3-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/collections
[junit4] 2> 3 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/solr/build/solr-core/test/J2/temp/solr.cloud.RecoveryZkTest_FE1B883B99B87E41-001
[junit4] 2> Oct 02, 2017 3:30:47 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {rnd_b=PostingsFormat(name=Direct), a_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_i=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct)}, docValues:{}, maxPointsInLeafNode=1779, maxMBSortInHeap=6.894583087107962, sim=RandomSimilarity(queryNorm=false): {}, locale=de-LU, timezone=US/Mountain
[junit4] 2> NOTE: Linux 4.4.0-83-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=4,threads=1,free=239156224,total=527433728
[junit4] 2> NOTE: All tests run in this JVM: [RankQueryTest, UtilsToolTest, HdfsDirectoryTest, NotRequiredUniqueKeyTest, TestLegacyFieldCache, TestReloadAndDeleteDocs, DistributedFacetPivotWhiteBoxTest, BlobRepositoryCloudTest, AtomicUpdateProcessorFactoryTest, TestPullReplica, SortByFunctionTest, DocValuesMissingTest, TestConfigsApi, TestDistribDocBasedVersion, PreAnalyzedFieldManagedSchemaCloudTest, TestCloudPivotFacet, TestDistribIDF, TestRequestForwarding, TestRecovery, SparseHLLTest, TestStreamBody, SolrCoreCheckLockOnStartupTest, TermsComponentTest, OverseerTest, TestZkChroot, TestMultiWordSynonyms, CollectionsAPISolrJTest, TestXmlQParserPlugin, LeaderElectionContextKeyTest, BJQParserTest, TestCollationFieldDocValues, TestSurroundQueryParser, TestTrie, SolrCloudExampleTest, SubstringBytesRefFilterTest, ClassificationUpdateProcessorIntegrationTest, TestDistributedMissingSort, FastVectorHighlighterTest, TestJsonRequest, TestCodecSupport, DateFieldTest, OverseerTaskQueueTest, TestDFRSimilarityFactory, SignatureUpdateProcessorFactoryTest, DistribCursorPagingTest, TestQuerySenderListener, TestSQLHandler, TestSolrCoreParser, SolrMetricReporterTest, BigEndianAscendingWordSerializerTest, TestJmxIntegration, TestLegacyFieldReuse, CleanupOldIndexTest, FullSolrCloudDistribCmdsTest, ResponseLogComponentTest, TimeZoneUtilsTest, DateMathParserTest, TestQueryUtils, TestSolrCloudWithDelegationTokens, TestSolrConfigHandler, TestNumericTokenStream, TestManagedResourceStorage, TestGroupingSearch, TestRandomRequestDistribution, TestRawResponseWriter, TestSchemaSimilarityResource, TestSort, DocExpirationUpdateProcessorFactoryTest, TestSubQueryTransformerCrossCore, TestFastWriter, DistributedSuggestComponentTest, TestRuleBasedAuthorizationPlugin, TestCollapseQParserPlugin, RemoteQueryErrorTest, NumericFieldsTest, DistributedExpandComponentTest, AssignBackwardCompatibilityTest, SolrInfoBeanTest, URLClassifyProcessorTest, SpellPossibilityIteratorTest, PropertiesRequestHandlerTest, TestUninvertingReader, TestExpandComponent, TestFieldCacheSortRandom, SuggestComponentContextFilterQueryTest, TestFileDictionaryLookup, LeaderElectionTest, TestTlogReplica, TestBulkSchemaConcurrent, TestManagedSchemaAPI, RestartWhileUpdatingTest, TestRecoveryHdfs, DistributedQueueTest, TestPerFieldSimilarityWithDefaultOverride, CircularListTest, SaslZkACLProviderTest, SolrSlf4jReporterTest, TestStressCloudBlindAtomicUpdates, TestBackupRepositoryFactory, TestLMJelinekMercerSimilarityFactory, MoveReplicaTest, QueryEqualityTest, PingRequestHandlerTest, TestLRUStatsCache, PreAnalyzedUpdateProcessorTest, DirectUpdateHandlerTest, DirectUpdateHandlerOptimizeTest, ReplicaListTransformerTest, ClusterStateTest, TestCustomDocTransformer, TestFieldTypeResource, TestPayloadCheckQParserPlugin, TestClassicSimilarityFactory, PrimitiveFieldTypeTest, TestSuggestSpellingConverter, StatsReloadRaceTest, SharedFSAutoReplicaFailoverUtilsTest, BasicDistributedZk2Test, TestMultiValuedNumericRangeQuery, OpenCloseCoreStressTest, BasicZkTest, RecoveryZkTest]
[junit4] Completed [337/734 (3!)] on J2 in 142.90s, 1 test, 1 error <<< FAILURES!
[...truncated 38582 lines...]
-documentation-lint:
[echo] checking for broken html...
[jtidy] Checking for broken html (such as invalid tags)...
[delete] Deleting directory /home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build/jtidy_tmp
[echo] Checking for broken links...
[exec]
[exec] Crawl/parse...
[exec]
[exec] Verify...
[exec]
[exec] file:///build/docs/sandbox/org/apache/lucene/document/FloatPointNearestNeighbor.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec] BROKEN LINK: file:///build/docs/core/org/apache/lucene/document/FloatPointNearestNeighbor.NearestHit.html
[exec]
[exec] Broken javadocs links were found! Common root causes:
[exec] * A typo of some sort for manually created links.
[exec] * Public methods referencing non-public classes in their signature.
BUILD FAILED
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:826: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/build.xml:101: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:142: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/build.xml:155: The following error occurred while executing this line:
/home/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-master/lucene/common-build.xml:2570: exec returned: 1
Total time: 298 minutes 16 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any