You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/25 05:18:15 UTC
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 857 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/857/
2 tests failed.
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Invalid content type:
Stack Trace:
org.apache.http.ParseException: Invalid content type:
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
at org.apache.http.entity.ContentType.parse(ContentType.java:273)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:513)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:224)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:166)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:676)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.handler.component.DistributedFacetPivotSmallTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35094/av_/oc/collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37832/av_/oc/collection1, http://[ff01::114]:33332/av_/oc, http://[ff01::083]:33332/av_/oc, http://[ff01::213]:33332/av_/oc]
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:621)
Build Log:
[...truncated 10739 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/init-core-data-001
[junit4] 2> 1659977 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection1
[junit4] 2> 1659979 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1659992 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@a4261bb{/,null,AVAILABLE}
[junit4] 2> 1659993 T9146 oejs.AbstractConnector.doStart Started ServerConnector@c1e4140{HTTP/1.1}{127.0.0.1:37384}
[junit4] 2> 1659994 T9146 oejs.Server.doStart Started @1661632ms
[junit4] 2> 1660051 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/lib).
[junit4] 2> 1661516 T9178 n:127.0.0.1:37384_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1661938 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/cores/collection1
[junit4] 2> 1661947 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1661961 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@15d381ea{/,null,AVAILABLE}
[junit4] 2> 1661961 T9146 oejs.AbstractConnector.doStart Started ServerConnector@70f634d7{HTTP/1.1}{127.0.0.1:39158}
[junit4] 2> 1661962 T9146 oejs.Server.doStart Started @1663600ms
[junit4] 2> 1662041 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/lib).
[junit4] 2> 1664554 T9203 n:127.0.0.1:39158_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1664971 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection1
[junit4] 2> 1664974 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1664978 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@11810f6c{/,null,AVAILABLE}
[junit4] 2> 1664978 T9146 oejs.AbstractConnector.doStart Started ServerConnector@5e936a6e{HTTP/1.1}{127.0.0.1:50927}
[junit4] 2> 1664978 T9146 oejs.Server.doStart Started @1666616ms
[junit4] 2> 1665007 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/lib).
[junit4] 2> 1667461 T9225 n:127.0.0.1:50927_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1667773 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection1
[junit4] 2> 1667776 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1667780 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4acc75a0{/,null,AVAILABLE}
[junit4] 2> 1667781 T9146 oejs.AbstractConnector.doStart Started ServerConnector@1ab7ba9a{HTTP/1.1}{127.0.0.1:34814}
[junit4] 2> 1667781 T9146 oejs.Server.doStart Started @1669419ms
[junit4] 2> 1667813 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/lib).
[junit4] 2> 1670206 T9247 n:127.0.0.1:34814_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1670578 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/cores/collection1
[junit4] 2> 1670582 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1670585 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4d9ab64{/,null,AVAILABLE}
[junit4] 2> 1670586 T9146 oejs.AbstractConnector.doStart Started ServerConnector@67fa54b6{HTTP/1.1}{127.0.0.1:52350}
[junit4] 2> 1670586 T9146 oejs.Server.doStart Started @1672224ms
[junit4] 2> 1670617 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/lib).
[junit4] 2> 1672996 T9269 n:127.0.0.1:52350_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1673328 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection1
[junit4] 2> 1673331 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1673334 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@2bd0d357{/,null,AVAILABLE}
[junit4] 2> 1673334 T9146 oejs.AbstractConnector.doStart Started ServerConnector@2ff61aa0{HTTP/1.1}{127.0.0.1:56400}
[junit4] 2> 1673335 T9146 oejs.Server.doStart Started @1674973ms
[junit4] 2> 1673365 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/lib).
[junit4] 2> 1675758 T9294 n:127.0.0.1:56400_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1676104 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection1
[junit4] 2> 1676107 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1676110 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@3f666854{/,null,AVAILABLE}
[junit4] 2> 1676110 T9146 oejs.AbstractConnector.doStart Started ServerConnector@619a2886{HTTP/1.1}{127.0.0.1:52653}
[junit4] 2> 1676111 T9146 oejs.Server.doStart Started @1677749ms
[junit4] 2> 1676144 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/lib).
[junit4] 2> 1678661 T9319 n:127.0.0.1:52653_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1678762 T9146 oas.SolrTestCaseJ4.setUp ###Starting test
[junit4] 2> ASYNC NEW_CORE C3298 name=collection1 org.apache.solr.core.SolrCore@7cc7b0e3 url=http://127.0.0.1:52350/collection1 node=127.0.0.1:52350_ C3298_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:52350, node_name=127.0.0.1:52350_}
[junit4] 2> 1681065 T9274 n:127.0.0.1:52350_ c:collection1 s:shard1 x:collection1 C3298 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3299 name=collection1 org.apache.solr.core.SolrCore@59e88613 url=http://127.0.0.1:56400/collection1 node=127.0.0.1:56400_ C3299_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1683829 T9299 n:127.0.0.1:56400_ c:collection1 s:shard2 x:collection1 C3299 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3300 name=collection1 org.apache.solr.core.SolrCore@76357e56 url=http://127.0.0.1:52653/collection1 node=127.0.0.1:52653_ C3300_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1686794 T9324 n:127.0.0.1:52653_ c:collection1 s:shard3 x:collection1 C3300 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> 1687256 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687307 T9320 n:127.0.0.1:52653_ c:collection1 s:shard3 r:core_node6 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687307 T9248 n:127.0.0.1:34814_ c:collection1 s:shard3 r:core_node3 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687309 T9248 n:127.0.0.1:34814_ c:collection1 s:shard3 r:core_node3 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687311 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:id=org.apache.solr.search.FastLRUCache,type=fieldValueCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715031 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715275 T9295 n:127.0.0.1:56400_ c:collection1 s:shard2 r:core_node5 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715277 T9270 n:127.0.0.1:52350_ c:collection1 s:shard1 r:core_node4 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1716861 T9202 n:127.0.0.1:39158_ oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1716872 T9146 oejs.AbstractConnector.doStop Stopped ServerConnector@70f634d7{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1716872 T9146 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@15d381ea{/,null,UNAVAILABLE}
[junit4] 2> ASYNC NEW_CORE C3301 name=collection1 org.apache.solr.core.SolrCore@7cc7b0e3 url=http://127.0.0.1:52350/collection1 node=127.0.0.1:52350_ C3301_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, base_url=http://127.0.0.1:52350, node_name=127.0.0.1:52350_}
[junit4] 2> 1717864 T9268 n:127.0.0.1:52350_ C3301 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 1718380 T9407 n:127.0.0.1:52350_ oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1718385 T9146 oejs.AbstractConnector.doStop Stopped ServerConnector@67fa54b6{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1718385 T9146 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@4d9ab64{/,null,UNAVAILABLE}
[junit4] 2> ASYNC NEW_CORE C3302 name=collection1 org.apache.solr.core.SolrCore@2168fff4 url=http://127.0.0.1:50927/collection1 node=127.0.0.1:50927_ C3302_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_, leader=true}
[junit4] 2> 1723442 T9212 n:127.0.0.1:50927_ c:collection1 s:shard2 r:core_node2 x:collection1 C3302 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard1
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:684)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:670)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:363)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:314)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:665)
[junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
[junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
[junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:98)
[junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2059)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:640)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
[junit4] 2> at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:497)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1723451 T9414 n:127.0.0.1:37384_ c:collection1 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : delete , {
[junit4] 2> "name":"collection1",
[junit4] 2> "operation":"delete"}
[junit4] 2> 1723485 T9318 n:127.0.0.1:52653_ oasc.LeaderElector.checkIfIamLeader WARN Our node is no longer in line to be leader
[junit4] 2> 1723486 T9409 n:127.0.0.1:56400_ oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove /collections/collection1/leader_elect/shard2/election/93881794365554702-core_node5-n_0000000001
[junit4] 2> 1723487 T9409 n:127.0.0.1:56400_ oasc.LeaderElector$ElectionWatcher.process WARN org.apache.solr.common.SolrException: SolrCore not found:collection1 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:215)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:198)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:390)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1724234 T9419 n:127.0.0.1:37384_ c:collection2 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "name":"collection2",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"7",
[junit4] 2> "maxShardsPerNode":"100000",
[junit4] 2> "stateFormat":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1729314 T9310 n:127.0.0.1:52653_ x:collection2_shard5_replica2 oasc.SolrCore.initIndex WARN [collection2_shard5_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard5_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729361 T9285 n:127.0.0.1:56400_ x:collection2_shard3_replica2 oasc.SolrCore.initIndex WARN [collection2_shard3_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729379 T9164 n:127.0.0.1:37384_ x:collection2_shard4_replica2 oasc.SolrCore.initIndex WARN [collection2_shard4_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729643 T9213 n:127.0.0.1:50927_ x:collection2_shard7_replica2 oasc.SolrCore.initIndex WARN [collection2_shard7_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard7_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729786 T9162 n:127.0.0.1:37384_ x:collection2_shard7_replica3 oasc.SolrCore.initIndex WARN [collection2_shard7_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard7_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729829 T9308 n:127.0.0.1:52653_ x:collection2_shard3_replica3 oasc.SolrCore.initIndex WARN [collection2_shard3_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729853 T9214 n:127.0.0.1:50927_ x:collection2_shard5_replica3 oasc.SolrCore.initIndex WARN [collection2_shard5_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard5_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729889 T9237 n:127.0.0.1:34814_ x:collection2_shard1_replica2 oasc.SolrCore.initIndex WARN [collection2_shard1_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729902 T9235 n:127.0.0.1:34814_ x:collection2_shard3_replica1 oasc.SolrCore.initIndex WARN [collection2_shard3_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard3_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729950 T9282 n:127.0.0.1:56400_ x:collection2_shard5_replica1 oasc.SolrCore.initIndex WARN [collection2_shard5_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard5_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730920 T9307 n:127.0.0.1:52653_ x:collection2_shard7_replica1 oasc.SolrCore.initIndex WARN [collection2_shard7_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard7_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730929 T9309 n:127.0.0.1:52653_ x:collection2_shard2_replica1 oasc.SolrCore.initIndex WARN [collection2_shard2_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730950 T9165 n:127.0.0.1:37384_ x:collection2_shard1_replica1 oasc.SolrCore.initIndex WARN [collection2_shard1_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730984 T9163 n:127.0.0.1:37384_ x:collection2_shard6_replica1 oasc.SolrCore.initIndex WARN [collection2_shard6_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard6_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730990 T9215 n:127.0.0.1:50927_ x:collection2_shard2_replica2 oasc.SolrCore.initIndex WARN [collection2_shard2_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731056 T9281 n:127.0.0.1:56400_ x:collection2_shard6_replica3 oasc.SolrCore.initIndex WARN [collection2_shard6_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard6_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731057 T9212 n:127.0.0.1:50927_ x:collection2_shard4_replica1 oasc.SolrCore.initIndex WARN [collection2_shard4_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard4_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731167 T9284 n:127.0.0.1:56400_ x:collection2_shard1_replica3 oasc.SolrCore.initIndex WARN [collection2_shard1_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731193 T9236 n:127.0.0.1:34814_ x:collection2_shard4_replica3 oasc.SolrCore.initIndex WARN [collection2_shard4_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard4_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731203 T9238 n:127.0.0.1:34814_ x:collection2_shard6_replica2 oasc.SolrCore.initIndex WARN [collection2_shard6_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard6_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731211 T9435 n:127.0.0.1:37384_ x:collection2_shard2_replica3 oasc.SolrCore.initIndex WARN [collection2_shard2_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard2_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> ASYNC NEW_CORE C3303 name=collection2_shard3_replica1 org.apache.solr.core.SolrCore@376b26a8 url=http://127.0.0.1:34814/collection2_shard3_replica1 node=127.0.0.1:34814_ C3303_STATE=coll:collection2 core:collection2_shard3_replica1 props:{state=recovering, core=collection2_shard3_replica1, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739142 T9482 n:127.0.0.1:34814_ c:collection2 s:shard3 x:collection2_shard3_replica1 C3303 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3304 name=collection2_shard5_replica3 org.apache.solr.core.SolrCore@cb16afd url=http://127.0.0.1:50927/collection2_shard5_replica3 node=127.0.0.1:50927_ C3304_STATE=coll:collection2 core:collection2_shard5_replica3 props:{state=recovering, core=collection2_shard5_replica3, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739142 T9483 n:127.0.0.1:50927_ c:collection2 s:shard5 x:collection2_shard5_replica3 C3304 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3305 name=collection2_shard5_replica1 org.apache.solr.core.SolrCore@656d4d8e url=http://127.0.0.1:56400/collection2_shard5_replica1 node=127.0.0.1:56400_ C3305_STATE=coll:collection2 core:collection2_shard5_replica1 props:{state=recovering, core=collection2_shard5_replica1, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1739155 T9487 n:127.0.0.1:56400_ c:collection2 s:shard5 x:collection2_shard5_replica1 C3305 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3306 name=collection2_shard3_replica3 org.apache.solr.core.SolrCore@45e7efc6 url=http://127.0.0.1:52653/collection2_shard3_replica3 node=127.0.0.1:52653_ C3306_STATE=coll:collection2 core:collection2_shard3_replica3 props:{state=recovering, core=collection2_shard3_replica3, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1739157 T9479 n:127.0.0.1:52653_ c:collection2 s:shard3 x:collection2_shard3_replica3 C3306 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3307 name=collection2_shard1_replica3 org.apache.solr.core.SolrCore@200d65c6 url=http://127.0.0.1:56400/collection2_shard1_replica3 node=127.0.0.1:56400_ C3307_STATE=coll:collection2 core:collection2_shard1_replica3 props:{state=recovering, core=collection2_shard1_replica3, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1739377 T9509 n:127.0.0.1:56400_ c:collection2 s:shard1 x:collection2_shard1_replica3 C3307 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3308 name=collection2_shard7_replica3 org.apache.solr.core.SolrCore@b581d6e url=http://127.0.0.1:37384/collection2_shard7_replica3 node=127.0.0.1:37384_ C3308_STATE=coll:collection2 core:collection2_shard7_replica3 props:{state=recovering, core=collection2_shard7_replica3, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739379 T9520 n:127.0.0.1:37384_ c:collection2 s:shard7 x:collection2_shard7_replica3 C3308 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3309 name=collection2_shard4_replica3 org.apache.solr.core.SolrCore@7c63528d url=http://127.0.0.1:34814/collection2_shard4_replica3 node=127.0.0.1:34814_ C3309_STATE=coll:collection2 core:collection2_shard4_replica3 props:{state=recovering, core=collection2_shard4_replica3, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739406 T9510 n:127.0.0.1:34814_ c:collection2 s:shard4 x:collection2_shard4_replica3 C3309 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3310 name=collection2_shard1_replica1 org.apache.solr.core.SolrCore@40c37096 url=http://127.0.0.1:37384/collection2_shard1_replica1 node=127.0.0.1:37384_ C3310_STATE=coll:collection2 core:collection2_shard1_replica1 props:{state=recovering, core=collection2_shard1_replica1, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739410 T9513 n:127.0.0.1:37384_ c:collection2 s:shard1 x:collection2_shard1_replica1 C3310 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3311 name=collection2_shard7_replica1 org.apache.solr.core.SolrCore@498e673 url=http://127.0.0.1:52653/collection2_shard7_replica1 node=127.0.0.1:52653_ C3311_STATE=coll:collection2 core:collection2_shard7_replica1 props:{state=recovering, core=collection2_shard7_replica1, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1739411 T9521 n:127.0.0.1:52653_ c:collection2 s:shard7 x:collection2_shard7_replica1 C3311 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3312 name=collection2_shard6_replica2 org.apache.solr.core.SolrCore@53166389 url=http://127.0.0.1:34814/collection2_shard6_replica2 node=127.0.0.1:34814_ C3312_STATE=coll:collection2 core:collection2_shard6_replica2 props:{state=recovering, core=collection2_shard6_replica2, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739411 T9511 n:127.0.0.1:34814_ c:collection2 s:shard6 x:collection2_shard6_replica2 C3312 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3313 name=collection2_shard2_replica3 org.apache.solr.core.SolrCore@436c8b49 url=http://127.0.0.1:37384/collection2_shard2_replica3 node=127.0.0.1:37384_ C3313_STATE=coll:collection2 core:collection2_shard2_replica3 props:{state=recovering, core=collection2_shard2_replica3, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739415 T9514 n:127.0.0.1:37384_ c:collection2 s:shard2 x:collection2_shard2_replica3 C3313 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3314 name=collection2_shard4_replica1 org.apache.solr.core.SolrCore@3d6fce97 url=http://127.0.0.1:50927/collection2_shard4_replica1 node=127.0.0.1:50927_ C3314_STATE=coll:collection2 core:collection2_shard4_replica1 props:{state=recovering, core=collection2_shard4_replica1, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739417 T9517 n:127.0.0.1:50927_ c:collection2 s:shard4 x:collection2_shard4_replica1 C3314 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3315 name=collection2_shard6_replica1 org.apache.solr.core.SolrCore@3130d012 url=http://127.0.0.1:37384/collection2_shard6_replica1 node=127.0.0.1:37384_ C3315_STATE=coll:collection2 core:collection2_shard6_replica1 props:{state=recovering, core=collection2_shard6_replica1, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739418 T9522 n:127.0.0.1:37384_ c:collection2 s:shard6 x:collection2_shard6_replica1 C3315 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3316 name=collection2_shard2_replica2 org.apache.solr.core.SolrCore@18212853 url=http://127.0.0.1:50927/collection2_shard2_replica2 node=127.0.0.1:50927_ C3316_STATE=coll:collection2 core:collection2_shard2_replica2 props:{state=recovering, core=collection2_shard2_replica2, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739420 T9519 n:127.0.0.1:50927_ c:collection2 s:shard2 x:collection2_shard2_replica2 C3316 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (7)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1> {"id":"93881794365554691-127.0.0.1:37384_-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (5)
[junit4] 1> /solr/overseer_elect/election/93881794365554704-127.0.0.1:52653_-n_0000000006 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554698-127.0.0.1:34814_-n_0000000003 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554696-127.0.0.1:50927_-n_0000000002 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554691-127.0.0.1:37384_-n_0000000000 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554702-127.0.0.1:56400_-n_0000000005 (0)
[junit4] 1> /solr/collections (2)
[junit4] 1> /solr/collections/collection2 (2)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection2/leaders (7)
[junit4] 1> /solr/collections/collection2/leaders/shard2 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard2_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}
[junit4] 1> /solr/collections/collection2/leaders/shard5 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard5_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}
[junit4] 1> /solr/collections/collection2/leaders/shard4 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard4_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}
[junit4] 1> /solr/collections/collection2/leaders/shard7 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard7_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"}
[junit4] 1> /solr/collections/collection2/leaders/shard3 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard3_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}
[junit4] 1> /solr/collections/collection2/leaders/shard1 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard1_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"}
[junit4] 1> /solr/collections/collection2/leaders/shard6 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard6_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}
[junit4] 1> /solr/collections/collection2/leader_elect (7)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554691-core_node20-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554704-core_node11-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554696-core_node9-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554696-core_node8-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554702-core_node17-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554704-core_node10-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554691-core_node12-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554698-core_node3-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554696-core_node6-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554704-core_node13-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554691-core_node2-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554696-core_node21-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554704-core_node14-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554698-core_node7-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554702-core_node1-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554691-core_node18-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554702-core_node15-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554698-core_node5-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554702-core_node19-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554691-core_node16-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554698-core_node4-n_0000000002 (0)
[junit4] 1> /solr/collections/control_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/93881794365554691-core_node1-n_0000000000 (0)
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "control_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_",
[junit4] 1> "leader":"true"}}}}},
[junit4] 1> "collection2":{
[junit4] 1> "replicationFactor":"3",
[junit4] 1> "maxShardsPerNode":"100000",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-a491ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node5":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node15":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"},
[junit4] 1> "core_node18":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"a4920000-c923ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node9":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node11":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node20":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}}},
[junit4] 1> "shard3":{
[junit4] 1> "range":"c9240000-edb5ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node7":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node14":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}}},
[junit4] 1> "shard4":{
[junit4] 1> "range":"edb60000-1248ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node3":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node6":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node12":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_",
[junit4] 1> "leader":"true"}}},
[junit4] 1> "shard5":{
[junit4] 1> "range":"12490000-36daffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node8":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node10":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node17":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}}},
[junit4] 1> "shard6":{
[junit4] 1> "range":"36db0000-5b6cffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node4":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node16":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"},
[junit4] 1> "core_node19":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_",
[junit4] 1> "leader":"true"}}},
[junit4] 1> "shard7":{
[junit4] 1> "range":"5b6d0000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"},
[junit4] 1> "core_node13":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"},
[junit4] 1> "core_node21":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_",
[junit4] 1> "leader":"true"}}}}}}
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4] 1> "timestamp": 1332070464,
[junit4] 1>
[junit4] 1>
[junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/live_nodes (5)
[junit4] 1> /solr/live_nodes/127.0.0.1:37384_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:56400_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:52653_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:34814_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:50927_ (0)
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> ######controlDocList: SolrDocumentList[sz=100000 numFound=103384]=[SolrDocument{id=thread0_0_174}, SolrDocument{id=thread3_0_8}, SolrDocument{id=thread1_0_260}, SolrDocument{id=thread0_0_177}, SolrDocument{id=thread3_0_13}] , [...] , [SolrDocument{id=thread0_9_463}, SolrDocument{id=thread0_9_464}, SolrDocument{id=thread0_9_465}, SolrDocument{id=thread0_9_466}, SolrDocument{id=thread0_9_467}]
[junit4] 2> ######cloudDocList: SolrDocumentList[sz=100000 numFound=103384]=[SolrDocument{id=thread1_0_0}, SolrDocument{id=thread1_0_2}, SolrDocument{id=thread1_0_6}, SolrDocument{id=thread1_0_8}, SolrDocument{id=thread1_0_26}] , [...] , [SolrDocument{id=thread2_8_30}, SolrDocument{id=thread2_8_36}, SolrDocument{id=thread2_8_48}, SolrDocument{id=thread2_8_52}, SolrDocument{id=thread2_8_55}]
[junit4] 2> ###### sizes=100000,100000
[junit4] 2> ###### Only in controlDocList: [{id=thread2_8_2272}, {id=thread3_7_631}, {id=thread3_7_635}, {id=thread3_7_636}, {id=thread3_7_639}, {id=thread3_7_620}, {id=thread2_8_2258}, {id=thread3_7_628}, {id=thread2_8_2252}, {id=thread3_7_652}, {id=thread3_7_640}, {id=thread3_7_642}, {id=thread2_8_2236}, {id=thread3_7_644}, {id=thread3_7_647}, {id=thread2_8_2298}, {id=thread2_8_2283}, {id=thread2_8_2285}, {id=thread3_7_607}, {id=thread3_7_676}, {id=thread2_8_2231}, {id=thread2_8_2219}, {id=thread2_8_2221}, {id=thread2_8_2202}, {id=thread2_8_2206}, {id=thread2_8_2212}, {id=thread2_8_2201}, {id=thread2_8_2200}, {id=thread3_7_779}, {id=thread2_8_2129}, {id=thread2_8_2122}, {id=thread2_8_2119}, {id=thread2_8_2118}, {id=thread3_7_767}, {id=thread3_7_760}, {id=thread2_8_2151}, {id=thread2_8_2141}, {id=thread3_7_744}, {id=thread3_7_747}, {id=thread2_8_2136}, {id=thread3_7_742}, {id=thread3_7_729}, {id=thread2_8_2171}, {id=thread2_8_2169}, {id=thread3_7_734}, {id=thread2_8_2164}, {id=thread3_7_725}, {id=thread3_7_724}, {id=thread2_8_2196}, {id=thread2_8_2182}, {id=thread3_7_791}, {id=thread3_7_798}, {id=thread3_7_782}, {id=thread3_7_787}, {id=thread2_8_2084}, {id=thread2_8_2094}, {id=thread2_8_2072}, {id=thread2_8_2048}, {id=thread2_8_2051}, {id=thread2_8_2056}, {id=thread2_8_2039}, {id=thread2_8_2040}, {id=thread2_8_2043}, {id=thread2_8_2044}, {id=thread2_8_2047}, {id=thread2_8_2006}, {id=thread2_8_2008}, {id=thread2_8_2001}, {id=thread1_12_394}, {id=thread1_12_380}, {id=thread1_12_376}, {id=thread1_12_369}, {id=thread1_12_356}, {id=thread1_12_351}, {id=thread1_12_341}, {id=thread1_12_344}, {id=thread1_12_321}, {id=thread1_12_324}, {id=thread1_12_323}, {id=thread3_7_276}, {id=thread3_7_261}, {id=thread3_7_293}, {id=thread3_7_291}, {id=thread1_12_309}, {id=thread1_12_302}, {id=thread3_7_295}, {id=thread3_7_283}, {id=thread3_7_250}, {id=thread3_7_208}, {id=thread3_7_203}, {id=thread3_7_215}, {id=thread1_13_893}, {id=thread1_13_864}, {id=thread1_13_858}, {id=thread1_12_498}, {id=thread1_12_450}, {id=thread1_12_482}, {id=thread1_12_426}, {id=thread1_12_421}, {id=thread1_12_420}, {id=thread1_12_422}, {id=thread1_12_413}, {id=thread1_12_419}, {id=thread3_7_390}, {id=thread3_7_397}, {id=thread1_12_442}, {id=thread1_12_445}, {id=thread1_12_444}, {id=thread1_12_440}, {id=thread1_12_437}, {id=thread3_7_381}, {id=thread3_7_360}, {id=thread3_7_379}, {id=thread3_7_348}, {id=thread3_7_342}, {id=thread1_13_728}, {id=thread3_7_359}, {id=thread3_7_354}, {id=thread3_7_357}, {id=thread1_12_404}, {id=thread1_12_402}, {id=thread1_12_408}, {id=thread3_7_320}, {id=thread3_7_333}, {id=thread3_7_335}, {id=thread3_7_336}, {id=thread3_7_337}, {id=thread3_7_339}, {id=thread3_7_300}, {id=thread1_13_749}, {id=thread1_13_765}, {id=thread1_13_763}, {id=thread1_12_135}, {id=thread1_12_180}, {id=thread1_12_185}, {id=thread1_12_186}, {id=thread1_12_104}, {id=thread3_7_430}, {id=thread3_7_455}, {id=thread3_7_461}, {id=thread3_7_475}, {id=thread3_7_479}, {id=thread3_7_481}, {id=thread3_7_495}, {id=thread3_7_406}, {id=thread1_12_262}, {id=thread1_12_277}, {id=thread1_12_295}, {id=thread1_12_213}, {id=thread1_12_219}, {id=thread1_12_244}, {id=thread1_12_246}, {id=thread1_12_234}, {id=thread1_13_900}, {id=thread3_7_560}, {id=thread3_7_579}, {id=thread3_7_545}, {id=thread1_13_912}, {id=thread3_7_552}, {id=thread3_7_553}, {id=thread3_7_583}, {id=thread3_7_588}, {id=thread3_7_590}, {id=thread3_7_592}, {id=thread3_7_597}, {id=thread3_7_529}, {id=thread3_7_520}, {id=thread3_7_539}, {id=thread3_7_530}, {id=thread3_7_519}, {id=thread3_7_510}, {id=thread1_13_439}, {id=thread1_13_435}, {id=thread1_13_440}, {id=thread1_13_476}, {id=thread1_13_474}, {id=thread1_13_316}, {id=thread1_13_315}, {id=thread1_13_327}, {id=thread1_13_355}, {id=thread1_13_357}, {id=thread1_13_341}, {id=thread1_13_346}, {id=thread1_13_338}, {id=thread1_13_335}, {id=thread1_13_627}, {id=thread1_13_629}, {id=thread1_13_631}, {id=thread1_13_630}, {id=thread1_13_648}, {id=thread1_13_663}, {id=thread1_13_682}, {id=thread0_10_2014}, {id=thread0_10_2002}, {id=thread0_10_2005}, {id=thread0_10_2007}, {id=thread1_13_603}, {id=thread0_10_2022}, {id=thread0_10_2021}, {id=thread1_13_502}, {id=thread1_13_565}, {id=thread1_13_563}, {id=thread1_13_561}, {id=thread1_13_532}, {id=thread1_13_542}, {id=thread1_13_540}, {id=thread3_7_117}, {id=thread3_7_138}, {id=thread3_7_135}, {id=thread3_7_130}, {id=thread3_7_131}, {id=thread3_7_120}, {id=thread3_7_148}, {id=thread3_7_141}, {id=thread3_7_159}, {id=thread3_7_158}, {id=thread3_7_162}, {id=thread3_7_176}, {id=thread3_7_171}, {id=thread3_7_173}, {id=thread3_7_186}, {id=thread3_7_180}, {id=thread3_7_196}, {id=thread3_7_199}, {id=thread3_7_194}, {id=thread1_13_594}, {id=thread1_13_593}, {id=thread1_13_592}, {id=thread1_13_578}, {id=thread0_8_1843}, {id=thread0_8_1844}, {id=thread0_8_1876}, {id=thread0_8_1815}, {id=thread0_8_1811}, {id=thread0_8_1803}, {id=thread0_8_1807}, {id=thread0_8_1823}, {id=thread0_8_1825}, {id=thread0_8_1890}, {id=thread0_8_1891}, {id=thread0_8_1750}, {id=thread0_8_1748}, {id=thread0_8_1742}, {id=thread0_8_1737}, {id=thread0_8_1733}, {id=thread0_8_1718}, {id=thread0_8_1716}, {id=thread0_8_1700}, {id=thread0_8_1708}, {id=thread0_8_1785}, {id=thread0_8_1783}, {id=thread0_8_1786}, {id=thread1_13_214}, {id=thread1_13_226}, {id=thread1_13_235}, {id=thread1_13_254}, {id=thread1_13_250}, {id=thread1_13_274}, {id=thread1_13_279}, {id=thread1_13_278}, {id=thread1_13_276}, {id=thread3_10_2020}, {id=thread1_13_292}, {id=thread1_13_299}, {id=thread0_8_1957}, {id=thread0_8_1955}, {id=thread0_8_1996}, {id=thread0_8_1993}, {id=thread0_8_1994}, {id=thread0_8_1987}, {id=thread0_8_1980}, {id=thread0_8_1981}, {id=thread0_8_1979}, {id=thread0_8_1977}, {id=thread0_8_1970}, {id=thread0_8_1968}, {id=thread0_8_1903}, {id=thread1_13_157}, {id=thread1_13_167}, {id=thread1_13_143}, {id=thread1_13_176}, {id=thread1_13_186}, {id=thread1_13_187}, {id=thread1_13_182}, {id=thread0_8_2623}, {id=thread0_8_2627}, {id=thread0_8_2614}, {id=thread0_8_2617}, {id=thread0_8_2619}, {id=thread0_8_2644}, {id=thread0_8_2643}, {id=thread0_8_2649}, {id=thread0_8_2636}, {id=thread0_8_2637}, {id=thread0_8_2639}, {id=thread0_8_2669}, {id=thread0_8_2691}, {id=thread0_8_2690}, {id=thread0_8_2677}, {id=thread0_8_2674}, {id=thread0_8_2673}, {id=thread0_8_2681}, {id=thread0_8_2699}, {id=thread0_8_2607}, {id=thread0_8_2601}, {id=thread0_8_2765}, {id=thread0_8_2770}, {id=thread0_8_2750}, {id=thread0_8_2760}, {id=thread0_8_2730}, {id=thread0_8_2731}, {id=thread0_8_2733}, {id=thread0_8_2772}, {id=thread0_8_2714}, {id=thread0_8_2725}, {id=thread0_8_2702}, {id=thread0_8_2867}, {id=thread0_8_2868}, {id=thread0_8_2850}, {id=thread0_8_2851}, {id=thread0_8_2892}, {id=thread0_8_2884}, {id=thread0_8_2882}, {id=thread0_8_2871}, {id=thread0_8_2873}, {id=thread0_8_2874}, {id=thread0_8_2817}, {id=thread0_8_2815}, {id=thread0_8_2813}, {id=thread0_8_2848}, {id=thread2_11_26}, {id=thread2_11_27}, {id=thread2_11_10}, {id=thread2_11_16}, {id=thread2_11_44}, {id=thread2_11_31}, {id=thread2_11_37}, {id=thread2_11_39}, {id=thread2_11_62}, {id=thread2_11_55}, {id=thread2_11_57}, {id=thread2_11_50}, {id=thread0_8_2981}, {id=thread0_8_2987}, {id=thread2_11_86}, {id=thread0_8_2988}, {id=thread2_11_85}, {id=thread0_8_2980}, {id=thread2_11_78}, {id=thread0_8_2972}, {id=thread2_11_76}, {id=thread2_11_93}, {id=thread2_11_94}, {id=thread0_8_2931}, {id=thread0_8_2944}, {id=thread0_8_2943}, {id=thread0_8_2912}, {id=thread0_8_2918}, {id=thread0_8_2916}, {id=thread0_8_2921}, {id=thread0_8_2922}, {id=thread0_8_2903}, {id=thread0_8_2221}, {id=thread0_8_2211}, {id=thread0_8_2231}, {id=thread0_8_2227}, {id=thread0_8_2235}, {id=thread0_8_2275}, {id=thread0_8_2269}, {id=thread0_8_2280}, {id=thread0_8_2297}, {id=thread0_9_
[...truncated too long message...]
tCase.java:621)
[junit4] 2>
[junit4] 2> 2725727 T18704 oas.SolrTestCaseJ4.tearDown ###Ending test
[junit4] 2> 2725736 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@4b20166a{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725746 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@710f8cd1{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725764 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@7383b8f6{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725776 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@45f21856{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725792 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@5fc707f8{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725807 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@5dd38269{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725816 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@196e319a{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725827 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@ee57258{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725829 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@75da046b{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725842 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@3ba359f{/av_/oc,null,UNAVAILABLE}
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedFacetPivotSmallTest -Dtests.method=test -Dtests.seed=B855A1C7B309F547 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=iw -Dtests.timezone=US/Alaska -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 5.60s J2 | DistributedFacetPivotSmallTest.test <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35094/av_/oc/collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37832/av_/oc/collection1, http://[ff01::114]:33332/av_/oc, http://[ff01::083]:33332/av_/oc, http://[ff01::213]:33332/av_/oc]
[junit4] > at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
[junit4] > at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
[junit4] > at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:621)
[junit4] 2> 2725850 T18704 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=LuceneFixedGap), solo_s=PostingsFormat(name=Direct), company_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), place_t=PostingsFormat(name=LuceneFixedGap), id=FSTOrd50, range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l_dv=FSTOrd50, text=PostingsFormat(name=Direct), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), price_ti=PostingsFormat(name=Direct), solo_i=FSTOrd50, solo_dt=PostingsFormat(name=LuceneFixedGap), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{timestamp=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), range_facet_l_dv=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=iw, timezone=US/Alaska
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=216630088,total=517996544
[junit4] 2> NOTE: All tests run in this JVM: [OpenExchangeRatesOrgProviderTest, TermVectorComponentDistributedTest, HttpPartitionTest, AddBlockUpdateTest, DocValuesTest, MultiThreadedOCPTest, CollectionsAPIAsyncDistributedZkTest, TestNonDefinedSimilarityFactory, InfoHandlerTest, TestRecoveryHdfs, ZkStateWriterTest, DistributedFacetPivotLongTailTest, MoreLikeThisHandlerTest, RegexBoostProcessorTest, SoftAutoCommitTest, TestTrie, HardAutoCommitTest, TestCSVResponseWriter, NumericFieldsTest, DOMUtilTest, QueryEqualityTest, QueryParsingTest, TestStandardQParsers, TestCloudPivotFacet, SimpleFacetsTest, TestNRTOpen, TestReRankQParserPlugin, CircularListTest, SampleTest, SynonymTokenizerTest, SOLR749Test, LoggingHandlerTest, TestDistributedStatsComponentCardinality, BasicDistributedZk2Test, AutoCommitTest, TestCloudInspectUtil, DistributedFacetPivotSmallAdvancedTest, CustomCollectionTest, TestReplicationHandlerBackup, TestFieldTypeResource, TestExtendedDismaxParser, DateRangeFieldTest, TestInfoStreamLogging, RemoteQueryErrorTest, DirectUpdateHandlerTest, TestQueryUtils, SuggesterTest, PolyFieldTest, TestSimpleQParserPlugin, TestClusterStateMutator, TestConfigOverlay, ActionThrottleTest, TestJettySolrRunner, TestFieldSortValues, BadIndexSchemaTest, TestBlobHandler, DistributedQueryElevationComponentTest, TestGroupingSearch, TestDefaultSimilarityFactory, TestSchemaSimilarityResource, RankQueryTest, TestFastOutputStream, DistribDocExpirationUpdateProcessorTest, TestBulkSchemaAPI, PluginInfoTest, ConcurrentDeleteAndCreateCollectionTest, XmlUpdateRequestHandlerTest, TestSurroundQueryParser, TestStressRecovery, SearchHandlerTest, ShardSplitTest, TestPartialUpdateDeduplication, QueryResultKeyTest, TestHighlightDedupGrouping, SaslZkACLProviderTest, SpellCheckCollatorTest, TestTrackingShardHandlerFactory, TestCollationField, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestRecovery, TestStressReorder, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, StatsComponentTest, TestIndexSearcher, CurrencyFieldXmlFileTest, AnalysisAfterCoreReloadTest, SuggesterFSTTest, TestStressLucene, SolrCoreCheckLockOnStartupTest, TestUpdate, TestAtomicUpdateErrorCases, SortByFunctionTest, SolrInfoMBeanTest, CacheHeaderTest, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestSolrQueryParser, IndexSchemaTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, TestLFUCache, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, AsyncMigrateRouteKeyTest, DeleteInactiveReplicaTest, DistribJoinFromCollectionTest, ExternalCollectionsTest, LeaderFailoverAfterPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, SSLMigrationTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestCollectionAPI, TestCryptoKeys, TestRequestStatusCollectionAPI, TriLevelCompositeIdRoutingTest, RequestLoggingTest, TestRestoreCore, CoreAdminRequestStatusTest, CoreMergeIndexesAdminHandlerTest, DistributedFacetPivotSmallTest]
[junit4] Completed [433/496] on J2 in 6.18s, 1 test, 1 error <<< FAILURES!
[...truncated 199 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1973 tests, 2 errors, 51 ignored (10 assumptions)
Total time: 151 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 854028375 bytes
Compression is 0.0%
Took 2 min 12 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 858 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/858/
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=4271, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4271, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42343/zg_x: collection already exists: awholynewstresscollection_collection1_1
at __randomizedtesting.SeedInfo.seed([A7DF9F764311F131]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1621)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1642)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:877)
Build Log:
[...truncated 10359 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/init-core-data-001
[junit4] 2> 491076 T3943 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 491076 T3943 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /zg_x/
[junit4] 2> 491081 T3943 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 491081 T3944 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 491082 T3944 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 491181 T3943 oasc.ZkTestServer.run start zk server on port:39162
[junit4] 2> 491182 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491183 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491187 T3951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72318b04 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491188 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491188 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491189 T3943 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 491193 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491193 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491195 T3954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b4c6d89 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491195 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491196 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491196 T3943 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 491200 T3943 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 491203 T3943 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 491205 T3943 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 491209 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 491210 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 491214 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 491215 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 491219 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491220 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491223 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 491224 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 491227 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 491228 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 491231 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 491231 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 491234 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 491234 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 491237 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 491237 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 491240 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 491241 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 491244 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 491244 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 491247 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 491248 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 491251 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491253 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491255 T3957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b6dd8b5 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491255 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491256 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491256 T3943 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 491258 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491259 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491261 T3960 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e5551d2 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491262 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491262 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491263 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 491264 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 491268 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 491269 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 491272 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 491273 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 491279 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491280 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491283 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 491284 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 491287 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 491288 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 491291 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 491291 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 491294 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 491295 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 491297 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 491298 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 491300 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 491301 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 491303 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 491304 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 491306 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 491307 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 491633 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1
[junit4] 2> 491635 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 491637 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@e568c69{/zg_x,null,AVAILABLE}
[junit4] 2> 491639 T3943 oejs.AbstractConnector.doStart Started ServerConnector@cf2c9b3{HTTP/1.1}{127.0.0.1:40177}
[junit4] 2> 491640 T3943 oejs.Server.doStart Started @493160ms
[junit4] 2> 491640 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/zg_x, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores, hostPort=40177}
[junit4] 2> 491641 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 491641 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/'
[junit4] 2> 491657 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/solr.xml
[junit4] 2> 491673 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores
[junit4] 2> 491673 T3943 oasc.CoreContainer.<init> New CoreContainer 635411005
[junit4] 2> 491674 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/]
[junit4] 2> 491674 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/lib
[junit4] 2> 491674 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/lib).
[junit4] 2> 491700 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 491702 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 491703 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 491703 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 491704 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 491704 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 491704 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 491705 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491706 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491708 T3974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56db1007 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491709 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491710 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491713 T3943 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491714 T3977 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@760ed9b7 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491715 T3943 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491717 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 491722 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 491725 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 491728 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 491730 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 491734 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 491736 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 491738 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 491739 T3943 n:127.0.0.1:40177_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40177_zg_x
[junit4] 2> 491740 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40177_zg_x
[junit4] 2> 491742 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 491744 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 491746 T3943 n:127.0.0.1:40177_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 491748 T3943 n:127.0.0.1:40177_zg_x oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40177_zg_x
[junit4] 2> 491748 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 491750 T3943 n:127.0.0.1:40177_zg_x oasc.Overseer.start Overseer (id=93885543106347013-127.0.0.1:40177_zg_x-n_0000000000) starting
[junit4] 2> 491753 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 491761 T3943 n:127.0.0.1:40177_zg_x oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 491762 T3943 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 491762 T3979 n:127.0.0.1:40177_zg_x oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 491762 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 491766 T3943 n:127.0.0.1:40177_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 491767 T3943 n:127.0.0.1:40177_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 491768 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores
[junit4] 2> 491769 T3943 n:127.0.0.1:40177_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/, loadOnStartup=true, collection=control_collection, name=collection1, transient=false, schema=schema.xml, shard=, config=solrconfig.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1, dataDir=data/, coreNodeName=}
[junit4] 2> 491770 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/
[junit4] 2> 491770 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 491771 T3981 n:127.0.0.1:40177_zg_x c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 491772 T3981 n:127.0.0.1:40177_zg_x c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 491773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 491773 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 491774 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"1"} current state version: 0
[junit4] 2> 491774 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"1"}
[junit4] 2> 491775 T3978 n:127.0.0.1:40177_zg_x oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 491775 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 491776 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 492773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 492773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 492775 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 492775 T3981 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 492776 T3981 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 492777 T3981 n:127.0.0.1:40177_zg_x oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/'
[junit4] 2> 492794 T3981 n:127.0.0.1:40177_zg_x oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 492801 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 492815 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 492847 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 492849 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 492856 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 493118 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 493128 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 493130 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 493142 T3981 n:127.0.0.1:40177_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 493146 T3981 n:127.0.0.1:40177_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 493149 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 493153 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d72f5d6
[junit4] 2> 493153 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index/
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=45.962890625, floorSegmentMB=1.0, forceMergeDeletesPctAllowed=25.182957309614363, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.824333526459131
[junit4] 2> 493155 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7a5674a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c202f31; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 493156 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 493160 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 493160 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 493165 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493167 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493168 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493169 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493173 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json/docs,/admin/luke,/admin/threads,/admin/logging,/config,standard,/get,/admin/system,/admin/plugins,/admin/file,/admin/ping,/replication,/update/json,/admin/properties,/update/csv,/admin/mbeans,/update,/schema,/admin/segments
[junit4] 2> 493175 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 493176 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 493176 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 493177 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 493177 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7a5674a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c202f31; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 493179 T3981 n:127.0.0.1:40177_zg_x x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@4848d49c[collection1] main
[junit4] 2> 493179 T3981 n:127.0.0.1:40177_zg_x x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 493180 T3981 n:127.0.0.1:40177_zg_x x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 493180 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 493183 T3981 n:127.0.0.1:40177_zg_x x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 493183 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 493183 T3982 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4848d49c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502168691903561728
[junit4] 2> 493187 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1502168691903561728
[junit4] 2> 493187 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 493188 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40177/zg_x collection:control_collection shard:shard1
[junit4] 2> 493188 T3943 n:127.0.0.1:40177_zg_x oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
[junit4] 2> 493188 T3943 n:127.0.0.1:40177_zg_x oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 493189 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 493190 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 493191 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493193 T3988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe326ae name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493193 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493194 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 493194 T3943 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 493195 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 493200 T3943 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 493203 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493203 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C411 name=collection1 org.apache.solr.core.SolrCore@6f93b9fc url=http://127.0.0.1:40177/zg_x/collection1 node=127.0.0.1:40177_zg_x C411_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:40177_zg_x, state=down, core=collection1, base_url=http://127.0.0.1:40177/zg_x}
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40177/zg_x/collection1/
[junit4] 2> 493204 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.syncToMe http://127.0.0.1:40177/zg_x/collection1/ has no replicas
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40177/zg_x/collection1/ shard1
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 493209 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493210 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 493314 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493314 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493360 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:40177/zg_x/collection1/ and leader is http://127.0.0.1:40177/zg_x/collection1/
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40177/zg_x
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 493363 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493364 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"2"} current state version: 2
[junit4] 2> 493365 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 493468 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493468 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493523 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1
[junit4] 2> 493525 T3943 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001
[junit4] 2> 493526 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 493528 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1c8f8f05{/zg_x,null,AVAILABLE}
[junit4] 2> 493528 T3943 oejs.AbstractConnector.doStart Started ServerConnector@4b7c84bf{HTTP/1.1}{127.0.0.1:36311}
[junit4] 2> 493529 T3943 oejs.Server.doStart Started @495049ms
[junit4] 2> 493529 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/zg_x, solrconfig=solrconfig.xml, hostPort=36311, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores}
[junit4] 2> 493529 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 493530 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/'
[junit4] 2> 493546 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/solr.xml
[junit4] 2> 493561 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores
[junit4] 2> 493561 T3943 oasc.CoreContainer.<init> New CoreContainer 980129858
[junit4] 2> 493561 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/]
[junit4] 2> 493562 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/lib
[junit4] 2> 493562 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/lib).
[junit4] 2> 493571 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 493572 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 493573 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 493573 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 493573 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 493573 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 493574 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 493574 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 493576 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493577 T4002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f811c80 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493578 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493579 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 493581 T3943 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493583 T4005 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc521dc name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493583 T3943 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493590 T3943 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 494597 T3943 n:127.0.0.1:36311_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36311_zg_x
[junit4] 2> 494598 T3943 n:127.0.0.1:36311_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36311_zg_x
[junit4] 2> 494601 T3943 n:127.0.0.1:36311_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 494603 T3943 n:127.0.0.1:36311_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 494604 T3943 n:127.0.0.1:36311_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 494605 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, shard=, collection=collection1, config=solrconfig.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1, coreNodeName=, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/, loadOnStartup=true, transient=false, name=collection1, schema=schema.xml}
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 494607 T4006 n:127.0.0.1:36311_zg_x c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 494608 T4006 n:127.0.0.1:36311_zg_x c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 494609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 494609 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"} current state version: 3
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 494611 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 494714 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 494714 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 494714 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 495609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 495609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 495611 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 495611 T4006 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 495612 T4006 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 495613 T4006 n:127.0.0.1:36311_zg_x oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/'
[junit4] 2> 495632 T4006 n:127.0.0.1:36311_zg_x oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 495638 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 495652 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 495683 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 495685 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 495692 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 495944 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 495963 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 495965 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 495983 T4006 n:127.0.0.1:36311_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 495988 T4006 n:127.0.0.1:36311_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 495992 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d72f5d6
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=45.962890625, floorSegmentMB=1.0, forceMergeDeletesPctAllowed=25.182957309614363, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.824333526459131
[junit4] 2> 495998 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@621ad2fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4f11d0b5; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 495998 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 496006 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 496006 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 496009 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496010 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496012 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496013 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496019 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json/docs,/admin/luke,/admin/threads,/admin/logging,/config,standard,/get,/admin/system,/admin/plugins,/admin/file,/admin/ping,/replication,/update/json,/admin/properties,/update/csv,/admin/mbeans,/update,/schema,/admin/segments
[junit4] 2> 496021 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 496021 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 496022 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 496023 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 496023 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 496024 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@621ad2fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4f11d0b5; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@1b92c9c5[collection1] main
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 496026 T4006 n:127.0.0.1:36311_zg_x x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 496026 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 496029 T4007 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b92c9c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 496031 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502168694888857600
[junit4] 2> 496033 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1502168694888857600
[junit4] 2> 496033 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 496034 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36311/zg_x collection:collection1 shard:shard2
[junit4] 2> 496035 T3943 n:127.0.0.1:36311_zg_x oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
[junit4] 2> 496035 T3943 n:127.0.0.1:36311_zg_x oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 496038 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 496042 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 496044 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C412 name=collection1 org.apache.solr.core.SolrCore@6e1fa000 url=http://127.0.0.1:36311/zg_x/collection1 node=127.0.0.1:36311_zg_x C412_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:36311_zg_x, state=down, core=collection1, base_url=http://127.0.0.1:36311/zg_x}
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36311/zg_x/collection1/
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.syncToMe http://127.0.0.1:36311/zg_x/collection1/ has no replicas
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36311/zg_x/collection1/ shard2
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 496047 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 496051 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496052 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 496155 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496155 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496155 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register We are http://127.0.0.1:36311/zg_x/collection1/ and leader is http://127.0.0.1:36311/zg_x/collection1/
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36311/zg_x
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 496203 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 496204 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496205 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"} current state version: 5
[junit4] 2> 496206 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 496309 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496310 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496310 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496368 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1
[junit4] 2> 496369 T3943 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001
[junit4] 2> 496370 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 496372 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@12fbe862{/zg_x,null,AVAILABLE}
[junit4] 2> 496373 T3943 oejs.AbstractConnector.doStart Started ServerConnector@56373b34{HTTP/1.1}{127.0.0.1:42343}
[junit4] 2> 496373 T3943 oejs.Server.doStart Started @497893ms
[junit4] 2> 496374 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=42343, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores, hostContext=/zg_x, solrconfig=solrconfig.xml}
[junit4] 2> 496374 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 496374 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/'
[junit4] 2> 496391 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/solr.xml
[junit4] 2> 496406 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores
[junit4] 2> 496406 T3943 oasc.CoreContainer.<init> New CoreContainer 724333786
[junit4] 2> 496406 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/]
[junit4] 2> 496406 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/lib
[junit4] 2> 496407 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/lib).
[junit4] 2> 496416 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 496417 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 496418 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 496418 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 496419 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 496419 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 496419 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 496419 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 496420 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 496422 T4024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e71de4 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 496423 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 496424 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 496426 T3943 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 496427 T4027 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4519d02c name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 496428 T3943 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 496434 T3943 n:127.0.0.1:42343_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 497440 T3943 n:127.0.0.1:42343_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42343_zg_x
[junit4] 2> 497441 T3943 n:127.0.0.1:42343_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42343_zg_x
[junit4] 2> 497448 T3943 n:127.0.0.1:42343_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 497450 T3943 n:127.0.0.1:42343_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 497450 T3943 n:127.0.0.1:42343_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 497452 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1, coreNodeName=, name=collection1, loadOnStartup=true, shard=, config=solrconfig.xml, collection=collection1, dataDir=data/, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1/, transient=false}
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1/
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 497454 T4028 n:127.0.0.1:42343_zg_x c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 497454 T4028 n:127.0.0.1:42343_zg_x c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 497455 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 497455 T4028 n:127.0.0.1:42343_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 497456 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:42343_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42343/zg_x",
[junit4] 2> "numShards":"2"} current state version: 6
[junit4] 2> 497457 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:42343_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4]
[...truncated too long message...]
SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42343/zg_x
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:570)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 5 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:152)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:122)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:466)
[junit4] > ... 9 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4275, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42343/zg_x: Could not find collection : awholynewstresscollection_collection5_1
[junit4] > at __randomizedtesting.SeedInfo.seed([A7DF9F764311F131]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
[junit4] 2> 972905 T3943 c:collection1 s:shard2 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {multiDefault=Lucene50(blocksize=128), a_t=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=LuceneFixedGap), range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= true), range_facet_l=PostingsFormat(name=Memory doPackFST= true), a_i1=PostingsFormat(name=Memory doPackFST= true), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), _version_=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Memory doPackFST= true)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=vi, timezone=Asia/Colombo
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=200145752,total=514850816
[junit4] 2> NOTE: All tests run in this JVM: [TestCustomSort, PreAnalyzedUpdateProcessorTest, TestSolrConfigHandlerConcurrent, DistributedTermsComponentTest, CoreAdminRequestStatusTest, CacheHeaderTest, TestValueSourceCache, SpatialFilterTest, TestManagedResourceStorage, TestSchemaNameResource, TestTolerantSearch, TestWriterPerf, TestFreeTextSuggestions, MergeStrategyTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, BasicFunctionalityTest, SuggestComponentTest, TestBlendedInfixSuggestions, TestFastWriter, DisMaxRequestHandlerTest, WordBreakSolrSpellCheckerTest, TestStressUserVersions, TestSortingResponseWriter, TestAddFieldRealTimeGet, ShardRoutingTest, HdfsRecoverLeaseTest, ScriptEngineTest, SpellCheckComponentTest, UpdateParamsTest, TestSolrCoreProperties, DistanceUnitsTest, TestPHPSerializedResponseWriter, TestLRUCache, ConvertedLegacyTest, TestRebalanceLeaders, JsonLoaderTest, DocExpirationUpdateProcessorFactoryTest, SolrPluginUtilsTest, SpellingQueryConverterTest, FieldMutatingUpdateProcessorTest, TestDynamicFieldResource, TestFuzzyAnalyzedSuggestions, TestCollapseQParserPlugin, TestClassNameShortening, TestDistributedMissingSort, RequiredFieldsTest, ResourceLoaderTest, TestObjectReleaseTracker, TestSolrDeletionPolicy2, ClusterStateUpdateTest, SharedFSAutoReplicaFailoverUtilsTest, CachingDirectoryFactoryTest, LukeRequestHandlerTest, AnalysisAfterCoreReloadTest, TestShardHandlerFactory, TestJsonFacets, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestAnalyzeInfixSuggestions, TestHighFrequencyDictionaryFactory, TestAnalyzedSuggestions, DocumentAnalysisRequestHandlerTest, ChaosMonkeySafeLeaderTest, RAMDirectoryFactoryTest, ShardRoutingCustomTest, TestElisionMultitermQuery, CoreAdminCreateDiscoverTest, TestHdfsUpdateLog, TestConfigSets, TestSolrDynamicMBean, TestAtomicUpdateErrorCases, SegmentsInfoRequestHandlerTest, TestRTGBase, SystemInfoHandlerTest, TestCursorMarkWithoutUniqueKey, DeleteShardTest, TestMiniSolrCloudCluster, TestReplicaProperties, HdfsNNFailoverTest, SuggesterTSTTest, TestIndexSearcher, TestCoreContainer, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed [138/496] on J1 in 482.46s, 1 test, 1 error <<< FAILURES!
[...truncated 1147 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1973 tests, 1 error, 51 ignored (10 assumptions)
Total time: 161 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 846215487 bytes
Compression is 0.0%
Took 2 min 24 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure