You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/22 19:10:21 UTC
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 855 - Still
Failing
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/855/
2 tests failed.
REGRESSION: org.apache.solr.cloud.RecoveryZkTest.test
Error Message:
shard1 is not consistent. Got 864 from http://127.0.0.1:61546/up_lvc/gp/collection1lastClient and got 223 from http://127.0.0.1:61558/up_lvc/gp/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 864 from http://127.0.0.1:61546/up_lvc/gp/collection1lastClient and got 223 from http://127.0.0.1:61558/up_lvc/gp/collection1
at __randomizedtesting.SeedInfo.seed([19F35FD276FB405C:91A76008D8072DA4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([19F35FD276FB405C:6817A10400106790]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:111)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11091 lines...]
[junit4] Suite: org.apache.solr.cloud.RecoveryZkTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/init-core-data-001
[junit4] 2> 2066405 T12843 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 2066408 T12843 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@3122ead5{/up_lvc/gp,null,AVAILABLE}
[junit4] 2> 2066415 T12843 oejs.AbstractConnector.doStart Started ServerConnector@4f97eee0{HTTP/1.1}{127.0.0.1:61539}
[junit4] 2> 2066415 T12843 oejs.Server.doStart Started @2071480ms
[junit4] 2> 2066525 T12843 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/control-001/lib).
[junit4] 2> 2068111 T12875 n:127.0.0.1:61539_up_lvc%2Fgp x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2068149 T12875 n:127.0.0.1:61539_up_lvc%2Fgp x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2068149 T12875 n:127.0.0.1:61539_up_lvc%2Fgp x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501887262587092992
[junit4] 2> 2070715 T12843 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 2070724 T12843 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@107409ac{/up_lvc/gp,null,AVAILABLE}
[junit4] 2> 2070725 T12843 oejs.AbstractConnector.doStart Started ServerConnector@1f601db5{HTTP/1.1}{127.0.0.1:61546}
[junit4] 2> 2070726 T12843 oejs.Server.doStart Started @2075791ms
[junit4] 2> 2070970 T12843 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-1-001/lib).
[junit4] 2> 2073661 T12900 n:127.0.0.1:61546_up_lvc%2Fgp x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2073713 T12900 n:127.0.0.1:61546_up_lvc%2Fgp x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2073713 T12900 n:127.0.0.1:61546_up_lvc%2Fgp x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501887268421369856
[junit4] 2> 2075630 T12843 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 2075633 T12843 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@55bdb0ed{/up_lvc/gp,null,AVAILABLE}
[junit4] 2> 2075634 T12843 oejs.AbstractConnector.doStart Started ServerConnector@730e77d9{HTTP/1.1}{127.0.0.1:61558}
[junit4] 2> 2075634 T12843 oejs.Server.doStart Started @2080699ms
[junit4] 2> 2075751 T12843 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-2-001/lib).
[junit4] 2> 2078344 T12922 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2078379 T12922 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2078380 T12922 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501887273315074048
[junit4] 2> 2080389 T12843 oasc.RecoveryStrategy.close WARN Stopping recovery for core=collection1 coreNodeName=core_node2
[junit4] 2> ASYNC NEW_CORE C2554 name=collection1 org.apache.solr.core.SolrCore@20c2e47d url=http://127.0.0.1:61558/up_lvc/gp/collection1 node=127.0.0.1:61558_up_lvc%2Fgp C2554_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:61558_up_lvc%2Fgp, core=collection1, base_url=http://127.0.0.1:61558/up_lvc/gp, state=recovering}
[junit4] 2> 2085409 T12927 n:127.0.0.1:61558_up_lvc%2Fgp c:collection1 s:shard1 x:collection1 C2554 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> 2085423 T12937 n:127.0.0.1:61546_up_lvc%2Fgp c:collection1 s:shard1 r:core_node1 x:collection1 oascsi.ConcurrentUpdateSolrClient$Runner.run WARN Failed to parse error response from http://127.0.0.1:61558/up_lvc/gp/collection1 due to: java.lang.RuntimeException: Invalid version (expected 2, but 60) or the data in not in 'javabin' format
[junit4] 2> 2085423 T12937 n:127.0.0.1:61546_up_lvc%2Fgp c:collection1 s:shard1 r:core_node1 x:collection1 oasu.StreamingSolrClients$1.handleError ERROR error org.apache.solr.common.SolrException: Can not find: /up_lvc/gp/collection1/update
[junit4] 2>
[junit4] 2>
[junit4] 2>
[junit4] 2> request: http://127.0.0.1:61558/up_lvc/gp/collection1/update?update.distrib=FROMLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A61546%2Fup_lvc%2Fgp%2Fcollection1%2F&wt=javabin&version=2
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:251)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C2555 name=collection1 org.apache.solr.core.SolrCore@551dc08d url=http://127.0.0.1:61546/up_lvc/gp/collection1 node=127.0.0.1:61546_up_lvc%2Fgp C2555_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:61546_up_lvc%2Fgp, core=collection1, base_url=http://127.0.0.1:61546/up_lvc/gp, state=active, leader=true}
[junit4] 2> 2085427 T12890 n:127.0.0.1:61546_up_lvc%2Fgp c:collection1 s:shard1 r:core_node1 x:collection1 C2555 oasup.DistributedUpdateProcessor.doFinish WARN Error sending update to http://127.0.0.1:61558/up_lvc/gp org.apache.solr.common.SolrException: Can not find: /up_lvc/gp/collection1/update
[junit4] 2>
[junit4] 2>
[junit4] 2>
[junit4] 2> request: http://127.0.0.1:61558/up_lvc/gp/collection1/update?update.distrib=FROMLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A61546%2Fup_lvc%2Fgp%2Fcollection1%2F&wt=javabin&version=2
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:251)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2085473 T12921 n:127.0.0.1:61558_up_lvc%2Fgp oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2085487 T12843 oejs.AbstractConnector.doStop Stopped ServerConnector@730e77d9{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2085488 T12843 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@55bdb0ed{/up_lvc/gp,null,UNAVAILABLE}
[junit4] 2> 2085525 T12890 n:127.0.0.1:61546_up_lvc%2Fgp c:collection1 s:shard1 r:core_node1 x:collection1 C2555 oasc.ZkController.ensureReplicaInLeaderInitiatedRecovery WARN Leader is publishing core=collection1 coreNodeName =core_node2 state=down on behalf of un-reachable replica http://127.0.0.1:61558/up_lvc/gp/collection1/; forcePublishState? false
[junit4] 2> 2085526 T12890 n:127.0.0.1:61546_up_lvc%2Fgp c:collection1 s:shard1 r:core_node1 x:collection1 C2555 oasup.DistributedUpdateProcessor.doFinish ERROR Setting up to try to start recovery on replica http://127.0.0.1:61558/up_lvc/gp/collection1/ org.apache.solr.common.SolrException: Can not find: /up_lvc/gp/collection1/update
[junit4] 2>
[junit4] 2>
[junit4] 2>
[junit4] 2> request: http://127.0.0.1:61558/up_lvc/gp/collection1/update?update.distrib=FROMLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A61546%2Fup_lvc%2Fgp%2Fcollection1%2F&wt=javabin&version=2
[junit4] 2> at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:251)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2085690 T12843 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 2085693 T12843 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@5958d672{/up_lvc/gp,null,AVAILABLE}
[junit4] 2> 2085694 T12843 oejs.AbstractConnector.doStart Started ServerConnector@2c4459cb{HTTP/1.1}{127.0.0.1:61558}
[junit4] 2> 2085694 T12843 oejs.Server.doStart Started @2090759ms
[junit4] 2> 2085822 T12843 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-2-001/lib).
[junit4] 2> 2087528 T12967 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/../../../../../../../../../../../usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 2087579 T12967 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 2087579 T12967 n:127.0.0.1:61558_up_lvc%2Fgp x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501887282960924672
[junit4] 2> 2088540 T12981 n:127.0.0.1:61558_up_lvc%2Fgp oasc.RecoveryStrategy.close WARN Stopping recovery for core=collection1 coreNodeName=core_node2
[junit4] 2> ASYNC NEW_CORE C2556 name=collection1 org.apache.solr.core.SolrCore@1e1df496 url=http://127.0.0.1:61558/up_lvc/gp/collection1 node=127.0.0.1:61558_up_lvc%2Fgp C2556_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:61558_up_lvc%2Fgp, core=collection1, base_url=http://127.0.0.1:61558/up_lvc/gp, state=recovering}
[junit4] 2> 2088543 T12972 n:127.0.0.1:61558_up_lvc%2Fgp c:collection1 s:shard1 x:collection1 C2556 oasc.SolrException.log ERROR Error while trying to recover. core=collection1:java.util.concurrent.ExecutionException: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:61546/up_lvc/gp
[junit4] 2> at java.util.concurrent.FutureTask.report(FutureTask.java:122)
[junit4] 2> at java.util.concurrent.FutureTask.get(FutureTask.java:188)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.sendPrepRecoveryCmd(RecoveryStrategy.java:592)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:363)
[junit4] 2> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:229)
[junit4] 2> Caused by: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:61546/up_lvc/gp
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:574)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient$1.call(HttpSolrClient.java:271)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient$1.call(HttpSolrClient.java:267)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> Caused by: java.net.SocketException: Socket closed
[junit4] 2> at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:152)
[junit4] 2> at java.net.SocketInputStream.read(SocketInputStream.java:122)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] 2> at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] 2> at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] 2> at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] 2> at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] 2> at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] 2> at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] 2> at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] 2> at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] 2> at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] 2> at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] 2> at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] 2> at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:466)
[junit4] 2> ... 7 more
[junit4] 2>
[junit4] 2> added docs:857 with 0 fails deletes:428
[junit4] 2> added docs:872 with 0 fails deletes:437
[junit4] 2> ######shard1 is not consistent. Got 864 from http://127.0.0.1:61546/up_lvc/gp/collection1lastClient and got 223 from http://127.0.0.1:61558/up_lvc/gp/collection1
[junit4] 2> ######http://127.0.0.1:61546/up_lvc/gp/collection1: SolrDocumentList[sz=864]=[SolrDocument{id=1-1, _version_=1501887273379037185}, SolrDocument{id=1-10, _version_=1501887273519546368}, SolrDocument{id=1-103, _version_=1501887275006427136}, SolrDocument{id=1-11, _version_=1501887273540517888}, SolrDocument{id=1-114, _version_=1501887275214045184}] , [...] , [SolrDocument{id=2-90, _version_=1501887274830266369}, SolrDocument{id=2-91, _version_=1501887274842849280}, SolrDocument{id=2-94, _version_=1501887274886889472}, SolrDocument{id=2-95, _version_=1501887274907860992}, SolrDocument{id=2-97, _version_=1501887274929881088}]
[junit4] 2> ######http://127.0.0.1:61558/up_lvc/gp/collection1: SolrDocumentList[sz=223]=[SolrDocument{id=1-674, _version_=1501887283138134016}, SolrDocument{id=1-675, _version_=1501887283149668352}, SolrDocument{id=1-678, _version_=1501887283192659968}, SolrDocument{id=1-680, _version_=1501887283234603008}, SolrDocument{id=1-681, _version_=1501887283245088768}] , [...] , [SolrDocument{id=2-852, _version_=1501887286024863744}, SolrDocument{id=2-853, _version_=1501887286033252352}, SolrDocument{id=2-854, _version_=1501887286051078144}, SolrDocument{id=2-855, _version_=1501887286069952512}, SolrDocument{id=2-856, _version_=1501887286132867072}]
[junit4] 2> ###### sizes=864,223
[junit4] 2> ###### Only in http://127.0.0.1:61546/up_lvc/gp/collection1: [{id=1-207, _version_=1501887276709314560}, {id=2-5, _version_=1501887273426223104}, {id=2-555, _version_=1501887282101092352}, {id=2-570, _version_=1501887282255233024}, {id=2-478, _version_=1501887281200365568}, {id=1-10, _version_=1501887273519546368}, {id=1-141, _version_=1501887275618795521}, {id=2-214, _version_=1501887276916932608}, {id=1-498, _version_=1501887281275863040}, {id=1-364, _version_=1501887279310831616}, {id=2-627, _version_=1501887282834046976}, {id=2-618, _version_=1501887282754355200}, {id=2-33, _version_=1501887273913810944}, {id=2-262, _version_=1501887277709656065}, {id=2-614, _version_=1501887282708217856}, {id=1-90, _version_=1501887274830266368}, {id=1-82, _version_=1501887274700242945}, {id=1-9, _version_=1501887273495429120}, {id=2-95, _version_=1501887274907860992}, {id=2-121, _version_=1501887275314708480}, {id=2-413, _version_=1501887280130818049}, {id=1-529, _version_=1501887281614553088}, {id=1-308, _version_=1501887278415347712}, {id=1-55, _version_=1501887274239918080}, {id=2-54, _version_=1501887274230480896}, {id=1-359, _version_=1501887279218556928}, {id=2-540, _version_=1501887281941708801}, {id=1-557, _version_=1501887281921785857}, {id=1-257, _version_=1501887277598507009}, {id=2-88, _version_=1501887274797760512}, {id=2-471, _version_=1501887281115430912}, {id=1-389, _version_=1501887279740747776}, {id=2-330, _version_=1501887278790737920}, {id=1-404, _version_=1501887279944171520}, {id=1-244, _version_=1501887277384597504}, {id=2-477, _version_=1501887281187782656}, {id=1-31, _version_=1501887273882353664}, {id=2-584, _version_=1501887282402033664}, {id=1-523, _version_=1501887281551638528}, {id=2-622, _version_=1501887282793152512}, {id=1-156, _version_=1501887275843190784}, {id=2-290, _version_=1501887278179418112}, {id=2-521, _version_=1501887281674321921}, {id=1-341, _version_=1501887278929149952}, {id=1-276, _version_=1501887277904691201}, {id=2-286, _version_=1501887278115454976}, {id=2-194, _version_=1501887276538396672}, {id=2-533, _version_=1501887281876697089}, {id=1-561, _version_=1501887281959534592}, {id=1-152, _version_=1501887275775033344}, {id=1-214, _version_=1501887276888621056}, {id=1-520, _version_=1501887281518084096}, {id=2-68, _version_=1501887274444390400}, {id=2-434, _version_=1501887280460070912}, {id=1-390, _version_=1501887279750184960}, {id=1-566, _version_=1501887282020352000}, {id=1-24, _version_=1501887273740795904}, {id=1-274, _version_=1501887277872185344}, {id=1-94, _version_=1501887274885840896}, {id=1-547, _version_=1501887281823219712}, {id=1-439, _version_=1501887280468459520}, {id=2-653, _version_=1501887283069976576}, {id=1-114, _version_=1501887275214045184}, {id=1-549, _version_=1501887281843142656}, {id=1-25, _version_=1501887273764913152}, {id=2-364, _version_=1501887279351726080}, {id=1-126, _version_=1501887275396497408}, {id=2-485, _version_=1501887281265377280}, {id=1-119, _version_=1501887275293736960}, {id=1-199, _version_=1501887276565659648}, {id=1-326, _version_=1501887278691123200}, {id=1-488, _version_=1501887281155276800}, {id=1-74, _version_=1501887274540859392}, {id=1-1, _version_=1501887273379037185}, {id=2-461, _version_=1501887280934027264}, {id=1-638, _version_=1501887282753306624}, {id=1-550, _version_=1501887281858871296}, {id=2-256, _version_=1501887277608992768}, {id=2-559, _version_=1501887282146181120}, {id=1-385, _version_=1501887279696707584}, {id=2-359, _version_=1501887279253159936}, {id=1-657, _version_=1501887282924224512}, {id=1-338, _version_=1501887278889304064}, {id=2-271, _version_=1501887277875331072}, {id=2-115, _version_=1501887275223482368}, {id=1-471, _version_=1501887280916201472}, {id=2-155, _version_=1501887275868356608}, {id=2-523, _version_=1501887281761353728}, {id=2-548, _version_=1501887282042372097}, {id=1-634, _version_=1501887282717655040}, {id=2-189, _version_=1501887276432490496}, {id=1-221, _version_=1501887277019693056}, {id=2-580, _version_=1501887282366382080}, {id=2-57, _version_=1501887274277666816}, {id=2-32, _version_=1501887273903325184}, {id=1-425, _version_=1501887280263987200}, {id=2-569, _version_=1501887282248941568}, {id=2-421, _version_=1501887280261890048}, {id=2-124, _version_=1501887275365040128}, {id=1-176, _version_=1501887276154617857}, {id=2-127, _version_=1501887275414323200}, {id=1-380, _version_=1501887279562489856}, {id=1-28, _version_=1501887273820487680}, {id=1-604, _version_=1501887282405179392}, {id=1-582, _version_=1501887282177638400}, {id=2-619, _version_=1501887282762743808}, {id=1-454, _version_=1501887280696000512}, {id=1-450, _version_=1501887280638328832}, {id=2-332, _version_=1501887278845263872}, {id=1-60, _version_=1501887274321707008}, {id=2-232, _version_=1501887277230456833}, {id=2-261, _version_=1501887277699170304}, {id=1-26, _version_=1501887273775398912}, {id=1-472, _version_=1501887280929832960}, {id=1-301, _version_=1501887278310490112}, {id=1-165, _version_=1501887275975311360}, {id=2-307, _version_=1501887278436319232}, {id=2-412, _version_=1501887280120332289}, {id=2-615, _version_=1501887282722897920}, {id=2-547, _version_=1501887282028740608}, {id=2-172, _version_=1501887276143083520}, {id=2-556, _version_=1501887282113675264}, {id=1-669, _version_=1501887283044810752}, {id=2-636, _version_=1501887282916884480}, {id=1-461, _version_=1501887280789323776}, {id=1-411, _version_=1501887280047980544}, {id=2-133, _version_=1501887275511840768}, {id=1-324, _version_=1501887278644985856}, {id=2-394, _version_=1501887279794225152}, {id=1-355, _version_=1501887279159836672}, {id=2-337, _version_=1501887278916567040}, {id=2-565, _version_=1501887282211192832}, {id=2-274, _version_=1501887277916225536}, {id=1-169, _version_=1501887276028788736}, {id=2-385, _version_=1501887279672590336}, {id=2-202, _version_=1501887276662128640}, {id=2-577, _version_=1501887282331779072}, {id=1-330, _version_=1501887278764523520}, {id=1-504, _version_=1501887281339826176}, {id=1-325, _version_=1501887278669103104}, {id=2-134, _version_=1501887275532812288}, {id=1-591, _version_=1501887282267815937}, {id=1-218, _version_=1501887276963069952}, {id=2-505, _version_=1501887281501306880}, {id=2-574, _version_=1501887282300321793}, {id=1-248, _version_=1501887277444366336}, {id=2-160, _version_=1501887275927076864}, {id=1-485, _version_=1501887281120673792}, {id=1-49, _version_=1501887274152886272}, {id=2-592, _version_=1501887282474385408}, {id=1-30, _version_=1501887273870819328}, {id=1-91, _version_=1501887274841800704}, {id=2-528, _version_=1501887281826365440}, {id=1-83, _version_=1501887274711777281}, {id=1-407, _version_=1501887279993454592}, {id=1-398, _version_=1501887279866576896}, {id=1-273, _version_=1501887277850165248}, {id=1-656, _version_=1501887282907447296}, {id=2-86, _version_=1501887274764206080}, {id=1-467, _version_=1501887280858529792}, {id=1-193, _version_=1501887276469190656}, {id=1-574, _version_=1501887282101092353}, {id=1-261, _version_=1501887277666664448}, {id=1-36, _version_=1501887273963094016}, {id=1-332, _version_=1501887278805417984}, {id=1-124, _version_=1501887275368185856}, {id=2-119, _version_=1501887275292688384}, {id=2-497, _version_=1501887281401692160}, {id=1-194, _version_=1501887276493307904}, {id=1-7, _version_=1501887273450340352}, {id=2-268, _version_=1501887277812416512}, {id=2-484, _version_=1501887281259085824}, {id=1-212, _version_=1501887276843532288}, {id=1-473, _version_=1501887280938221568}, {id=2-475, _version_=1501887281165762560}, {id=2-446, _version_=1501887280632037376}, {id=2-578, _version_=1501887282340167680}, {id=2-141, _version_=1501887275618795520}, {id=1-601, _version_=1501887282376867840}, {id=1-238, _version_=1501887277295468545}, {id=2-617, _version_=1501887282748063744}, {id=1-258, _version_=1501887277618429952}, {id=2-376, _version_=1501887279542566912}, {id=2-169, _version_=1501887276088557568}, {id=1-475, _version_=1501887280969678848}, {id=2-327, _version_=1501887278729920512}, {id=1-233, _version_=1501887277230456832}, {id=2-473, _version_=1501887281138499584}, {id=1-172, _version_=1501887276083314688}, {id=1-486, _version_=1501887281135353856}, {id=2-234, _version_=1501887277271351296}, {id=1-617, _version_=1501887282538348544}, {id=1-23, _version_=1501887273719824384}, {id=2-439, _version_=1501887280533471232}, {id=2-366, _version_=1501887279390523393}, {id=1-502, _version_=1501887281320951808}, {id=2-263, _version_=1501887277719093248}, {id=1-116, _version_=1501887275239211008}, {id=1-533, _version_=1501887281660690432}, {id=2-462, _version_=1501887280951853056}, {id=2-610, _version_=1501887282657886209}, {id=2-502, _version_=1501887281465655297}, {id=1-32, _version_=1501887273902276608}, {id=1-366, _version_=1501887279352774656}, {id=2-16, _version_=1501887273607626752}, {id=2-654, _version_=1501887283077316608}, {id=2-283, _version_=1501887278078754816}, {id=2-80, _version_=1501887274677174273}, {id=2-642, _version_=1501887282976653312}, {id=2-549, _version_=1501887282048663552}, {id=1-264, _version_=1501887277698121728}, {id=1-615, _version_=1501887282508988416}, {id=1-598, _version_=1501887282357993473}, {id=2-84, _version_=1501887274731700224}, {id=2-179, _version_=1501887276273106944}, {id=2-498, _version_=1501887281416372225}, {id=2-454, _version_=1501887280855384064}, {id=2-326, _version_=1501887278720483328}, {id=1-618, _version_=1501887282544640000}, {id=2-607, _version_=1501887282628526080}, {id=1-59, _version_=1501887274311221248}, {id=1-118, _version_=1501887275270668288}, {id=1-540, _version_=1501887281731993600}, {id=2-51, _version_=1501887274185392129}, {id=2-36, _version_=1501887273966239744}, {id=1-660, _version_=1501887282950438913}, {id=2-60, _version_=1501887274319609856}, {id=1-474, _version_=1501887280954998784}, {id=1-57, _version_=1501887274279763968}, {id=1-252, _version_=1501887277506232320}, {id=2-355, _version_=1501887279198633984}, {id=2-495, _version_=1501887281375477760}, {id=2-55, _version_=1501887274240966656}, {id=2-154, _version_=1501887275847385088}, {id=1-307, _version_=1501887278396473344}, {id=2-595, _version_=1501887282506891264}, {id=1-302, _version_=1501887278319927296}, {id=1-275, _version_=1501887277893156864}, {id=1-51, _version_=1501887274185392128}, {id=2-491, _version_=1501887281330388992}, {id=1-294, _version_=1501887278181515264}, {id=2-239, _version_=1501887277327974400}, {id=1-420, _version_=1501887280192684032}, {id=2-207, _version_=1501887276743917568}, {id=1-392, _version_=1501887279778496512}, {id=1-586, _version_=1501887282212241408}, {id=2-338, _version_=1501887278935441408}, {id=2-581, _version_=1501887282377916416}, {id=2-117, _version_=1501887275257036800}, {id=2-551, _version_=1501887282068586496}, {id=1-327, _version_=1501887278700560384}, {id=1-267, _version_=1501887277759987712}, {id=2-407, _version_=1501887279984017408}, {id=1-424, _version_=1501887280247209984}, {id=1-29, _version_=1501887273845653504}, {id=2-193, _version_=1501887276516376576}, {id=2-254, _version_=1501887277576486913}, {id=1-254, _version_=1501887277547126784}, {id=2-91, _version_=1501887274842849280}, {id=1-469, _version_=1501887280886841344}, {id=1-607, _version_=1501887282430345216}, {id=2-469, _version_=1501887281042030592}, {id=1-421, _version_=1501887280202121216}, {id=2-257, _version_=1501887277631012864}, {id=1-406, _version_=1501887279975628800}, {id=1-318, _version_=1501887278553759744}, {id=1-39, _version_=1501887274006085632}, {id=2-507, _version_=1501887281520181248}, {id=2-499, _version_=1501887281432100864}, {id=1-224, _version_=1501887277052198912}, {id=2-362, _version_=1501887279310831617}, {id=1-319, _version_=1501887278571585536}, {id=2-392, _version_=1501887279757524992}, {id=2-591, _version_=1501887282467045377}, {id=2-223, _version_=1501887277066878976}, {id=2-415, _version_=1501887280167518208}, {id=1-551, _version_=1501887281865162752}, {id=1-262, _version_=1501887277676101632}, {id=1-417, _version_=1501887280130818048}, {id=2-25, _version_=1501887273763864576}, {id=2-638, _version_=1501887282936807425}, {id=2-472, _version_=1501887281131159552}, {id=1-271, _version_=1501887277830242304}, {id=1-668, _version_=1501887283029082113}, {id=1-624, _version_=1501887282608603136}, {id=2-424, _version_=1501887280311173120}, {id=1-493, _version_=1501887281219239936}, {id=2-626, _version_=1501887282827755520}, {id=2-393, _version_=1501887279776399360}, {id=2-427, _version_=1501887280365699072}, {id=2-313, _version_=1501887278505525248}, {id=2-319, _version_=1501887278608285696}, {id=2-294, _version_=1501887278242332673}, {id=2-192, _version_=1501887276494356480}, {id=2-537, _version_=1501887281902911488}, {id=2-81, _version_=1501887274688708608}, {id=1-11, _version_=1501887273540517888}, {id=2-11, _version_=1501887273540517889}, {id=2-325, _version_=1501887278699511808}, {id=2-211, _version_=1501887276862406656}, {id=1-42, _version_=1501887274040688640}, {id=1-376, _version_=1501887279504818177}, {id=2-204, _version_=1501887276686245888}, {id=1-219, _version_=1501887276974604288}, {id=1-35, _version_=1501887273943171072}, {id=1-590, _version_=1501887282261524481}, {id=2-467, _version_=1501887281011621888}, {id=1-337, _version_=1501887278872526848}, {id=1-534, _version_=1501887281666981888}, {id=1-293, _version_=1501887278174175232}, {id=2-346, _version_=1501887279044493312}, {id=1-478, _version_=1501887281005330432}, {id=2-184, _version_=1501887276352798720}, {id=1-127, _version_=1501887275415371776}, {id=2-402, _version_=1501887279905374209}, {id=2-259, _version_=1501887277668761600}, {id=1-346, _version_=1501887278997307392}, {id=1-565, _version_=1501887282007769088}, {id=2-443, _version_=1501887280582754304}, {id=1-477, _version_=1501887280991698944}, {id=1-521, _version_=1501887281531715584}, {id=2-305, _version_=1501887278408007680}, {id=2-590, _version_=1501887282460753920}, {id=1-559, _version_=1501887281941708800}, {id=1-201, _version_=1501887276604456960}, {id=1-195, _version_=1501887276504842241}, {id=1-370, _version_=1501887279403106304}, {id=2-539, _version_=1501887281928077312}, {id=1-408, _version_=1501887280011280384}, {id=1-548, _version_=1501887281835802624}, {id=2-289, _version_=1501887278159495168}, {id=1-499, _version_=1501887281289494528}, {id=2-323, _version_=1501887278669103105}, {id=1-204, _version_=1501887276640108544}, {id=1-654, _version_=1501887282893815808}, {id=2-531, _version_=1501887281855725568}, {id=2-520, _version_=1501887281658593280}, {id=2-135, _version_=1501887275543298048}, {id=1-121, _version_=1501887275316805632}, {id=1-47, _version_=1501887274118283264}, {id=2-182, _version_=1501887276318195712}, {id=2-292, _version_=1501887278221361152}, {id=2-380, _version_=1501887279599190016}, {id=1-556, _version_=1501887281909202945}, {id=1-245, _version_=1501887277404520448}, {id=1-84, _version_=1501887274732748800}, {id=1-103, _version_=1501887275006427136}, {id=2-53, _version_=1501887274217897985}, {id=2-219, _version_=1501887277001867264}, {id=1-443, _version_=1501887280525082624}, {id=2-216, _version_=1501887276956778496}, {id=2-557, _version_=1501887282126258176}, {id=2-534, _version_=1501887281884037120}, {id=2-22, _version_=1501887273710387200}, {id=2-186, _version_=1501887276397887488}, {id=1-189, _version_=1501887276387401729}, {id=1-53, _version_=1501887274217897984}, {id=2-83, _version_=1501887274711777280}, {id=1-514, _version_=1501887281458315264}, {id=1-648, _version_=1501887282845581312}, {id=2-245, _version_=1501887277426540544}, {id=1-335, _version_=1501887278845263873}, {id=2-561, _version_=1501887282167152640}, {id=2-23, _version_=1501887273721921536}, {id=2-488, _version_=1501887281296834560}, {id=1-208, _version_=1501887276721897472}, {id=1-237, _version_=1501887277281837056}, {id=2-586, _version_=1501887282415665152}, {id=2-331, _version_=1501887278826389504}, {id=2-425, _version_=1501887280332144640}, {id=2-235, _version_=1501887277282885632}, {id=1-430, _version_=1501887280339484672}, {id=1-289, _version_=1501887278112309248}, {id=1-560, _version_=1501887281948000256}, {id=1-528, _version_=1501887281601970176}, {id=2-389, _version_=1501887279718727680}, {id=2-39, _version_=1501887274010279936}, {id=1-215, _version_=1501887276911689728}, {id=2-156, _version_=1501887275881988096}, {id=1-614, _version_=1501887282495356928}, {id=2-308, _version_=1501887278455193600}, {
[junit4] 2> id=1-22, _version_=1501887273708290048}, {id=2-176, _version_=1501887276210192384}, {id=2-293, _version_=1501887278230798336}, {id=1-67, _version_=1501887274431807488}, {id=1-192, _version_=1501887276446121984}, {id=1-292, _version_=1501887278165786624}, {id=2-288, _version_=1501887278136426496}, {id=2-624, _version_=1501887282813075456}, {id=1-177, _version_=1501887276165103617}, {id=2-273, _version_=1501887277895254016}, {id=1-180, _version_=1501887276214386688}, {id=2-601, _version_=1501887282553028608}, {id=1-531, _version_=1501887281640767488}, {id=2-634, _version_=1501887282904301568}, {id=1-595, _version_=1501887282306613248}, {id=2-287, _version_=1501887278126989312}, {id=1-234, _version_=1501887277251428352}, {id=2-28, _version_=1501887273820487681}, {id=2-165, _version_=1501887276016205824}, {id=1-95, _version_=1501887274906812416}, {id=2-30, _version_=1501887273871867904}, {id=1-286, _version_=1501887278076657664}, {id=2-648, _version_=1501887283029082112}, {id=2-545, _version_=1501887282001477632}, {id=1-155, _version_=1501887275832705024}, {id=1-288, _version_=1501887278094483456}, {id=1-619, _version_=1501887282550931456}, {id=2-567, _version_=1501887282230067200}, {id=1-464, _version_=1501887280824975360}, {id=2-212, _version_=1501887276873940992}, {id=1-592, _version_=1501887282275155968}, {id=2-315, _version_=1501887278533836800}, {id=1-645, _version_=1501887282820415488}, {id=2-406, _version_=1501887279964094465}, {id=1-361, _version_=1501887279254208512}, {id=1-290, _version_=1501887278131183616}, {id=1-211, _version_=1501887276830949376}, {id=1-81, _version_=1501887274688708609}, {id=1-140, _version_=1501887275606212608}, {id=1-255, _version_=1501887277557612544}, {id=2-226, _version_=1501887277110919168}, {id=1-597, _version_=1501887282351702016}, {id=1-658, _version_=1501887282936807424}, {id=2-616, _version_=1501887282735480832}, {id=1-154, _version_=1501887275810684928}, {id=2-255, _version_=1501887277588021249}, {id=1-622, _version_=1501887282578194432}, {id=2-302, _version_=1501887278368161792}, {id=1-569, _version_=1501887282048663553}, {id=2-74, _version_=1501887274537713664}, {id=2-335, _version_=1501887278885109760}, {id=2-126, _version_=1501887275395448832}, {id=2-517, _version_=1501887281631330304}, {id=2-196, _version_=1501887276566708224}, {id=1-80, _version_=1501887274677174272}, {id=2-152, _version_=1501887275813830656}, {id=2-31, _version_=1501887273883402240}, {id=1-182, _version_=1501887276276252672}, {id=2-244, _version_=1501887277408714752}, {id=1-240, _version_=1501887277325877248}, {id=2-128, _version_=1501887275425857537}, {id=1-427, _version_=1501887280292298752}, {id=1-223, _version_=1501887277040664576}, {id=2-264, _version_=1501887277729579008}, {id=2-26, _version_=1501887273775398913}, {id=1-259, _version_=1501887277638352896}, {id=1-394, _version_=1501887279817293824}, {id=1-287, _version_=1501887278086094848}, {id=1-666, _version_=1501887283009159169}, {id=2-411, _version_=1501887280102506496}, {id=2-404, _version_=1501887279931588608}, {id=1-537, _version_=1501887281689001984}, {id=2-94, _version_=1501887274886889472}, {id=1-589, _version_=1501887282253135872}, {id=1-577, _version_=1501887282127306752}, {id=2-474, _version_=1501887281151082496}, {id=2-275, _version_=1501887277934051328}, {id=1-174, _version_=1501887276118966272}, {id=1-239, _version_=1501887277305954305}, {id=1-159, _version_=1501887275877793792}, {id=2-114, _version_=1501887275210899456}, {id=2-258, _version_=1501887277648838656}, {id=1-331, _version_=1501887278785495040}, {id=2-158, _version_=1501887275904008192}, {id=1-539, _version_=1501887281719410688}, {id=2-103, _version_=1501887275005378560}, {id=2-64, _version_=1501887274386718720}, {id=1-336, _version_=1501887278854701056}, {id=1-16, _version_=1501887273608675328}, {id=2-450, _version_=1501887280694951936}, {id=2-408, _version_=1501887280002891777}, {id=2-233, _version_=1501887277251428353}, {id=2-582, _version_=1501887282383159296}, {id=2-417, _version_=1501887280195829760}, {id=1-633, _version_=1501887282709266432}, {id=2-1, _version_=1501887273379037184}, {id=1-160, _version_=1501887275890376704}, {id=2-97, _version_=1501887274929881088}, {id=2-390, _version_=1501887279728164864}, {id=2-598, _version_=1501887282532057089}, {id=2-606, _version_=1501887282615943168}, {id=1-134, _version_=1501887275533860864}, {id=1-584, _version_=1501887282197561344}, {id=1-555, _version_=1501887281897668608}, {id=2-221, _version_=1501887277045907456}, {id=1-495, _version_=1501887281238114304}, {id=1-88, _version_=1501887274796711936}, {id=2-67, _version_=1501887274433904640}, {id=1-627, _version_=1501887282630623232}, {id=2-76, _version_=1501887274582802432}, {id=2-90, _version_=1501887274830266369}, {id=1-162, _version_=1501887275921833984}, {id=2-159, _version_=1501887275915542528}, {id=2-79, _version_=1501887274638376960}, {id=2-414, _version_=1501887280157032448}, {id=2-265, _version_=1501887277750550529}, {id=1-412, _version_=1501887280067903488}, {id=1-581, _version_=1501887282169249792}, {id=1-117, _version_=1501887275259133952}, {id=1-133, _version_=1501887275511840769}, {id=2-59, _version_=1501887274309124096}, {id=2-468, _version_=1501887281025253376}, {id=2-420, _version_=1501887280252452864}, {id=2-297, _version_=1501887278284275712}, {id=1-545, _version_=1501887281793859584}, {id=2-195, _version_=1501887276553076736}, {id=1-484, _version_=1501887281069293568}, {id=2-42, _version_=1501887274043834368}, {id=1-564, _version_=1501887282000429056}, {id=1-315, _version_=1501887278503428096}, {id=2-637, _version_=1501887282929467392}, {id=2-224, _version_=1501887277077364736}, {id=2-7, _version_=1501887273448243200}, {id=2-218, _version_=1501887276990332928}, {id=1-637, _version_=1501887282747015168}, {id=1-235, _version_=1501887277261914112}, {id=2-430, _version_=1501887280410787840}, {id=1-580, _version_=1501887282153521152}, {id=2-82, _version_=1501887274700242944}, {id=2-589, _version_=1501887282453413889}, {id=2-318, _version_=1501887278587314176}, {id=1-268, _version_=1501887277779910656}, {id=2-208, _version_=1501887276755451904}, {id=1-179, _version_=1501887276202852352}, {id=1-610, _version_=1501887282453413888}, {id=2-162, _version_=1501887275959582720}, {id=1-414, _version_=1501887280094117888}, {id=1-505, _version_=1501887281352409088}, {id=2-118, _version_=1501887275270668289}, {id=1-334, _version_=1501887278836875264}, {id=1-313, _version_=1501887278473019392}, {id=1-115, _version_=1501887275227676672}, {id=1-653, _version_=1501887282887524352}, {id=2-464, _version_=1501887280975970304}, {id=1-76, _version_=1501887274582802433}, {id=2-324, _version_=1501887278679588865}, {id=2-566, _version_=1501887282223775744}, {id=2-514, _version_=1501887281596727296}, {id=1-79, _version_=1501887274638376961}, {id=2-442, _version_=1501887280573317120}, {id=2-604, _version_=1501887282598117376}, {id=1-626, _version_=1501887282623283200}, {id=1-5, _version_=1501887273426223105}, {id=2-237, _version_=1501887277305954304}, {id=2-248, _version_=1501887277469532160}, {id=1-507, _version_=1501887281371283456}, {id=1-578, _version_=1501887282133598208}, {id=1-606, _version_=1501887282417762304}, {id=2-504, _version_=1501887281488723968}, {id=2-276, _version_=1501887277944537088}, {id=1-64, _version_=1501887274386718721}, {id=2-177, _version_=1501887276221726720}, {id=2-633, _version_=1501887282898010112}, {id=2-238, _version_=1501887277316440065}, {id=1-446, _version_=1501887280577511424}, {id=1-68, _version_=1501887274443341824}, {id=1-297, _version_=1501887278231846912}, {id=2-281, _version_=1501887278047297536}, {id=2-199, _version_=1501887276614942720}, {id=1-232, _version_=1501887277206339584}, {id=1-97, _version_=1501887274930929664}, {id=2-370, _version_=1501887279440855040}, {id=2-301, _version_=1501887278358724608}, {id=1-434, _version_=1501887280395059200}, {id=1-128, _version_=1501887275425857536}, {id=1-158, _version_=1501887275866259456}, {id=1-202, _version_=1501887276615991296}, {id=1-616, _version_=1501887282523668480}, {id=2-35, _version_=1501887273946316800}, {id=2-334, _version_=1501887278874624000}, {id=1-362, _version_=1501887279272034305}, {id=1-226, _version_=1501887277083656192}, {id=1-323, _version_=1501887278634500096}, {id=1-186, _version_=1501887276354895872}, {id=1-663, _version_=1501887282990284800}, {id=1-184, _version_=1501887276310855680}, {id=1-600, _version_=1501887282370576384}, {id=2-529, _version_=1501887281838948352}, {id=2-174, _version_=1501887276174540800}, {id=2-295, _version_=1501887278253867008}, {id=2-493, _version_=1501887281356603392}, {id=2-215, _version_=1501887276944195584}, {id=1-295, _version_=1501887278190952448}, {id=1-33, _version_=1501887273912762368}, {id=2-597, _version_=1501887282525765632}, {id=1-567, _version_=1501887282026643456}, {id=1-402, _version_=1501887279915859968}, {id=1-216, _version_=1501887276923224064}, {id=1-283, _version_=1501887278034714624}, {id=1-263, _version_=1501887277686587392}, {id=1-642, _version_=1501887282795249664}, {id=1-305, _version_=1501887278369210368}, {id=1-636, _version_=1501887282731286528}, {id=2-336, _version_=1501887278894546944}, {id=1-371, _version_=1501887279421980673}, {id=2-180, _version_=1501887276284641280}, {id=2-183, _version_=1501887276339167232}, {id=1-86, _version_=1501887274765254656}, {id=1-265, _version_=1501887277720141824}, {id=2-116, _version_=1501887275235016704}, {id=1-281, _version_=1501887278003257344}, {id=1-497, _version_=1501887281263280128}, {id=2-47, _version_=1501887274115137536}, {id=2-361, _version_=1501887279293005824}, {id=2-645, _version_=1501887283002867712}, {id=2-398, _version_=1501887279842459648}, {id=2-267, _version_=1501887277791444992}, {id=2-600, _version_=1501887282546737152}, {id=1-442, _version_=1501887280514596864}, {id=1-415, _version_=1501887280103555072}, {id=2-564, _version_=1501887282204901376}, {id=1-54, _version_=1501887274228383744}, {id=2-24, _version_=1501887273741844480}, {id=2-550, _version_=1501887282061246465}, {id=1-309, _version_=1501887278432124928}, {id=1-517, _version_=1501887281492918272}, {id=1-183, _version_=1501887276299321344}, {id=2-309, _version_=1501887278465679360}, {id=1-393, _version_=1501887279797370880}, {id=1-196, _version_=1501887276516376577}, {id=2-49, _version_=1501887274149740544}, {id=1-659, _version_=1501887282943098880}, {id=1-570, _version_=1501887282054955009}, {id=2-29, _version_=1501887273845653505}, {id=2-140, _version_=1501887275607261184}, {id=2-486, _version_=1501887281277960192}, {id=1-135, _version_=1501887275543298049}, {id=2-560, _version_=1501887282152472576}, {id=1-468, _version_=1501887280873209856}, {id=1-491, _version_=1501887281191976960}, {id=2-341, _version_=1501887278975287296}, {id=2-252, _version_=1501887277535592448}, {id=2-201, _version_=1501887276649545728}, {id=2-240, _version_=1501887277349994496}, {id=2-371, _version_=1501887279459729408}, {id=2-9, _version_=1501887273496477696}, {id=1-413, _version_=1501887280077340672}, {id=1-256, _version_=1501887277576486912}, {id=2-10, _version_=1501887273519546369}, {id=1-462, _version_=1501887280802955264}]
[junit4] 2> 2233110 T13006 n:127.0.0.1:61539_up_lvc%2Fgp oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2233112 T12843 oejs.AbstractConnector.doStop Stopped ServerConnector@4f97eee0{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2233113 T12843 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@3122ead5{/up_lvc/gp,null,UNAVAILABLE}
[junit4] 2> 2233130 T13019 n:127.0.0.1:61558_up_lvc%2Fgp oasc.RecoveryStrategy.close WARN Stopping recovery for core=collection1 coreNodeName=core_node2
[junit4] 2> 2234625 T13007 n:127.0.0.1:61546_up_lvc%2Fgp oascc.ZkStateReader.getIndividualColls WARN Error reading collections nodes org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/state.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getIndividualColls(ZkStateReader.java:512)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.constructState(ZkStateReader.java:467)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$200(ZkStateReader.java:59)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:330)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2234626 T13007 n:127.0.0.1:61546_up_lvc%2Fgp oascc.ZkStateReader.getIndividualColls WARN Error reading collections nodes org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/control_collection/state.json
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:311)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:308)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:308)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getIndividualColls(ZkStateReader.java:512)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.constructState(ZkStateReader.java:467)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.access$200(ZkStateReader.java:59)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader$2.process(ZkStateReader.java:330)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 2234627 T13010 n:127.0.0.1:61546_up_lvc%2Fgp oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2234629 T12843 oejs.AbstractConnector.doStop Stopped ServerConnector@1f601db5{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2234629 T12843 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@107409ac{/up_lvc/gp,null,UNAVAILABLE}
[junit4] 2> 2234635 T13017 n:127.0.0.1:61558_up_lvc%2Fgp oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> ASYNC NEW_CORE C2557 name=collection1 org.apache.solr.core.SolrCore@1e1df496 url=http://127.0.0.1:61558/up_lvc/gp/collection1 node=127.0.0.1:61558_up_lvc%2Fgp C2557_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:61558_up_lvc%2Fgp, core=collection1, base_url=http://127.0.0.1:61558/up_lvc/gp, state=active}
[junit4] 2> 2235631 T13019 n:127.0.0.1:61558_up_lvc%2Fgp C2557 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 2235646 T12843 oejs.AbstractConnector.doStop Stopped ServerConnector@2c4459cb{HTTP/1.1}{127.0.0.1:61558}
[junit4] 2> 2235646 T12843 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@5958d672{/up_lvc/gp,null,UNAVAILABLE}
[junit4] 2> 2235860 T12844 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 5 /solr/clusterstate.json
[junit4] 2> 5 /solr/aliases.json
[junit4] 2> 4 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 2 /solr/overseer_elect/election/93867953705910278-127.0.0.1:61546_up_lvc%2Fgp-n_0000000001
[junit4] 2> 2 /solr/collections/collection1/leader_elect/shard1/election/93867953705910278-core_node1-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 3 /solr/overseer/queue
[junit4] 2> 3 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RecoveryZkTest -Dtests.method=test -Dtests.seed=19F35FD276FB405C -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es_CO -Dtests.timezone=AET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 171s J3 | RecoveryZkTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: shard1 is not consistent. Got 864 from http://127.0.0.1:61546/up_lvc/gp/collection1lastClient and got 223 from http://127.0.0.1:61558/up_lvc/gp/collection1
[junit4] > at __randomizedtesting.SeedInfo.seed([19F35FD276FB405C:91A76008D8072DA4]:0)
[junit4] > at org.apache.solr.cloud.RecoveryZkTest.test(RecoveryZkTest.java:123)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.cloud.RecoveryZkTest 19F35FD276FB405C-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {a_i=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), rnd_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_t=PostingsFormat(name=Asserting), _version_=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_CO, timezone=AET
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=300855592,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [TermVectorComponentDistributedTest, TestSystemIdResolver, TestLeaderElectionZkExpiry, CollectionsAPIDistributedZkTest, TestCloudManagedSchemaConcurrent, OverriddenZkACLAndCredentialsProvidersTest, DeleteLastCustomShardedReplicaTest, DocValuesMultiTest, TestDefaultSimilarityFactory, TestRangeQuery, LeaderElectionTest, CoreAdminRequestStatusTest, TestFreeTextSuggestions, TestCollationFieldDocValues, TestJsonRequest, NumericFieldsTest, TestNoOpRegenerator, TestReqParamsAPI, SampleTest, DefaultValueUpdateProcessorTest, TestUtils, TestSurroundQueryParser, TestDistribDocBasedVersion, MultiTermTest, TestJmxMonitoredMap, TestReloadAndDeleteDocs, SoftAutoCommitTest, TestNRTOpen, TestSimpleTrackingShardHandler, TestClassNameShortening, TestManagedSchema, TestFiltering, TestRawResponseWriter, ConcurrentDeleteAndCreateCollectionTest, TestSolrConfigHandler, DistributedExpandComponentTest, TestCodecSupport, AnalysisAfterCoreReloadTest, TestConfigReload, ZkStateWriterTest, ResponseHeaderTest, AddBlockUpdateTest, CachingDirectoryFactoryTest, OutputWriterTest, AsyncMigrateRouteKeyTest, CloudExitableDirectoryReaderTest, TestAuthorizationFramework, TestManagedSchemaFieldResource, BadIndexSchemaTest, TestCSVLoader, TestChildDocTransformer, TestWriterPerf, DistributedFacetPivotSmallAdvancedTest, AtomicUpdatesTest, FacetPivotSmallTest, TestIndexingPerformance, VersionInfoTest, ResponseLogComponentTest, TestValueSourceCache, ClusterStateUpdateTest, ExternalCollectionsTest, BasicDistributedZkTest, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest]
[junit4] Completed [258/496] on J3 in 170.92s, 1 test, 1 failure <<< FAILURES!
[...truncated 205 lines...]
[junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
[junit4] 2> Creating dataDir: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.update.processor.UpdateRequestProcessorFactoryTest 19F35FD276FB405C-001/init-core-data-001
[junit4] 2> 2473552 T14893 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 2473553 T14893 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 2474047 T14893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2474047 T14893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2474048 T14893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2474048 T14893 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2474083 T14893 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/lib).
[junit4] 2> 2474757 T14894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2474758 T14894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2474759 T14894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 2474759 T14894 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 2474760 T14894 x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.update.processor.UpdateRequestProcessorFactoryTest 19F35FD276FB405C-001/init-core-data-001/index' doesn't exist. Creating new index...
[junit4] 2> 2475015 T14894 x:collection1 oasc.RequestHandlers.initHandlersFromConfig WARN no default request handler is registered (either '/select' or 'standard')
[junit4] 2> 2475024 T14894 x:collection1 oasr.ManagedResourceStorage.newStorageIO WARN Cannot write to config directory /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
[junit4] 2> 2475027 T14893 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2475034 T14893 oas.SolrTestCaseJ4.setUp ###Starting testUpdateDistribChainSkipping
[junit4] 2> 2475035 T14893 oas.SolrTestCaseJ4.tearDown ###Ending testUpdateDistribChainSkipping
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=19F35FD276FB405C -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=sl_SI -Dtests.timezone=Europe/Isle_of_Man -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 0.01s J3 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([19F35FD276FB405C:6817A10400106790]:0)
[junit4] > at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:111)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 2475047 T14893 oas.SolrTestCaseJ4.setUp ###Starting testConfiguration
[junit4] 2> 2475048 T14893 oas.SolrTestCaseJ4.tearDown ###Ending testConfiguration
[junit4] 2> 2475049 T14893 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J3/temp/solr.update.processor.UpdateRequestProcessorFactoryTest 19F35FD276FB405C-001
[junit4] 2> NOTE: test params are: codec=Lucene50, sim=DefaultSimilarity, locale=sl_SI, timezone=Europe/Isle_of_Man
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_65 (64-bit)/cpus=16,threads=1,free=228639944,total=533725184
[junit4] 2> NOTE: All tests run in this JVM: [TermVectorComponentDistributedTest, TestSystemIdResolver, TestLeaderElectionZkExpiry, CollectionsAPIDistributedZkTest, TestCloudManagedSchemaConcurrent, OverriddenZkACLAndCredentialsProvidersTest, DeleteLastCustomShardedReplicaTest, DocValuesMultiTest, TestDefaultSimilarityFactory, TestRangeQuery, LeaderElectionTest, CoreAdminRequestStatusTest, TestFreeTextSuggestions, TestCollationFieldDocValues, TestJsonRequest, NumericFieldsTest, TestNoOpRegenerator, TestReqParamsAPI, SampleTest, DefaultValueUpdateProcessorTest, TestUtils, TestSurroundQueryParser, TestDistribDocBasedVersion, MultiTermTest, TestJmxMonitoredMap, TestReloadAndDeleteDocs, SoftAutoCommitTest, TestNRTOpen, TestSimpleTrackingShardHandler, TestClassNameShortening, TestManagedSchema, TestFiltering, TestRawResponseWriter, ConcurrentDeleteAndCreateCollectionTest, TestSolrConfigHandler, DistributedExpandComponentTest, TestCodecSupport, AnalysisAfterCoreReloadTest, TestConfigReload, ZkStateWriterTest, ResponseHeaderTest, AddBlockUpdateTest, CachingDirectoryFactoryTest, OutputWriterTest, AsyncMigrateRouteKeyTest, CloudExitableDirectoryReaderTest, TestAuthorizationFramework, TestManagedSchemaFieldResource, BadIndexSchemaTest, TestCSVLoader, TestChildDocTransformer, TestWriterPerf, DistributedFacetPivotSmallAdvancedTest, AtomicUpdatesTest, FacetPivotSmallTest, TestIndexingPerformance, VersionInfoTest, ResponseLogComponentTest, TestValueSourceCache, ClusterStateUpdateTest, ExternalCollectionsTest, BasicDistributedZkTest, UnloadDistributedZkTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestDistributedGrouping, TestFaceting, ZkControllerTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, DistributedTermsComponentTest, SimpleFacetsTest, SolrCoreTest, SolrCmdDistributorTest, HighlighterTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, SuggesterFSTTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, TestTrie, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, DebugComponentTest, TestQueryUtils, StandardRequestHandlerTest, TestQueryTypes, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, TestArbitraryIndexDir, LoggingHandlerTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest]
[junit4] Completed [321/496] on J3 in 1.52s, 2 tests, 1 failure <<< FAILURES!
[...truncated 546 lines...]
BUILD FAILED
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/usr/home/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1971 tests, 2 failures, 65 ignored (11 assumptions)
Total time: 181 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 5 artifacts
Archive block size is 32768
Received 0 blocks and 909921216 bytes
Compression is 0.0%
Took 2 min 35 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 858 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/858/
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=4271, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4271, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42343/zg_x: collection already exists: awholynewstresscollection_collection1_1
at __randomizedtesting.SeedInfo.seed([A7DF9F764311F131]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1621)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1642)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:877)
Build Log:
[...truncated 10359 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/init-core-data-001
[junit4] 2> 491076 T3943 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
[junit4] 2> 491076 T3943 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /zg_x/
[junit4] 2> 491081 T3943 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 491081 T3944 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 491082 T3944 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 491181 T3943 oasc.ZkTestServer.run start zk server on port:39162
[junit4] 2> 491182 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491183 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491187 T3951 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72318b04 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491188 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491188 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491189 T3943 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 491193 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491193 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491195 T3954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b4c6d89 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491195 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491196 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491196 T3943 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 491200 T3943 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 491203 T3943 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 491205 T3943 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 491209 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 491210 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 491214 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 491215 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 491219 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491220 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491223 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 491224 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 491227 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 491228 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 491231 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 491231 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 491234 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 491234 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 491237 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 491237 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 491240 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 491241 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 491244 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 491244 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 491247 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 491248 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 491251 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491253 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491255 T3957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b6dd8b5 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491255 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491256 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491256 T3943 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 491258 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491259 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491261 T3960 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e5551d2 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491262 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491262 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491263 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 491264 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 491268 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 491269 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 491272 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 491273 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 491279 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491280 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 491283 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 491284 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 491287 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 491288 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 491291 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 491291 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 491294 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 491295 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 491297 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 491298 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 491300 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 491301 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 491303 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 491304 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 491306 T3943 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 491307 T3943 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 491633 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1
[junit4] 2> 491635 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 491637 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@e568c69{/zg_x,null,AVAILABLE}
[junit4] 2> 491639 T3943 oejs.AbstractConnector.doStart Started ServerConnector@cf2c9b3{HTTP/1.1}{127.0.0.1:40177}
[junit4] 2> 491640 T3943 oejs.Server.doStart Started @493160ms
[junit4] 2> 491640 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/zg_x, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores, hostPort=40177}
[junit4] 2> 491641 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 491641 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/'
[junit4] 2> 491657 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/solr.xml
[junit4] 2> 491673 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores
[junit4] 2> 491673 T3943 oasc.CoreContainer.<init> New CoreContainer 635411005
[junit4] 2> 491674 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/]
[junit4] 2> 491674 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/lib
[junit4] 2> 491674 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/lib).
[junit4] 2> 491700 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 491702 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 491703 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 491703 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 491704 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 491704 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 491704 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 491705 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 491706 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491708 T3974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56db1007 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491709 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491710 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 491713 T3943 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 491714 T3977 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@760ed9b7 name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 491715 T3943 n:127.0.0.1:40177_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 491717 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 491722 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 491725 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 491728 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 491730 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 491734 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 491736 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 491738 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 491739 T3943 n:127.0.0.1:40177_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40177_zg_x
[junit4] 2> 491740 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40177_zg_x
[junit4] 2> 491742 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 491744 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 491746 T3943 n:127.0.0.1:40177_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 491748 T3943 n:127.0.0.1:40177_zg_x oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40177_zg_x
[junit4] 2> 491748 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 491750 T3943 n:127.0.0.1:40177_zg_x oasc.Overseer.start Overseer (id=93885543106347013-127.0.0.1:40177_zg_x-n_0000000000) starting
[junit4] 2> 491753 T3943 n:127.0.0.1:40177_zg_x oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 491761 T3943 n:127.0.0.1:40177_zg_x oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 491762 T3943 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 491762 T3979 n:127.0.0.1:40177_zg_x oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 491762 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 491766 T3943 n:127.0.0.1:40177_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 491767 T3943 n:127.0.0.1:40177_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 491768 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores
[junit4] 2> 491769 T3943 n:127.0.0.1:40177_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/, loadOnStartup=true, collection=control_collection, name=collection1, transient=false, schema=schema.xml, shard=, config=solrconfig.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1, dataDir=data/, coreNodeName=}
[junit4] 2> 491770 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/
[junit4] 2> 491770 T3943 n:127.0.0.1:40177_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 491771 T3981 n:127.0.0.1:40177_zg_x c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 491772 T3981 n:127.0.0.1:40177_zg_x c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 491773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 491773 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 491774 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"1"} current state version: 0
[junit4] 2> 491774 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"1"}
[junit4] 2> 491775 T3978 n:127.0.0.1:40177_zg_x oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 491775 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 491776 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 492773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 492773 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 492775 T3981 n:127.0.0.1:40177_zg_x oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 492775 T3981 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 492776 T3981 n:127.0.0.1:40177_zg_x oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 492777 T3981 n:127.0.0.1:40177_zg_x oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/'
[junit4] 2> 492794 T3981 n:127.0.0.1:40177_zg_x oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 492801 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 492815 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 492847 T3981 n:127.0.0.1:40177_zg_x oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 492849 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 492856 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 493118 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 493128 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 493130 T3981 n:127.0.0.1:40177_zg_x oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 493142 T3981 n:127.0.0.1:40177_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 493146 T3981 n:127.0.0.1:40177_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 493149 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 493150 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 493152 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 493153 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d72f5d6
[junit4] 2> 493153 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index/
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/control-001/cores/collection1/data/index
[junit4] 2> 493154 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=45.962890625, floorSegmentMB=1.0, forceMergeDeletesPctAllowed=25.182957309614363, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.824333526459131
[junit4] 2> 493155 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7a5674a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c202f31; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 493156 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 493160 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 493160 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 493161 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 493162 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 493165 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493167 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493168 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493169 T3981 n:127.0.0.1:40177_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 493173 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json/docs,/admin/luke,/admin/threads,/admin/logging,/config,standard,/get,/admin/system,/admin/plugins,/admin/file,/admin/ping,/replication,/update/json,/admin/properties,/update/csv,/admin/mbeans,/update,/schema,/admin/segments
[junit4] 2> 493175 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 493176 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 493176 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 493177 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 493177 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@7a5674a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c202f31; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 493178 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 493179 T3981 n:127.0.0.1:40177_zg_x x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@4848d49c[collection1] main
[junit4] 2> 493179 T3981 n:127.0.0.1:40177_zg_x x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 493180 T3981 n:127.0.0.1:40177_zg_x x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 493180 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 493181 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 493182 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 493183 T3981 n:127.0.0.1:40177_zg_x x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 493183 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 493183 T3982 n:127.0.0.1:40177_zg_x x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4848d49c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 493184 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502168691903561728
[junit4] 2> 493187 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1502168691903561728
[junit4] 2> 493187 T3981 n:127.0.0.1:40177_zg_x x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 493188 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40177/zg_x collection:control_collection shard:shard1
[junit4] 2> 493188 T3943 n:127.0.0.1:40177_zg_x oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
[junit4] 2> 493188 T3943 n:127.0.0.1:40177_zg_x oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 493189 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 493190 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 493191 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493193 T3988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fe326ae name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493193 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493194 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 493194 T3943 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 493195 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 493200 T3943 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 493203 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493203 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C411 name=collection1 org.apache.solr.core.SolrCore@6f93b9fc url=http://127.0.0.1:40177/zg_x/collection1 node=127.0.0.1:40177_zg_x C411_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:40177_zg_x, state=down, core=collection1, base_url=http://127.0.0.1:40177/zg_x}
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40177/zg_x/collection1/
[junit4] 2> 493204 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 493204 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 C411 oasc.SyncStrategy.syncToMe http://127.0.0.1:40177/zg_x/collection1/ has no replicas
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40177/zg_x/collection1/ shard1
[junit4] 2> 493205 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 493209 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493210 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 493314 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493314 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493360 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:40177/zg_x/collection1/ and leader is http://127.0.0.1:40177/zg_x/collection1/
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40177/zg_x
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 493361 T3985 n:127.0.0.1:40177_zg_x c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 493363 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 493364 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"2"} current state version: 2
[junit4] 2> 493365 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:40177_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:40177/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 493468 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493468 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 493523 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1
[junit4] 2> 493525 T3943 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001
[junit4] 2> 493526 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 493528 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1c8f8f05{/zg_x,null,AVAILABLE}
[junit4] 2> 493528 T3943 oejs.AbstractConnector.doStart Started ServerConnector@4b7c84bf{HTTP/1.1}{127.0.0.1:36311}
[junit4] 2> 493529 T3943 oejs.Server.doStart Started @495049ms
[junit4] 2> 493529 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/zg_x, solrconfig=solrconfig.xml, hostPort=36311, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores}
[junit4] 2> 493529 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 493530 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/'
[junit4] 2> 493546 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/solr.xml
[junit4] 2> 493561 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores
[junit4] 2> 493561 T3943 oasc.CoreContainer.<init> New CoreContainer 980129858
[junit4] 2> 493561 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/]
[junit4] 2> 493562 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/lib
[junit4] 2> 493562 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/lib).
[junit4] 2> 493571 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 493572 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 493573 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 493573 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 493573 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 493573 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 493574 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 493574 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 493576 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493577 T4002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f811c80 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493578 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493579 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 493581 T3943 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 493583 T4005 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@dc521dc name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 493583 T3943 n:127.0.0.1:36311_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 493590 T3943 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 494597 T3943 n:127.0.0.1:36311_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36311_zg_x
[junit4] 2> 494598 T3943 n:127.0.0.1:36311_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36311_zg_x
[junit4] 2> 494601 T3943 n:127.0.0.1:36311_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 494603 T3943 n:127.0.0.1:36311_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 494604 T3943 n:127.0.0.1:36311_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 494605 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, shard=, collection=collection1, config=solrconfig.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1, coreNodeName=, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/, loadOnStartup=true, transient=false, name=collection1, schema=schema.xml}
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/
[junit4] 2> 494606 T3943 n:127.0.0.1:36311_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 494607 T4006 n:127.0.0.1:36311_zg_x c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 494608 T4006 n:127.0.0.1:36311_zg_x c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 494609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 494609 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"} current state version: 3
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 494610 T3978 n:127.0.0.1:40177_zg_x oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 494611 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 494714 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 494714 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 494714 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 495609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 495609 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 495611 T4006 n:127.0.0.1:36311_zg_x oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 495611 T4006 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 495612 T4006 n:127.0.0.1:36311_zg_x oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 495613 T4006 n:127.0.0.1:36311_zg_x oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/'
[junit4] 2> 495632 T4006 n:127.0.0.1:36311_zg_x oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 495638 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 495652 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 495683 T4006 n:127.0.0.1:36311_zg_x oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 495685 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 495692 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 495944 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 495963 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 495965 T4006 n:127.0.0.1:36311_zg_x oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 495983 T4006 n:127.0.0.1:36311_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 495988 T4006 n:127.0.0.1:36311_zg_x oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 495992 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 495993 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 495995 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d72f5d6
[junit4] 2> 495996 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 495997 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=45.962890625, floorSegmentMB=1.0, forceMergeDeletesPctAllowed=25.182957309614363, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.824333526459131
[junit4] 2> 495998 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@621ad2fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4f11d0b5; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 495998 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 496004 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 496005 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 496006 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 496006 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 496009 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496010 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496012 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496013 T4006 n:127.0.0.1:36311_zg_x x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 496019 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /update/json/docs,/admin/luke,/admin/threads,/admin/logging,/config,standard,/get,/admin/system,/admin/plugins,/admin/file,/admin/ping,/replication,/update/json,/admin/properties,/update/csv,/admin/mbeans,/update,/schema,/admin/segments
[junit4] 2> 496021 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 496021 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 496022 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 496023 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 496023 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 496024 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@621ad2fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4f11d0b5; maxCacheMB=0.6416015625 maxMergeSizeMB=0.5849609375)),segFN=segments_1,generation=1}
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@1b92c9c5[collection1] main
[junit4] 2> 496025 T4006 n:127.0.0.1:36311_zg_x x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 496026 T4006 n:127.0.0.1:36311_zg_x x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 496026 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 496027 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 496028 T4006 n:127.0.0.1:36311_zg_x x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 496029 T4007 n:127.0.0.1:36311_zg_x x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b92c9c5[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 496030 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 496031 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502168694888857600
[junit4] 2> 496033 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1502168694888857600
[junit4] 2> 496033 T4006 n:127.0.0.1:36311_zg_x x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 496034 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36311/zg_x collection:collection1 shard:shard2
[junit4] 2> 496035 T3943 n:127.0.0.1:36311_zg_x oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
[junit4] 2> 496035 T3943 n:127.0.0.1:36311_zg_x oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 496038 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 496042 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 496044 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C412 name=collection1 org.apache.solr.core.SolrCore@6e1fa000 url=http://127.0.0.1:36311/zg_x/collection1 node=127.0.0.1:36311_zg_x C412_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:36311_zg_x, state=down, core=collection1, base_url=http://127.0.0.1:36311/zg_x}
[junit4] 2> 496044 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36311/zg_x/collection1/
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 C412 oasc.SyncStrategy.syncToMe http://127.0.0.1:36311/zg_x/collection1/ has no replicas
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36311/zg_x/collection1/ shard2
[junit4] 2> 496045 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 496047 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 496051 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496052 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 496155 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496155 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496155 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register We are http://127.0.0.1:36311/zg_x/collection1/ and leader is http://127.0.0.1:36311/zg_x/collection1/
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36311/zg_x
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 496202 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 496203 T4010 n:127.0.0.1:36311_zg_x c:collection1 s:shard2 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 496204 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 496205 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"} current state version: 5
[junit4] 2> 496206 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "node_name":"127.0.0.1:36311_zg_x",
[junit4] 2> "state":"active",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:36311/zg_x",
[junit4] 2> "numShards":"2"}
[junit4] 2> 496309 T3988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496310 T4005 n:127.0.0.1:36311_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496310 T3977 n:127.0.0.1:40177_zg_x oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 496368 T3943 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1
[junit4] 2> 496369 T3943 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001
[junit4] 2> 496370 T3943 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 496372 T3943 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@12fbe862{/zg_x,null,AVAILABLE}
[junit4] 2> 496373 T3943 oejs.AbstractConnector.doStart Started ServerConnector@56373b34{HTTP/1.1}{127.0.0.1:42343}
[junit4] 2> 496373 T3943 oejs.Server.doStart Started @497893ms
[junit4] 2> 496374 T3943 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=42343, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores, hostContext=/zg_x, solrconfig=solrconfig.xml}
[junit4] 2> 496374 T3943 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@620b5b80
[junit4] 2> 496374 T3943 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/'
[junit4] 2> 496391 T3943 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/solr.xml
[junit4] 2> 496406 T3943 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores
[junit4] 2> 496406 T3943 oasc.CoreContainer.<init> New CoreContainer 724333786
[junit4] 2> 496406 T3943 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/]
[junit4] 2> 496406 T3943 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/lib
[junit4] 2> 496407 T3943 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/lib).
[junit4] 2> 496416 T3943 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 496417 T3943 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 496418 T3943 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 496418 T3943 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 496419 T3943 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 496419 T3943 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:39162/solr
[junit4] 2> 496419 T3943 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 496419 T3943 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 496420 T3943 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 496422 T4024 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4e71de4 name:ZooKeeperConnection Watcher:127.0.0.1:39162 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 496423 T3943 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 496424 T3943 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 496426 T3943 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 496427 T4027 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4519d02c name:ZooKeeperConnection Watcher:127.0.0.1:39162/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 496428 T3943 n:127.0.0.1:42343_zg_x oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 496434 T3943 n:127.0.0.1:42343_zg_x oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 497440 T3943 n:127.0.0.1:42343_zg_x oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42343_zg_x
[junit4] 2> 497441 T3943 n:127.0.0.1:42343_zg_x oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:42343_zg_x
[junit4] 2> 497448 T3943 n:127.0.0.1:42343_zg_x oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 497450 T3943 n:127.0.0.1:42343_zg_x oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 497450 T3943 n:127.0.0.1:42343_zg_x oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 497452 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1, coreNodeName=, name=collection1, loadOnStartup=true, shard=, config=solrconfig.xml, collection=collection1, dataDir=data/, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1/, transient=false}
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest A7DF9F764311F131-001/shard-2-001/cores/collection1/
[junit4] 2> 497453 T3943 n:127.0.0.1:42343_zg_x oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 497454 T4028 n:127.0.0.1:42343_zg_x c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 497454 T4028 n:127.0.0.1:42343_zg_x c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 497455 T3977 n:127.0.0.1:40177_zg_x oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 497455 T4028 n:127.0.0.1:42343_zg_x oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 497456 T3978 n:127.0.0.1:40177_zg_x oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:42343_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4] 2> "operation":"state",
[junit4] 2> "collection":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"http://127.0.0.1:42343/zg_x",
[junit4] 2> "numShards":"2"} current state version: 6
[junit4] 2> 497457 T3978 n:127.0.0.1:40177_zg_x oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:42343_zg_x",
[junit4] 2> "state":"down",
[junit4] 2> "core":"collection1",
[junit4] 2> "shard":null,
[junit4]
[...truncated too long message...]
SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
[junit4] > Caused by: org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: http://127.0.0.1:42343/zg_x
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:570)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > ... 5 more
[junit4] > Caused by: java.net.SocketTimeoutException: Read timed out
[junit4] > at java.net.SocketInputStream.socketRead0(Native Method)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:152)
[junit4] > at java.net.SocketInputStream.read(SocketInputStream.java:122)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
[junit4] > at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
[junit4] > at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
[junit4] > at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
[junit4] > at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:261)
[junit4] > at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
[junit4] > at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
[junit4] > at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:272)
[junit4] > at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:124)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:685)
[junit4] > at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:487)
[junit4] > at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:107)
[junit4] > at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:466)
[junit4] > ... 9 moreThrowable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4275, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:42343/zg_x: Could not find collection : awholynewstresscollection_collection5_1
[junit4] > at __randomizedtesting.SeedInfo.seed([A7DF9F764311F131]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
[junit4] 2> 972905 T3943 c:collection1 s:shard2 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {multiDefault=Lucene50(blocksize=128), a_t=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=LuceneFixedGap), range_facet_l_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_i_dv=PostingsFormat(name=Memory doPackFST= true), range_facet_l=PostingsFormat(name=Memory doPackFST= true), a_i1=PostingsFormat(name=Memory doPackFST= true), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), _version_=PostingsFormat(name=Memory doPackFST= true), timestamp=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Memory doPackFST= true)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Direct)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=vi, timezone=Asia/Colombo
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=200145752,total=514850816
[junit4] 2> NOTE: All tests run in this JVM: [TestCustomSort, PreAnalyzedUpdateProcessorTest, TestSolrConfigHandlerConcurrent, DistributedTermsComponentTest, CoreAdminRequestStatusTest, CacheHeaderTest, TestValueSourceCache, SpatialFilterTest, TestManagedResourceStorage, TestSchemaNameResource, TestTolerantSearch, TestWriterPerf, TestFreeTextSuggestions, MergeStrategyTest, PreAnalyzedFieldTest, TestSuggestSpellingConverter, BasicFunctionalityTest, SuggestComponentTest, TestBlendedInfixSuggestions, TestFastWriter, DisMaxRequestHandlerTest, WordBreakSolrSpellCheckerTest, TestStressUserVersions, TestSortingResponseWriter, TestAddFieldRealTimeGet, ShardRoutingTest, HdfsRecoverLeaseTest, ScriptEngineTest, SpellCheckComponentTest, UpdateParamsTest, TestSolrCoreProperties, DistanceUnitsTest, TestPHPSerializedResponseWriter, TestLRUCache, ConvertedLegacyTest, TestRebalanceLeaders, JsonLoaderTest, DocExpirationUpdateProcessorFactoryTest, SolrPluginUtilsTest, SpellingQueryConverterTest, FieldMutatingUpdateProcessorTest, TestDynamicFieldResource, TestFuzzyAnalyzedSuggestions, TestCollapseQParserPlugin, TestClassNameShortening, TestDistributedMissingSort, RequiredFieldsTest, ResourceLoaderTest, TestObjectReleaseTracker, TestSolrDeletionPolicy2, ClusterStateUpdateTest, SharedFSAutoReplicaFailoverUtilsTest, CachingDirectoryFactoryTest, LukeRequestHandlerTest, AnalysisAfterCoreReloadTest, TestShardHandlerFactory, TestJsonFacets, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestAnalyzeInfixSuggestions, TestHighFrequencyDictionaryFactory, TestAnalyzedSuggestions, DocumentAnalysisRequestHandlerTest, ChaosMonkeySafeLeaderTest, RAMDirectoryFactoryTest, ShardRoutingCustomTest, TestElisionMultitermQuery, CoreAdminCreateDiscoverTest, TestHdfsUpdateLog, TestConfigSets, TestSolrDynamicMBean, TestAtomicUpdateErrorCases, SegmentsInfoRequestHandlerTest, TestRTGBase, SystemInfoHandlerTest, TestCursorMarkWithoutUniqueKey, DeleteShardTest, TestMiniSolrCloudCluster, TestReplicaProperties, HdfsNNFailoverTest, SuggesterTSTTest, TestIndexSearcher, TestCoreContainer, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed [138/496] on J1 in 482.46s, 1 test, 1 error <<< FAILURES!
[...truncated 1147 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1973 tests, 1 error, 51 ignored (10 assumptions)
Total time: 161 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 846215487 bytes
Compression is 0.0%
Took 2 min 24 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 857 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/857/
2 tests failed.
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Invalid content type:
Stack Trace:
org.apache.http.ParseException: Invalid content type:
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
at org.apache.http.entity.ContentType.parse(ContentType.java:273)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:513)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:224)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:166)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:676)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.handler.component.DistributedFacetPivotSmallTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35094/av_/oc/collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37832/av_/oc/collection1, http://[ff01::114]:33332/av_/oc, http://[ff01::083]:33332/av_/oc, http://[ff01::213]:33332/av_/oc]
at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:621)
Build Log:
[...truncated 10739 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/init-core-data-001
[junit4] 2> 1659977 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection1
[junit4] 2> 1659979 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1659992 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@a4261bb{/,null,AVAILABLE}
[junit4] 2> 1659993 T9146 oejs.AbstractConnector.doStart Started ServerConnector@c1e4140{HTTP/1.1}{127.0.0.1:37384}
[junit4] 2> 1659994 T9146 oejs.Server.doStart Started @1661632ms
[junit4] 2> 1660051 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/lib).
[junit4] 2> 1661516 T9178 n:127.0.0.1:37384_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1661938 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/cores/collection1
[junit4] 2> 1661947 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1661961 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@15d381ea{/,null,AVAILABLE}
[junit4] 2> 1661961 T9146 oejs.AbstractConnector.doStart Started ServerConnector@70f634d7{HTTP/1.1}{127.0.0.1:39158}
[junit4] 2> 1661962 T9146 oejs.Server.doStart Started @1663600ms
[junit4] 2> 1662041 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/lib).
[junit4] 2> 1664554 T9203 n:127.0.0.1:39158_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1664971 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection1
[junit4] 2> 1664974 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1664978 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@11810f6c{/,null,AVAILABLE}
[junit4] 2> 1664978 T9146 oejs.AbstractConnector.doStart Started ServerConnector@5e936a6e{HTTP/1.1}{127.0.0.1:50927}
[junit4] 2> 1664978 T9146 oejs.Server.doStart Started @1666616ms
[junit4] 2> 1665007 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/lib).
[junit4] 2> 1667461 T9225 n:127.0.0.1:50927_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1667773 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection1
[junit4] 2> 1667776 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1667780 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4acc75a0{/,null,AVAILABLE}
[junit4] 2> 1667781 T9146 oejs.AbstractConnector.doStart Started ServerConnector@1ab7ba9a{HTTP/1.1}{127.0.0.1:34814}
[junit4] 2> 1667781 T9146 oejs.Server.doStart Started @1669419ms
[junit4] 2> 1667813 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/lib).
[junit4] 2> 1670206 T9247 n:127.0.0.1:34814_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1670578 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/cores/collection1
[junit4] 2> 1670582 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1670585 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4d9ab64{/,null,AVAILABLE}
[junit4] 2> 1670586 T9146 oejs.AbstractConnector.doStart Started ServerConnector@67fa54b6{HTTP/1.1}{127.0.0.1:52350}
[junit4] 2> 1670586 T9146 oejs.Server.doStart Started @1672224ms
[junit4] 2> 1670617 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/lib).
[junit4] 2> 1672996 T9269 n:127.0.0.1:52350_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-4-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1673328 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection1
[junit4] 2> 1673331 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1673334 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@2bd0d357{/,null,AVAILABLE}
[junit4] 2> 1673334 T9146 oejs.AbstractConnector.doStart Started ServerConnector@2ff61aa0{HTTP/1.1}{127.0.0.1:56400}
[junit4] 2> 1673335 T9146 oejs.Server.doStart Started @1674973ms
[junit4] 2> 1673365 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/lib).
[junit4] 2> 1675758 T9294 n:127.0.0.1:56400_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1676104 T9146 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection1
[junit4] 2> 1676107 T9146 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 1676110 T9146 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@3f666854{/,null,AVAILABLE}
[junit4] 2> 1676110 T9146 oejs.AbstractConnector.doStart Started ServerConnector@619a2886{HTTP/1.1}{127.0.0.1:52653}
[junit4] 2> 1676111 T9146 oejs.Server.doStart Started @1677749ms
[junit4] 2> 1676144 T9146 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/lib).
[junit4] 2> 1678661 T9319 n:127.0.0.1:52653_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1678762 T9146 oas.SolrTestCaseJ4.setUp ###Starting test
[junit4] 2> ASYNC NEW_CORE C3298 name=collection1 org.apache.solr.core.SolrCore@7cc7b0e3 url=http://127.0.0.1:52350/collection1 node=127.0.0.1:52350_ C3298_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:52350, node_name=127.0.0.1:52350_}
[junit4] 2> 1681065 T9274 n:127.0.0.1:52350_ c:collection1 s:shard1 x:collection1 C3298 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3299 name=collection1 org.apache.solr.core.SolrCore@59e88613 url=http://127.0.0.1:56400/collection1 node=127.0.0.1:56400_ C3299_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1683829 T9299 n:127.0.0.1:56400_ c:collection1 s:shard2 x:collection1 C3299 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3300 name=collection1 org.apache.solr.core.SolrCore@76357e56 url=http://127.0.0.1:52653/collection1 node=127.0.0.1:52653_ C3300_STATE=coll:collection1 core:collection1 props:{state=recovering, core=collection1, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1686794 T9324 n:127.0.0.1:52653_ c:collection1 s:shard3 x:collection1 C3300 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> 1687256 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687307 T9320 n:127.0.0.1:52653_ c:collection1 s:shard3 r:core_node6 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687307 T9248 n:127.0.0.1:34814_ c:collection1 s:shard3 r:core_node3 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:type=searcher,id=org.apache.solr.search.SolrIndexSearcher
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687309 T9248 n:127.0.0.1:34814_ c:collection1 s:shard3 r:core_node3 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1687311 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:id=org.apache.solr.search.FastLRUCache,type=fieldValueCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715031 T9204 n:127.0.0.1:39158_ c:collection1 s:shard1 r:core_node1 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceAlreadyExistsException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715275 T9295 n:127.0.0.1:56400_ c:collection1 s:shard2 r:core_node5 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: searcher javax.management.InstanceNotFoundException: solr/collection1:id=org.apache.solr.search.SolrIndexSearcher,type=searcher
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getMBean(DefaultMBeanServerInterceptor.java:1095)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:427)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:178)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:395)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1715277 T9270 n:127.0.0.1:52350_ c:collection1 s:shard1 r:core_node4 x:collection1 oasc.JmxMonitoredMap.put WARN Failed to register info bean: fieldValueCache javax.management.InstanceAlreadyExistsException: solr/collection1:type=fieldValueCache,id=org.apache.solr.search.FastLRUCache
[junit4] 2> at com.sun.jmx.mbeanserver.Repository.addMBean(Repository.java:437)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerWithRepository(DefaultMBeanServerInterceptor.java:1898)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:966)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:900)
[junit4] 2> at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:324)
[junit4] 2> at com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:522)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:180)
[junit4] 2> at org.apache.solr.core.JmxMonitoredMap.put(JmxMonitoredMap.java:72)
[junit4] 2> at org.apache.solr.search.SolrIndexSearcher.register(SolrIndexSearcher.java:399)
[junit4] 2> at org.apache.solr.core.SolrCore.registerSearcher(SolrCore.java:2005)
[junit4] 2> at org.apache.solr.core.SolrCore.access$100(SolrCore.java:151)
[junit4] 2> at org.apache.solr.core.SolrCore$7.call(SolrCore.java:1872)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1716861 T9202 n:127.0.0.1:39158_ oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1716872 T9146 oejs.AbstractConnector.doStop Stopped ServerConnector@70f634d7{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1716872 T9146 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@15d381ea{/,null,UNAVAILABLE}
[junit4] 2> ASYNC NEW_CORE C3301 name=collection1 org.apache.solr.core.SolrCore@7cc7b0e3 url=http://127.0.0.1:52350/collection1 node=127.0.0.1:52350_ C3301_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, base_url=http://127.0.0.1:52350, node_name=127.0.0.1:52350_}
[junit4] 2> 1717864 T9268 n:127.0.0.1:52350_ C3301 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 1718380 T9407 n:127.0.0.1:52350_ oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1718385 T9146 oejs.AbstractConnector.doStop Stopped ServerConnector@67fa54b6{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 1718385 T9146 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@4d9ab64{/,null,UNAVAILABLE}
[junit4] 2> ASYNC NEW_CORE C3302 name=collection1 org.apache.solr.core.SolrCore@2168fff4 url=http://127.0.0.1:50927/collection1 node=127.0.0.1:50927_ C3302_STATE=coll:collection1 core:collection1 props:{state=active, core=collection1, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_, leader=true}
[junit4] 2> 1723442 T9212 n:127.0.0.1:50927_ c:collection1 s:shard2 r:core_node2 x:collection1 C3302 oasc.SolrException.log ERROR org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard1
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:684)
[junit4] 2> at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:670)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:363)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.setupRequest(DistributedUpdateProcessor.java:314)
[junit4] 2> at org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:665)
[junit4] 2> at org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:250)
[junit4] 2> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:177)
[junit4] 2> at org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:98)
[junit4] 2> at org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:74)
[junit4] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)
[junit4] 2> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2059)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:640)
[junit4] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:436)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:105)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
[junit4] 2> at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:300)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:497)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1723451 T9414 n:127.0.0.1:37384_ c:collection1 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : delete , {
[junit4] 2> "name":"collection1",
[junit4] 2> "operation":"delete"}
[junit4] 2> 1723485 T9318 n:127.0.0.1:52653_ oasc.LeaderElector.checkIfIamLeader WARN Our node is no longer in line to be leader
[junit4] 2> 1723486 T9409 n:127.0.0.1:56400_ oasc.ElectionContext.cancelElection WARN cancelElection did not find election node to remove /collections/collection1/leader_elect/shard2/election/93881794365554702-core_node5-n_0000000001
[junit4] 2> 1723487 T9409 n:127.0.0.1:56400_ oasc.LeaderElector$ElectionWatcher.process WARN org.apache.solr.common.SolrException: SolrCore not found:collection1 in []
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:215)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:198)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:390)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264)
[junit4] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[junit4] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:148)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1724234 T9419 n:127.0.0.1:37384_ c:collection2 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
[junit4] 2> "name":"collection2",
[junit4] 2> "fromApi":"true",
[junit4] 2> "replicationFactor":"3",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"7",
[junit4] 2> "maxShardsPerNode":"100000",
[junit4] 2> "stateFormat":"1",
[junit4] 2> "operation":"create"}
[junit4] 2> 1729314 T9310 n:127.0.0.1:52653_ x:collection2_shard5_replica2 oasc.SolrCore.initIndex WARN [collection2_shard5_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard5_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729361 T9285 n:127.0.0.1:56400_ x:collection2_shard3_replica2 oasc.SolrCore.initIndex WARN [collection2_shard3_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729379 T9164 n:127.0.0.1:37384_ x:collection2_shard4_replica2 oasc.SolrCore.initIndex WARN [collection2_shard4_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard4_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729643 T9213 n:127.0.0.1:50927_ x:collection2_shard7_replica2 oasc.SolrCore.initIndex WARN [collection2_shard7_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard7_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729786 T9162 n:127.0.0.1:37384_ x:collection2_shard7_replica3 oasc.SolrCore.initIndex WARN [collection2_shard7_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard7_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729829 T9308 n:127.0.0.1:52653_ x:collection2_shard3_replica3 oasc.SolrCore.initIndex WARN [collection2_shard3_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard3_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729853 T9214 n:127.0.0.1:50927_ x:collection2_shard5_replica3 oasc.SolrCore.initIndex WARN [collection2_shard5_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard5_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729889 T9237 n:127.0.0.1:34814_ x:collection2_shard1_replica2 oasc.SolrCore.initIndex WARN [collection2_shard1_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729902 T9235 n:127.0.0.1:34814_ x:collection2_shard3_replica1 oasc.SolrCore.initIndex WARN [collection2_shard3_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard3_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1729950 T9282 n:127.0.0.1:56400_ x:collection2_shard5_replica1 oasc.SolrCore.initIndex WARN [collection2_shard5_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard5_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730920 T9307 n:127.0.0.1:52653_ x:collection2_shard7_replica1 oasc.SolrCore.initIndex WARN [collection2_shard7_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard7_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730929 T9309 n:127.0.0.1:52653_ x:collection2_shard2_replica1 oasc.SolrCore.initIndex WARN [collection2_shard2_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-6-001/cores/collection2_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730950 T9165 n:127.0.0.1:37384_ x:collection2_shard1_replica1 oasc.SolrCore.initIndex WARN [collection2_shard1_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730984 T9163 n:127.0.0.1:37384_ x:collection2_shard6_replica1 oasc.SolrCore.initIndex WARN [collection2_shard6_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard6_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1730990 T9215 n:127.0.0.1:50927_ x:collection2_shard2_replica2 oasc.SolrCore.initIndex WARN [collection2_shard2_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731056 T9281 n:127.0.0.1:56400_ x:collection2_shard6_replica3 oasc.SolrCore.initIndex WARN [collection2_shard6_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard6_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731057 T9212 n:127.0.0.1:50927_ x:collection2_shard4_replica1 oasc.SolrCore.initIndex WARN [collection2_shard4_replica1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-2-001/cores/collection2_shard4_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731167 T9284 n:127.0.0.1:56400_ x:collection2_shard1_replica3 oasc.SolrCore.initIndex WARN [collection2_shard1_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-5-001/cores/collection2_shard1_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731193 T9236 n:127.0.0.1:34814_ x:collection2_shard4_replica3 oasc.SolrCore.initIndex WARN [collection2_shard4_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard4_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731203 T9238 n:127.0.0.1:34814_ x:collection2_shard6_replica2 oasc.SolrCore.initIndex WARN [collection2_shard6_replica2] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/shard-3-001/cores/collection2_shard6_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1731211 T9435 n:127.0.0.1:37384_ x:collection2_shard2_replica3 oasc.SolrCore.initIndex WARN [collection2_shard2_replica3] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest B855A1C7B309F547-001/control-001/cores/collection2_shard2_replica3/data/index' doesn't exist. Creating new index...
[junit4] 2> ASYNC NEW_CORE C3303 name=collection2_shard3_replica1 org.apache.solr.core.SolrCore@376b26a8 url=http://127.0.0.1:34814/collection2_shard3_replica1 node=127.0.0.1:34814_ C3303_STATE=coll:collection2 core:collection2_shard3_replica1 props:{state=recovering, core=collection2_shard3_replica1, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739142 T9482 n:127.0.0.1:34814_ c:collection2 s:shard3 x:collection2_shard3_replica1 C3303 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3304 name=collection2_shard5_replica3 org.apache.solr.core.SolrCore@cb16afd url=http://127.0.0.1:50927/collection2_shard5_replica3 node=127.0.0.1:50927_ C3304_STATE=coll:collection2 core:collection2_shard5_replica3 props:{state=recovering, core=collection2_shard5_replica3, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739142 T9483 n:127.0.0.1:50927_ c:collection2 s:shard5 x:collection2_shard5_replica3 C3304 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3305 name=collection2_shard5_replica1 org.apache.solr.core.SolrCore@656d4d8e url=http://127.0.0.1:56400/collection2_shard5_replica1 node=127.0.0.1:56400_ C3305_STATE=coll:collection2 core:collection2_shard5_replica1 props:{state=recovering, core=collection2_shard5_replica1, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1739155 T9487 n:127.0.0.1:56400_ c:collection2 s:shard5 x:collection2_shard5_replica1 C3305 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3306 name=collection2_shard3_replica3 org.apache.solr.core.SolrCore@45e7efc6 url=http://127.0.0.1:52653/collection2_shard3_replica3 node=127.0.0.1:52653_ C3306_STATE=coll:collection2 core:collection2_shard3_replica3 props:{state=recovering, core=collection2_shard3_replica3, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1739157 T9479 n:127.0.0.1:52653_ c:collection2 s:shard3 x:collection2_shard3_replica3 C3306 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3307 name=collection2_shard1_replica3 org.apache.solr.core.SolrCore@200d65c6 url=http://127.0.0.1:56400/collection2_shard1_replica3 node=127.0.0.1:56400_ C3307_STATE=coll:collection2 core:collection2_shard1_replica3 props:{state=recovering, core=collection2_shard1_replica3, base_url=http://127.0.0.1:56400, node_name=127.0.0.1:56400_}
[junit4] 2> 1739377 T9509 n:127.0.0.1:56400_ c:collection2 s:shard1 x:collection2_shard1_replica3 C3307 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3308 name=collection2_shard7_replica3 org.apache.solr.core.SolrCore@b581d6e url=http://127.0.0.1:37384/collection2_shard7_replica3 node=127.0.0.1:37384_ C3308_STATE=coll:collection2 core:collection2_shard7_replica3 props:{state=recovering, core=collection2_shard7_replica3, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739379 T9520 n:127.0.0.1:37384_ c:collection2 s:shard7 x:collection2_shard7_replica3 C3308 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3309 name=collection2_shard4_replica3 org.apache.solr.core.SolrCore@7c63528d url=http://127.0.0.1:34814/collection2_shard4_replica3 node=127.0.0.1:34814_ C3309_STATE=coll:collection2 core:collection2_shard4_replica3 props:{state=recovering, core=collection2_shard4_replica3, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739406 T9510 n:127.0.0.1:34814_ c:collection2 s:shard4 x:collection2_shard4_replica3 C3309 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3310 name=collection2_shard1_replica1 org.apache.solr.core.SolrCore@40c37096 url=http://127.0.0.1:37384/collection2_shard1_replica1 node=127.0.0.1:37384_ C3310_STATE=coll:collection2 core:collection2_shard1_replica1 props:{state=recovering, core=collection2_shard1_replica1, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739410 T9513 n:127.0.0.1:37384_ c:collection2 s:shard1 x:collection2_shard1_replica1 C3310 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3311 name=collection2_shard7_replica1 org.apache.solr.core.SolrCore@498e673 url=http://127.0.0.1:52653/collection2_shard7_replica1 node=127.0.0.1:52653_ C3311_STATE=coll:collection2 core:collection2_shard7_replica1 props:{state=recovering, core=collection2_shard7_replica1, base_url=http://127.0.0.1:52653, node_name=127.0.0.1:52653_}
[junit4] 2> 1739411 T9521 n:127.0.0.1:52653_ c:collection2 s:shard7 x:collection2_shard7_replica1 C3311 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3312 name=collection2_shard6_replica2 org.apache.solr.core.SolrCore@53166389 url=http://127.0.0.1:34814/collection2_shard6_replica2 node=127.0.0.1:34814_ C3312_STATE=coll:collection2 core:collection2_shard6_replica2 props:{state=recovering, core=collection2_shard6_replica2, base_url=http://127.0.0.1:34814, node_name=127.0.0.1:34814_}
[junit4] 2> 1739411 T9511 n:127.0.0.1:34814_ c:collection2 s:shard6 x:collection2_shard6_replica2 C3312 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3313 name=collection2_shard2_replica3 org.apache.solr.core.SolrCore@436c8b49 url=http://127.0.0.1:37384/collection2_shard2_replica3 node=127.0.0.1:37384_ C3313_STATE=coll:collection2 core:collection2_shard2_replica3 props:{state=recovering, core=collection2_shard2_replica3, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739415 T9514 n:127.0.0.1:37384_ c:collection2 s:shard2 x:collection2_shard2_replica3 C3313 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3314 name=collection2_shard4_replica1 org.apache.solr.core.SolrCore@3d6fce97 url=http://127.0.0.1:50927/collection2_shard4_replica1 node=127.0.0.1:50927_ C3314_STATE=coll:collection2 core:collection2_shard4_replica1 props:{state=recovering, core=collection2_shard4_replica1, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739417 T9517 n:127.0.0.1:50927_ c:collection2 s:shard4 x:collection2_shard4_replica1 C3314 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3315 name=collection2_shard6_replica1 org.apache.solr.core.SolrCore@3130d012 url=http://127.0.0.1:37384/collection2_shard6_replica1 node=127.0.0.1:37384_ C3315_STATE=coll:collection2 core:collection2_shard6_replica1 props:{state=recovering, core=collection2_shard6_replica1, base_url=http://127.0.0.1:37384, node_name=127.0.0.1:37384_}
[junit4] 2> 1739418 T9522 n:127.0.0.1:37384_ c:collection2 s:shard6 x:collection2_shard6_replica1 C3315 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 2> ASYNC NEW_CORE C3316 name=collection2_shard2_replica2 org.apache.solr.core.SolrCore@18212853 url=http://127.0.0.1:50927/collection2_shard2_replica2 node=127.0.0.1:50927_ C3316_STATE=coll:collection2 core:collection2_shard2_replica2 props:{state=recovering, core=collection2_shard2_replica2, base_url=http://127.0.0.1:50927, node_name=127.0.0.1:50927_}
[junit4] 2> 1739420 T9519 n:127.0.0.1:50927_ c:collection2 s:shard2 x:collection2_shard2_replica2 C3316 oasu.PeerSync.sync WARN no frame of reference to tell if we've missed updates
[junit4] 1> / (2)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr (7)
[junit4] 1> /solr/overseer_elect (2)
[junit4] 1> /solr/overseer_elect/leader (0)
[junit4] 1> DATA:
[junit4] 1> {"id":"93881794365554691-127.0.0.1:37384_-n_0000000000"}
[junit4] 1> /solr/overseer_elect/election (5)
[junit4] 1> /solr/overseer_elect/election/93881794365554704-127.0.0.1:52653_-n_0000000006 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554698-127.0.0.1:34814_-n_0000000003 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554696-127.0.0.1:50927_-n_0000000002 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554691-127.0.0.1:37384_-n_0000000000 (0)
[junit4] 1> /solr/overseer_elect/election/93881794365554702-127.0.0.1:56400_-n_0000000005 (0)
[junit4] 1> /solr/collections (2)
[junit4] 1> /solr/collections/collection2 (2)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/collection2/leaders (7)
[junit4] 1> /solr/collections/collection2/leaders/shard2 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard2_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}
[junit4] 1> /solr/collections/collection2/leaders/shard5 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard5_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}
[junit4] 1> /solr/collections/collection2/leaders/shard4 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard4_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}
[junit4] 1> /solr/collections/collection2/leaders/shard7 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard7_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"}
[junit4] 1> /solr/collections/collection2/leaders/shard3 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard3_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}
[junit4] 1> /solr/collections/collection2/leaders/shard1 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard1_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"}
[junit4] 1> /solr/collections/collection2/leaders/shard6 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection2_shard6_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}
[junit4] 1> /solr/collections/collection2/leader_elect (7)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554691-core_node20-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554704-core_node11-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard2/election/93881794365554696-core_node9-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554696-core_node8-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554702-core_node17-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard5/election/93881794365554704-core_node10-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554691-core_node12-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554698-core_node3-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard4/election/93881794365554696-core_node6-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554704-core_node13-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554691-core_node2-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard7/election/93881794365554696-core_node21-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554704-core_node14-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554698-core_node7-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard3/election/93881794365554702-core_node1-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554691-core_node18-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554702-core_node15-n_0000000002 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard1/election/93881794365554698-core_node5-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6 (1)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election (3)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554702-core_node19-n_0000000000 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554691-core_node16-n_0000000001 (0)
[junit4] 1> /solr/collections/collection2/leader_elect/shard6/election/93881794365554698-core_node4-n_0000000002 (0)
[junit4] 1> /solr/collections/control_collection (3)
[junit4] 1> DATA:
[junit4] 1> {"configName":"conf1"}
[junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}
[junit4] 1> /solr/collections/control_collection/shards (0)
[junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/93881794365554691-core_node1-n_0000000000 (0)
[junit4] 1> /solr/clusterstate.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "control_collection":{
[junit4] 1> "replicationFactor":"1",
[junit4] 1> "autoCreated":"true",
[junit4] 1> "maxShardsPerNode":"1",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "shards":{"shard1":{
[junit4] 1> "range":"80000000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{"core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_",
[junit4] 1> "leader":"true"}}}}},
[junit4] 1> "collection2":{
[junit4] 1> "replicationFactor":"3",
[junit4] 1> "maxShardsPerNode":"100000",
[junit4] 1> "router":{"name":"compositeId"},
[junit4] 1> "autoAddReplicas":"false",
[junit4] 1> "shards":{
[junit4] 1> "shard1":{
[junit4] 1> "range":"80000000-a491ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node5":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node15":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"},
[junit4] 1> "core_node18":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard1_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}}},
[junit4] 1> "shard2":{
[junit4] 1> "range":"a4920000-c923ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node9":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node11":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node20":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard2_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"}}},
[junit4] 1> "shard3":{
[junit4] 1> "range":"c9240000-edb5ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node1":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node7":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node14":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard3_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"}}},
[junit4] 1> "shard4":{
[junit4] 1> "range":"edb60000-1248ffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node3":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node6":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node12":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard4_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_",
[junit4] 1> "leader":"true"}}},
[junit4] 1> "shard5":{
[junit4] 1> "range":"12490000-36daffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node8":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_"},
[junit4] 1> "core_node10":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_",
[junit4] 1> "leader":"true"},
[junit4] 1> "core_node17":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard5_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_"}}},
[junit4] 1> "shard6":{
[junit4] 1> "range":"36db0000-5b6cffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node4":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:34814",
[junit4] 1> "node_name":"127.0.0.1:34814_"},
[junit4] 1> "core_node16":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"},
[junit4] 1> "core_node19":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard6_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:56400",
[junit4] 1> "node_name":"127.0.0.1:56400_",
[junit4] 1> "leader":"true"}}},
[junit4] 1> "shard7":{
[junit4] 1> "range":"5b6d0000-7fffffff",
[junit4] 1> "state":"active",
[junit4] 1> "replicas":{
[junit4] 1> "core_node2":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica3",
[junit4] 1> "base_url":"http://127.0.0.1:37384",
[junit4] 1> "node_name":"127.0.0.1:37384_"},
[junit4] 1> "core_node13":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica1",
[junit4] 1> "base_url":"http://127.0.0.1:52653",
[junit4] 1> "node_name":"127.0.0.1:52653_"},
[junit4] 1> "core_node21":{
[junit4] 1> "state":"active",
[junit4] 1> "core":"collection2_shard7_replica2",
[junit4] 1> "base_url":"http://127.0.0.1:50927",
[junit4] 1> "node_name":"127.0.0.1:50927_",
[junit4] 1> "leader":"true"}}}}}}
[junit4] 1> /solr/overseer (6)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4] 1> /solr/overseer/collection-map-completed (0)
[junit4] 1> /solr/overseer/queue-work (0)
[junit4] 1> /solr/overseer/queue (0)
[junit4] 1> /solr/overseer/collection-map-failure (0)
[junit4] 1> /solr/overseer/collection-map-running (0)
[junit4] 1> /solr/configs (1)
[junit4] 1> /solr/configs/conf1 (11)
[junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/solrconfig.snippet.randomindexconfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4] 1> DATA:
[junit4] 1> {
[junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4] 1> "timestamp": 1332070464,
[junit4] 1>
[junit4] 1>
[junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4] 1>
[junit4] 1>
[junit4] 1> "base": "USD",
[junit4] 1> "rates": {
[junit4] 1> "USD": 1,
[junit4] 1> "JPY": 81.29,
[junit4] 1> "EUR": 2.5,
[junit4] 1> "GBP": 0.5,
[junit4] 1> "MXN": 2.0
[junit4] 1> }
[junit4] 1> }
[junit4] 1>
[junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/enumsConfig.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4] 1> DATA: ...supressed...
[junit4] 1> /solr/aliases.json (0)
[junit4] 1> /solr/live_nodes (5)
[junit4] 1> /solr/live_nodes/127.0.0.1:37384_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:56400_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:52653_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:34814_ (0)
[junit4] 1> /solr/live_nodes/127.0.0.1:50927_ (0)
[junit4] 1> /zookeeper (1)
[junit4] 1> DATA:
[junit4] 1>
[junit4] 1>
[junit4] 2> ######controlDocList: SolrDocumentList[sz=100000 numFound=103384]=[SolrDocument{id=thread0_0_174}, SolrDocument{id=thread3_0_8}, SolrDocument{id=thread1_0_260}, SolrDocument{id=thread0_0_177}, SolrDocument{id=thread3_0_13}] , [...] , [SolrDocument{id=thread0_9_463}, SolrDocument{id=thread0_9_464}, SolrDocument{id=thread0_9_465}, SolrDocument{id=thread0_9_466}, SolrDocument{id=thread0_9_467}]
[junit4] 2> ######cloudDocList: SolrDocumentList[sz=100000 numFound=103384]=[SolrDocument{id=thread1_0_0}, SolrDocument{id=thread1_0_2}, SolrDocument{id=thread1_0_6}, SolrDocument{id=thread1_0_8}, SolrDocument{id=thread1_0_26}] , [...] , [SolrDocument{id=thread2_8_30}, SolrDocument{id=thread2_8_36}, SolrDocument{id=thread2_8_48}, SolrDocument{id=thread2_8_52}, SolrDocument{id=thread2_8_55}]
[junit4] 2> ###### sizes=100000,100000
[junit4] 2> ###### Only in controlDocList: [{id=thread2_8_2272}, {id=thread3_7_631}, {id=thread3_7_635}, {id=thread3_7_636}, {id=thread3_7_639}, {id=thread3_7_620}, {id=thread2_8_2258}, {id=thread3_7_628}, {id=thread2_8_2252}, {id=thread3_7_652}, {id=thread3_7_640}, {id=thread3_7_642}, {id=thread2_8_2236}, {id=thread3_7_644}, {id=thread3_7_647}, {id=thread2_8_2298}, {id=thread2_8_2283}, {id=thread2_8_2285}, {id=thread3_7_607}, {id=thread3_7_676}, {id=thread2_8_2231}, {id=thread2_8_2219}, {id=thread2_8_2221}, {id=thread2_8_2202}, {id=thread2_8_2206}, {id=thread2_8_2212}, {id=thread2_8_2201}, {id=thread2_8_2200}, {id=thread3_7_779}, {id=thread2_8_2129}, {id=thread2_8_2122}, {id=thread2_8_2119}, {id=thread2_8_2118}, {id=thread3_7_767}, {id=thread3_7_760}, {id=thread2_8_2151}, {id=thread2_8_2141}, {id=thread3_7_744}, {id=thread3_7_747}, {id=thread2_8_2136}, {id=thread3_7_742}, {id=thread3_7_729}, {id=thread2_8_2171}, {id=thread2_8_2169}, {id=thread3_7_734}, {id=thread2_8_2164}, {id=thread3_7_725}, {id=thread3_7_724}, {id=thread2_8_2196}, {id=thread2_8_2182}, {id=thread3_7_791}, {id=thread3_7_798}, {id=thread3_7_782}, {id=thread3_7_787}, {id=thread2_8_2084}, {id=thread2_8_2094}, {id=thread2_8_2072}, {id=thread2_8_2048}, {id=thread2_8_2051}, {id=thread2_8_2056}, {id=thread2_8_2039}, {id=thread2_8_2040}, {id=thread2_8_2043}, {id=thread2_8_2044}, {id=thread2_8_2047}, {id=thread2_8_2006}, {id=thread2_8_2008}, {id=thread2_8_2001}, {id=thread1_12_394}, {id=thread1_12_380}, {id=thread1_12_376}, {id=thread1_12_369}, {id=thread1_12_356}, {id=thread1_12_351}, {id=thread1_12_341}, {id=thread1_12_344}, {id=thread1_12_321}, {id=thread1_12_324}, {id=thread1_12_323}, {id=thread3_7_276}, {id=thread3_7_261}, {id=thread3_7_293}, {id=thread3_7_291}, {id=thread1_12_309}, {id=thread1_12_302}, {id=thread3_7_295}, {id=thread3_7_283}, {id=thread3_7_250}, {id=thread3_7_208}, {id=thread3_7_203}, {id=thread3_7_215}, {id=thread1_13_893}, {id=thread1_13_864}, {id=thread1_13_858}, {id=thread1_12_498}, {id=thread1_12_450}, {id=thread1_12_482}, {id=thread1_12_426}, {id=thread1_12_421}, {id=thread1_12_420}, {id=thread1_12_422}, {id=thread1_12_413}, {id=thread1_12_419}, {id=thread3_7_390}, {id=thread3_7_397}, {id=thread1_12_442}, {id=thread1_12_445}, {id=thread1_12_444}, {id=thread1_12_440}, {id=thread1_12_437}, {id=thread3_7_381}, {id=thread3_7_360}, {id=thread3_7_379}, {id=thread3_7_348}, {id=thread3_7_342}, {id=thread1_13_728}, {id=thread3_7_359}, {id=thread3_7_354}, {id=thread3_7_357}, {id=thread1_12_404}, {id=thread1_12_402}, {id=thread1_12_408}, {id=thread3_7_320}, {id=thread3_7_333}, {id=thread3_7_335}, {id=thread3_7_336}, {id=thread3_7_337}, {id=thread3_7_339}, {id=thread3_7_300}, {id=thread1_13_749}, {id=thread1_13_765}, {id=thread1_13_763}, {id=thread1_12_135}, {id=thread1_12_180}, {id=thread1_12_185}, {id=thread1_12_186}, {id=thread1_12_104}, {id=thread3_7_430}, {id=thread3_7_455}, {id=thread3_7_461}, {id=thread3_7_475}, {id=thread3_7_479}, {id=thread3_7_481}, {id=thread3_7_495}, {id=thread3_7_406}, {id=thread1_12_262}, {id=thread1_12_277}, {id=thread1_12_295}, {id=thread1_12_213}, {id=thread1_12_219}, {id=thread1_12_244}, {id=thread1_12_246}, {id=thread1_12_234}, {id=thread1_13_900}, {id=thread3_7_560}, {id=thread3_7_579}, {id=thread3_7_545}, {id=thread1_13_912}, {id=thread3_7_552}, {id=thread3_7_553}, {id=thread3_7_583}, {id=thread3_7_588}, {id=thread3_7_590}, {id=thread3_7_592}, {id=thread3_7_597}, {id=thread3_7_529}, {id=thread3_7_520}, {id=thread3_7_539}, {id=thread3_7_530}, {id=thread3_7_519}, {id=thread3_7_510}, {id=thread1_13_439}, {id=thread1_13_435}, {id=thread1_13_440}, {id=thread1_13_476}, {id=thread1_13_474}, {id=thread1_13_316}, {id=thread1_13_315}, {id=thread1_13_327}, {id=thread1_13_355}, {id=thread1_13_357}, {id=thread1_13_341}, {id=thread1_13_346}, {id=thread1_13_338}, {id=thread1_13_335}, {id=thread1_13_627}, {id=thread1_13_629}, {id=thread1_13_631}, {id=thread1_13_630}, {id=thread1_13_648}, {id=thread1_13_663}, {id=thread1_13_682}, {id=thread0_10_2014}, {id=thread0_10_2002}, {id=thread0_10_2005}, {id=thread0_10_2007}, {id=thread1_13_603}, {id=thread0_10_2022}, {id=thread0_10_2021}, {id=thread1_13_502}, {id=thread1_13_565}, {id=thread1_13_563}, {id=thread1_13_561}, {id=thread1_13_532}, {id=thread1_13_542}, {id=thread1_13_540}, {id=thread3_7_117}, {id=thread3_7_138}, {id=thread3_7_135}, {id=thread3_7_130}, {id=thread3_7_131}, {id=thread3_7_120}, {id=thread3_7_148}, {id=thread3_7_141}, {id=thread3_7_159}, {id=thread3_7_158}, {id=thread3_7_162}, {id=thread3_7_176}, {id=thread3_7_171}, {id=thread3_7_173}, {id=thread3_7_186}, {id=thread3_7_180}, {id=thread3_7_196}, {id=thread3_7_199}, {id=thread3_7_194}, {id=thread1_13_594}, {id=thread1_13_593}, {id=thread1_13_592}, {id=thread1_13_578}, {id=thread0_8_1843}, {id=thread0_8_1844}, {id=thread0_8_1876}, {id=thread0_8_1815}, {id=thread0_8_1811}, {id=thread0_8_1803}, {id=thread0_8_1807}, {id=thread0_8_1823}, {id=thread0_8_1825}, {id=thread0_8_1890}, {id=thread0_8_1891}, {id=thread0_8_1750}, {id=thread0_8_1748}, {id=thread0_8_1742}, {id=thread0_8_1737}, {id=thread0_8_1733}, {id=thread0_8_1718}, {id=thread0_8_1716}, {id=thread0_8_1700}, {id=thread0_8_1708}, {id=thread0_8_1785}, {id=thread0_8_1783}, {id=thread0_8_1786}, {id=thread1_13_214}, {id=thread1_13_226}, {id=thread1_13_235}, {id=thread1_13_254}, {id=thread1_13_250}, {id=thread1_13_274}, {id=thread1_13_279}, {id=thread1_13_278}, {id=thread1_13_276}, {id=thread3_10_2020}, {id=thread1_13_292}, {id=thread1_13_299}, {id=thread0_8_1957}, {id=thread0_8_1955}, {id=thread0_8_1996}, {id=thread0_8_1993}, {id=thread0_8_1994}, {id=thread0_8_1987}, {id=thread0_8_1980}, {id=thread0_8_1981}, {id=thread0_8_1979}, {id=thread0_8_1977}, {id=thread0_8_1970}, {id=thread0_8_1968}, {id=thread0_8_1903}, {id=thread1_13_157}, {id=thread1_13_167}, {id=thread1_13_143}, {id=thread1_13_176}, {id=thread1_13_186}, {id=thread1_13_187}, {id=thread1_13_182}, {id=thread0_8_2623}, {id=thread0_8_2627}, {id=thread0_8_2614}, {id=thread0_8_2617}, {id=thread0_8_2619}, {id=thread0_8_2644}, {id=thread0_8_2643}, {id=thread0_8_2649}, {id=thread0_8_2636}, {id=thread0_8_2637}, {id=thread0_8_2639}, {id=thread0_8_2669}, {id=thread0_8_2691}, {id=thread0_8_2690}, {id=thread0_8_2677}, {id=thread0_8_2674}, {id=thread0_8_2673}, {id=thread0_8_2681}, {id=thread0_8_2699}, {id=thread0_8_2607}, {id=thread0_8_2601}, {id=thread0_8_2765}, {id=thread0_8_2770}, {id=thread0_8_2750}, {id=thread0_8_2760}, {id=thread0_8_2730}, {id=thread0_8_2731}, {id=thread0_8_2733}, {id=thread0_8_2772}, {id=thread0_8_2714}, {id=thread0_8_2725}, {id=thread0_8_2702}, {id=thread0_8_2867}, {id=thread0_8_2868}, {id=thread0_8_2850}, {id=thread0_8_2851}, {id=thread0_8_2892}, {id=thread0_8_2884}, {id=thread0_8_2882}, {id=thread0_8_2871}, {id=thread0_8_2873}, {id=thread0_8_2874}, {id=thread0_8_2817}, {id=thread0_8_2815}, {id=thread0_8_2813}, {id=thread0_8_2848}, {id=thread2_11_26}, {id=thread2_11_27}, {id=thread2_11_10}, {id=thread2_11_16}, {id=thread2_11_44}, {id=thread2_11_31}, {id=thread2_11_37}, {id=thread2_11_39}, {id=thread2_11_62}, {id=thread2_11_55}, {id=thread2_11_57}, {id=thread2_11_50}, {id=thread0_8_2981}, {id=thread0_8_2987}, {id=thread2_11_86}, {id=thread0_8_2988}, {id=thread2_11_85}, {id=thread0_8_2980}, {id=thread2_11_78}, {id=thread0_8_2972}, {id=thread2_11_76}, {id=thread2_11_93}, {id=thread2_11_94}, {id=thread0_8_2931}, {id=thread0_8_2944}, {id=thread0_8_2943}, {id=thread0_8_2912}, {id=thread0_8_2918}, {id=thread0_8_2916}, {id=thread0_8_2921}, {id=thread0_8_2922}, {id=thread0_8_2903}, {id=thread0_8_2221}, {id=thread0_8_2211}, {id=thread0_8_2231}, {id=thread0_8_2227}, {id=thread0_8_2235}, {id=thread0_8_2275}, {id=thread0_8_2269}, {id=thread0_8_2280}, {id=thread0_8_2297}, {id=thread0_9_
[...truncated too long message...]
tCase.java:621)
[junit4] 2>
[junit4] 2> 2725727 T18704 oas.SolrTestCaseJ4.tearDown ###Ending test
[junit4] 2> 2725736 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@4b20166a{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725746 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@710f8cd1{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725764 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@7383b8f6{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725776 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@45f21856{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725792 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@5fc707f8{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725807 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@5dd38269{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725816 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@196e319a{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725827 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@ee57258{/av_/oc,null,UNAVAILABLE}
[junit4] 2> 2725829 T18704 oejs.AbstractConnector.doStop Stopped ServerConnector@75da046b{HTTP/1.1}{127.0.0.1:0}
[junit4] 2> 2725842 T18704 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@3ba359f{/av_/oc,null,UNAVAILABLE}
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedFacetPivotSmallTest -Dtests.method=test -Dtests.seed=B855A1C7B309F547 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=iw -Dtests.timezone=US/Alaska -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 5.60s J2 | DistributedFacetPivotSmallTest.test <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=18832, name=Thread-10866, state=RUNNABLE, group=TGRP-DistributedFacetPivotSmallTest]
[junit4] > at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547:30019E1D1DF598BF]:0)
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:35094/av_/oc/collection1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:37832/av_/oc/collection1, http://[ff01::114]:33332/av_/oc, http://[ff01::083]:33332/av_/oc, http://[ff01::213]:33332/av_/oc]
[junit4] > at __randomizedtesting.SeedInfo.seed([B855A1C7B309F547]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
[junit4] > at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
[junit4] > at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$5.run(BaseDistributedSearchTestCase.java:621)
[junit4] 2> 2725850 T18704 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), multiDefault=PostingsFormat(name=LuceneFixedGap), solo_s=PostingsFormat(name=Direct), company_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), place_t=PostingsFormat(name=LuceneFixedGap), id=FSTOrd50, range_facet_i_dv=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), range_facet_l_dv=FSTOrd50, text=PostingsFormat(name=Direct), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), price_ti=PostingsFormat(name=Direct), solo_i=FSTOrd50, solo_dt=PostingsFormat(name=LuceneFixedGap), _version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{timestamp=DocValuesFormat(name=Lucene50), range_facet_i_dv=DocValuesFormat(name=Lucene50), range_facet_l_dv=DocValuesFormat(name=Memory)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=iw, timezone=US/Alaska
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=216630088,total=517996544
[junit4] 2> NOTE: All tests run in this JVM: [OpenExchangeRatesOrgProviderTest, TermVectorComponentDistributedTest, HttpPartitionTest, AddBlockUpdateTest, DocValuesTest, MultiThreadedOCPTest, CollectionsAPIAsyncDistributedZkTest, TestNonDefinedSimilarityFactory, InfoHandlerTest, TestRecoveryHdfs, ZkStateWriterTest, DistributedFacetPivotLongTailTest, MoreLikeThisHandlerTest, RegexBoostProcessorTest, SoftAutoCommitTest, TestTrie, HardAutoCommitTest, TestCSVResponseWriter, NumericFieldsTest, DOMUtilTest, QueryEqualityTest, QueryParsingTest, TestStandardQParsers, TestCloudPivotFacet, SimpleFacetsTest, TestNRTOpen, TestReRankQParserPlugin, CircularListTest, SampleTest, SynonymTokenizerTest, SOLR749Test, LoggingHandlerTest, TestDistributedStatsComponentCardinality, BasicDistributedZk2Test, AutoCommitTest, TestCloudInspectUtil, DistributedFacetPivotSmallAdvancedTest, CustomCollectionTest, TestReplicationHandlerBackup, TestFieldTypeResource, TestExtendedDismaxParser, DateRangeFieldTest, TestInfoStreamLogging, RemoteQueryErrorTest, DirectUpdateHandlerTest, TestQueryUtils, SuggesterTest, PolyFieldTest, TestSimpleQParserPlugin, TestClusterStateMutator, TestConfigOverlay, ActionThrottleTest, TestJettySolrRunner, TestFieldSortValues, BadIndexSchemaTest, TestBlobHandler, DistributedQueryElevationComponentTest, TestGroupingSearch, TestDefaultSimilarityFactory, TestSchemaSimilarityResource, RankQueryTest, TestFastOutputStream, DistribDocExpirationUpdateProcessorTest, TestBulkSchemaAPI, PluginInfoTest, ConcurrentDeleteAndCreateCollectionTest, XmlUpdateRequestHandlerTest, TestSurroundQueryParser, TestStressRecovery, SearchHandlerTest, ShardSplitTest, TestPartialUpdateDeduplication, QueryResultKeyTest, TestHighlightDedupGrouping, SaslZkACLProviderTest, SpellCheckCollatorTest, TestTrackingShardHandlerFactory, TestCollationField, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestRecovery, TestStressReorder, TestRangeQuery, TestCoreContainer, TestSolr4Spatial, StatsComponentTest, TestIndexSearcher, CurrencyFieldXmlFileTest, AnalysisAfterCoreReloadTest, SuggesterFSTTest, TestStressLucene, SolrCoreCheckLockOnStartupTest, TestUpdate, TestAtomicUpdateErrorCases, SortByFunctionTest, SolrInfoMBeanTest, CacheHeaderTest, StandardRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, RequestHandlersTest, PathHierarchyTokenizerFactoryTest, TestSolrQueryParser, IndexSchemaTest, JsonLoaderTest, TestPHPSerializedResponseWriter, TestComponentsName, TestLFUCache, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, AsyncMigrateRouteKeyTest, DeleteInactiveReplicaTest, DistribJoinFromCollectionTest, ExternalCollectionsTest, LeaderFailoverAfterPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, SSLMigrationTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestCollectionAPI, TestCryptoKeys, TestRequestStatusCollectionAPI, TriLevelCompositeIdRoutingTest, RequestLoggingTest, TestRestoreCore, CoreAdminRequestStatusTest, CoreMergeIndexesAdminHandlerTest, DistributedFacetPivotSmallTest]
[junit4] Completed [433/496] on J2 in 6.18s, 1 test, 1 error <<< FAILURES!
[...truncated 199 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1973 tests, 2 errors, 51 ignored (10 assumptions)
Total time: 151 minutes 35 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 854028375 bytes
Compression is 0.0%
Took 2 min 12 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 856 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/856/
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test
Error Message:
KeeperErrorCode = Session expired for /live_nodes
Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:328)
at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:325)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:325)
at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:531)
at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:269)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testNoCollectionSpecified(CollectionsAPIDistributedZkTest.java:488)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:189)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 21097 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/init-core-data-001
[junit4] 2> 986606 T5103 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 986606 T5103 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_zyp/zb
[junit4] 2> 986610 T5103 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 986611 T5104 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 986611 T5104 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 986711 T5103 oasc.ZkTestServer.run start zk server on port:50482
[junit4] 2> 986711 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 986735 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 986739 T5111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e4d52c0 name:ZooKeeperConnection Watcher:127.0.0.1:50482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 986740 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 986740 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 986740 T5103 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 986750 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 986753 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 986754 T5114 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2da99e69 name:ZooKeeperConnection Watcher:127.0.0.1:50482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 986756 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 986756 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 986756 T5103 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 986759 T5103 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 986761 T5103 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 986764 T5103 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 986765 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 986766 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 986782 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 986783 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 986789 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 986790 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 986796 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 986796 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 986798 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 986799 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 986811 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 986812 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 986818 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 986818 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 986821 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 986822 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 986824 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 986825 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 986827 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 986827 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 986829 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 986830 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 986835 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 986860 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 986861 T5117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8587c6a name:ZooKeeperConnection Watcher:127.0.0.1:50482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 986862 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 986862 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 986862 T5103 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 986876 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 986886 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 986900 T5120 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@358e6076 name:ZooKeeperConnection Watcher:127.0.0.1:50482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 986900 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 986900 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 986901 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf2/solrconfig.xml
[junit4] 2> 986901 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
[junit4] 2> 986905 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf2/schema.xml
[junit4] 2> 986905 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
[junit4] 2> 986917 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf2/enumsConfig.xml
[junit4] 2> 986917 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/enumsConfig.xml
[junit4] 2> 986919 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 986919 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 986921 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf2/stopwords.txt
[junit4] 2> 986921 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
[junit4] 2> 986923 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf2/protwords.txt
[junit4] 2> 986923 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
[junit4] 2> 986925 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf2/currency.xml
[junit4] 2> 986925 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
[junit4] 2> 986927 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
[junit4] 2> 986927 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
[junit4] 2> 986929 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 986930 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
[junit4] 2> 986944 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf2/old_synonyms.txt
[junit4] 2> 986944 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
[junit4] 2> 986950 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf2/synonyms.txt
[junit4] 2> 986951 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
[junit4] 2> 986954 T5103 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/elevate.xml to /configs/conf2/elevate.xml
[junit4] 2> 986955 T5103 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
[junit4] 2> 987424 T5103 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1
[junit4] 2> 987426 T5103 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 987440 T5103 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4c1a9790{/_zyp/zb,null,AVAILABLE}
[junit4] 2> 987440 T5103 oejs.AbstractConnector.doStart Started ServerConnector@67c20102{HTTP/1.1}{127.0.0.1:40617}
[junit4] 2> 987441 T5103 oejs.Server.doStart Started @988988ms
[junit4] 2> 987441 T5103 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=40617, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores, hostContext=/_zyp/zb}
[junit4] 2> 987441 T5103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@72b5615d
[junit4] 2> 987442 T5103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/'
[junit4] 2> 987457 T5103 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/solr.xml
[junit4] 2> 987471 T5103 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores
[junit4] 2> 987471 T5103 oasc.CoreContainer.<init> New CoreContainer 478073741
[junit4] 2> 987471 T5103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/]
[junit4] 2> 987472 T5103 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/lib
[junit4] 2> 987472 T5103 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/lib).
[junit4] 2> 987480 T5103 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 987481 T5103 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 987482 T5103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 987482 T5103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 987482 T5103 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 987482 T5103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50482/solr
[junit4] 2> 987483 T5103 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 987483 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 987504 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 987515 T5134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75470ca6 name:ZooKeeperConnection Watcher:127.0.0.1:50482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 987523 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 987524 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 987543 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 987559 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b796319 name:ZooKeeperConnection Watcher:127.0.0.1:50482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 987559 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 987561 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 987563 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 987571 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 987573 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 987575 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 987576 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 987578 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 987579 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 987580 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40617__zyp%2Fzb
[junit4] 2> 987580 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40617__zyp%2Fzb
[junit4] 2> 987582 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 987583 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 987584 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 987585 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:40617__zyp%2Fzb
[junit4] 2> 987586 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 987587 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer.start Overseer (id=93874491909865477-127.0.0.1:40617__zyp%2Fzb-n_0000000000) starting
[junit4] 2> 987589 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 987595 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 987599 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 987603 T5139 n:127.0.0.1:40617__zyp%2Fzb oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 987610 T5103 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 987613 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 987614 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 987615 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores
[junit4] 2> 987616 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {schema=schema.xml, name=collection1, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/, transient=false, shard=, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1, loadOnStartup=true, coreNodeName=, dataDir=data/, collection=control_collection, config=solrconfig.xml}
[junit4] 2> 987616 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/
[junit4] 2> 987616 T5103 n:127.0.0.1:40617__zyp%2Fzb oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 987619 T5141 n:127.0.0.1:40617__zyp%2Fzb c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 987620 T5141 n:127.0.0.1:40617__zyp%2Fzb c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 987622 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 987623 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 987623 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:40617__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:40617/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection"} current state version: 0
[junit4] 2> 987624 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "node_name":"127.0.0.1:40617__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"1",
[junit4] 2> "base_url":"http://127.0.0.1:40617/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection"}
[junit4] 2> 987624 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 987624 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 987625 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 988623 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 988624 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 988624 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 988624 T5141 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 988625 T5141 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 988626 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/'
[junit4] 2> 988648 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 988658 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 988726 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 988767 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 988770 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 988780 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 989085 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 989095 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 989098 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 989113 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 989117 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 989121 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 989122 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 989123 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 989123 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 989124 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 989124 T5141 n:127.0.0.1:40617__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 989125 T5141 n:127.0.0.1:40617__zyp%2Fzb oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 989125 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 989125 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/], dataDir=[null]
[junit4] 2> 989126 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@380f5e67
[junit4] 2> 989126 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/data
[junit4] 2> 989127 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/data/index/
[junit4] 2> 989127 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 989128 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/control-001/cores/collection1/data/index
[junit4] 2> 989129 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=69.1884765625, floorSegmentMB=0.7529296875, forceMergeDeletesPctAllowed=20.8555299810156, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 989131 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e9bba8),segFN=segments_1,generation=1}
[junit4] 2> 989132 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 989139 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 989139 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 989140 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 989140 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 989140 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 989140 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 989141 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 989141 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 989141 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 989147 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 989149 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 989150 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 989151 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 989157 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /get,/admin/threads,/update/json/docs,/update/csv,/update/json,/admin/segments,/admin/ping,/admin/logging,/admin/luke,/update,/admin/system,/config,/replication,standard,/admin/properties,/admin/file,/admin/mbeans,/schema,/admin/plugins
[junit4] 2> 989164 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 989165 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 989166 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 989168 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 989168 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 989169 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@67b3b588
[junit4] 2> 989170 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e9bba8),segFN=segments_1,generation=1}
[junit4] 2> 989171 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 989171 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@ff1a2c2[collection1] main
[junit4] 2> 989171 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 989171 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 989171 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 989172 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501991873242202112
[junit4] 2> 989174 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1501991873242202112
[junit4] 2> 989174 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 989175 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 989175 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 989175 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 989176 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 989176 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 989176 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 989177 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 989177 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 989177 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 989178 T5142 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ff1a2c2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 989178 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 989180 T5141 n:127.0.0.1:40617__zyp%2Fzb x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 989193 T5103 n:127.0.0.1:40617__zyp%2Fzb oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 989193 T5103 n:127.0.0.1:40617__zyp%2Fzb oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 989195 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 989196 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40617/_zyp/zb collection:control_collection shard:shard1
[junit4] 2> 989196 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 989203 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 989205 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 989206 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 989206 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1063 name=collection1 org.apache.solr.core.SolrCore@1928e4cc url=http://127.0.0.1:40617/_zyp/zb/collection1 node=127.0.0.1:40617__zyp%2Fzb C1063_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:40617__zyp%2Fzb, core=collection1, base_url=http://127.0.0.1:40617/_zyp/zb, state=down}
[junit4] 2> 989206 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 C1063 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40617/_zyp/zb/collection1/
[junit4] 2> 989206 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 C1063 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 989207 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 C1063 oasc.SyncStrategy.syncToMe http://127.0.0.1:40617/_zyp/zb/collection1/ has no replicas
[junit4] 2> 989207 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40617/_zyp/zb/collection1/ shard1
[junit4] 2> 989207 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 989207 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 989207 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 989210 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989213 T5148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e23c431 name:ZooKeeperConnection Watcher:127.0.0.1:50482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 989213 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 989214 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 989214 T5103 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 989215 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 989215 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"http://127.0.0.1:40617/_zyp/zb",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 2
[junit4] 2> 989217 T5103 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 989328 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989335 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989366 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:40617/_zyp/zb/collection1/ and leader is http://127.0.0.1:40617/_zyp/zb/collection1/
[junit4] 2> 989367 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40617/_zyp/zb
[junit4] 2> 989367 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 989367 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 989367 T5145 n:127.0.0.1:40617__zyp%2Fzb c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 989368 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 989369 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:40617__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:40617/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection"} current state version: 3
[junit4] 2> 989370 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:40617__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:40617/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"control_collection"}
[junit4] 2> 989474 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989474 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989705 T5103 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1
[junit4] 2> 989708 T5103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001
[junit4] 2> 989709 T5103 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 989714 T5103 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@295ba458{/_zyp/zb,null,AVAILABLE}
[junit4] 2> 989714 T5103 oejs.AbstractConnector.doStart Started ServerConnector@3f82a29e{HTTP/1.1}{127.0.0.1:51195}
[junit4] 2> 989714 T5103 oejs.Server.doStart Started @991261ms
[junit4] 2> 989715 T5103 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=51195, solrconfig=solrconfig.xml, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores, hostContext=/_zyp/zb}
[junit4] 2> 989715 T5103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@72b5615d
[junit4] 2> 989715 T5103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/'
[junit4] 2> 989732 T5103 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/solr.xml
[junit4] 2> 989758 T5103 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores
[junit4] 2> 989759 T5103 oasc.CoreContainer.<init> New CoreContainer 1801149921
[junit4] 2> 989759 T5103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/]
[junit4] 2> 989760 T5103 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/lib
[junit4] 2> 989760 T5103 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/lib).
[junit4] 2> 989777 T5103 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
[junit4] 2> 989778 T5103 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 989779 T5103 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 989780 T5103 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 989781 T5103 oasc.CoreContainer.load Node Name: 127.0.0.1
[junit4] 2> 989781 T5103 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50482/solr
[junit4] 2> 989781 T5103 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 989781 T5103 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 989792 T5103 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 989808 T5162 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66104bc3 name:ZooKeeperConnection Watcher:127.0.0.1:50482 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 989808 T5103 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 989809 T5103 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 989811 T5103 n:127.0.0.1:51195__zyp%2Fzb oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 989821 T5165 n:127.0.0.1:51195__zyp%2Fzb oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@390311ea name:ZooKeeperConnection Watcher:127.0.0.1:50482/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 989822 T5103 n:127.0.0.1:51195__zyp%2Fzb oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 989836 T5103 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 990839 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51195__zyp%2Fzb
[junit4] 2> 990840 T5103 n:127.0.0.1:51195__zyp%2Fzb oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51195__zyp%2Fzb
[junit4] 2> 990846 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 990848 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
[junit4] 2> 990849 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
[junit4] 2> 990850 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores
[junit4] 2> 990851 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, collection=collection1, config=solrconfig.xml, schema=schema.xml, coreNodeName=, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/, shard=, name=collection1, transient=false, loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1}
[junit4] 2> 990851 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/
[junit4] 2> 990851 T5103 n:127.0.0.1:51195__zyp%2Fzb oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 990864 T5166 n:127.0.0.1:51195__zyp%2Fzb c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 990864 T5166 n:127.0.0.1:51195__zyp%2Fzb c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 990865 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 990865 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 990866 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:51195__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:51195/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 990867 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:51195__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:51195/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1"}
[junit4] 2> 990867 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 990867 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 990970 T5165 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 990971 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 990970 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 991865 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 991866 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 991867 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 991867 T5166 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 991868 T5166 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 991868 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/'
[junit4] 2> 991893 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 991899 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 991936 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.3.0
[junit4] 2> 991975 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 991985 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 991992 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 992426 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 992442 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 992448 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 992474 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 992478 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 992489 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 992492 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 992492 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 992492 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 992493 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 992493 T5166 n:127.0.0.1:51195__zyp%2Fzb oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 992493 T5166 n:127.0.0.1:51195__zyp%2Fzb oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 992494 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 992494 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/], dataDir=[null]
[junit4] 2> 992494 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@380f5e67
[junit4] 2> 992495 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/data
[junit4] 2> 992500 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/data/index/
[junit4] 2> 992500 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 992501 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-1-001/cores/collection1/data/index
[junit4] 2> 992501 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=69.1884765625, floorSegmentMB=0.7529296875, forceMergeDeletesPctAllowed=20.8555299810156, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 992503 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e9bba8),segFN=segments_1,generation=1}
[junit4] 2> 992504 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 992517 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 992517 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 992518 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 992518 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 992518 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 992518 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 992519 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 992519 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 992519 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 992526 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 992546 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 992547 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 992549 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 992554 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /get,/admin/threads,/update/json/docs,/update/csv,/update/json,/admin/segments,/admin/ping,/admin/logging,/admin/luke,/update,/admin/system,/config,/replication,standard,/admin/properties,/admin/file,/admin/mbeans,/schema,/admin/plugins
[junit4] 2> 992559 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 992561 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 992561 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 992562 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 992562 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 992568 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@31b84c9e
[junit4] 2> 992569 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@17e9bba8),segFN=segments_1,generation=1}
[junit4] 2> 992570 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 992570 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@5990a217[collection1] main
[junit4] 2> 992570 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
[junit4] 2> 992570 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
[junit4] 2> 992570 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.VersionInfo.getMaxVersionFromIndex WARN No terms found for _version_, cannot seed version bucket highest value from index
[junit4] 2> 992571 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion WARN Could not find max version in index or recent updates, using new clock 1501991876806311936
[junit4] 2> 992573 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1501991876806311936
[junit4] 2> 992573 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 992574 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 992574 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 992576 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 992576 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 992576 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 992577 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 992577 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 992577 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 992577 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 992580 T5167 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5990a217[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 992580 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
[junit4] 2> 992581 T5166 n:127.0.0.1:51195__zyp%2Fzb x:collection1 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 992590 T5103 n:127.0.0.1:51195__zyp%2Fzb oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
[junit4] 2> 992591 T5103 n:127.0.0.1:51195__zyp%2Fzb oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 992603 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51195/_zyp/zb collection:collection1 shard:shard2
[junit4] 2> 992605 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 992609 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 992610 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 992610 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 992611 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 5
[junit4] 2> 992612 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992612 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992615 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1064 name=collection1 org.apache.solr.core.SolrCore@5951ccf7 url=http://127.0.0.1:51195/_zyp/zb/collection1 node=127.0.0.1:51195__zyp%2Fzb C1064_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:51195__zyp%2Fzb, core=collection1, base_url=http://127.0.0.1:51195/_zyp/zb, state=down}
[junit4] 2> 992615 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 C1064 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51195/_zyp/zb/collection1/
[junit4] 2> 992615 T5165 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992616 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 C1064 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 992621 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 C1064 oasc.SyncStrategy.syncToMe http://127.0.0.1:51195/_zyp/zb/collection1/ has no replicas
[junit4] 2> 992621 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51195/_zyp/zb/collection1/ shard2
[junit4] 2> 992621 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 992628 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 992628 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"http://127.0.0.1:51195/_zyp/zb",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 6
[junit4] 2> 992731 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992731 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992731 T5165 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992780 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.register We are http://127.0.0.1:51195/_zyp/zb/collection1/ and leader is http://127.0.0.1:51195/_zyp/zb/collection1/
[junit4] 2> 992780 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51195/_zyp/zb
[junit4] 2> 992780 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 992780 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 992780 T5170 n:127.0.0.1:51195__zyp%2Fzb c:collection1 s:shard2 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 992782 T5137 n:127.0.0.1:40617__zyp%2Fzb oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 992783 T5138 n:127.0.0.1:40617__zyp%2Fzb oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "node_name":"127.0.0.1:51195__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:51195/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1"} current state version: 7
[junit4] 2> 992784 T5138 n:127.0.0.1:40617__zyp%2Fzb oasco.ReplicaMutator.updateState Update state numShards=2 message={
[junit4] 2> "node_name":"127.0.0.1:51195__zyp%2Fzb",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "numShards":"2",
[junit4] 2> "base_url":"http://127.0.0.1:51195/_zyp/zb",
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "collection":"collection1"}
[junit4] 2> 992886 T5148 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992887 T5165 n:127.0.0.1:51195__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992887 T5137 n:127.0.0.1:40617__zyp%2Fzb oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993459 T5103 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/cores/collection1
[junit4] 2> 993460 T5103 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001
[junit4] 2> 993471 T5103 oejs.Server.doStart jetty-9.2.10.v20150310
[junit4] 2> 993512 T5103 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@64d50046{/_zyp/zb,null,AVAILABLE}
[junit4] 2> 993512 T5103 oejs.AbstractConnector.doStart Started ServerConnector@5c052761{HTTP/1.1}{127.0.0.1:34150}
[junit4] 2> 993513 T5103 oejs.Server.doStart Started @995060ms
[junit4] 2> 993513 T5103 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/cores, solrconfig=solrconfig.xml, hostPort=34150, hostContext=/_zyp/zb}
[junit4] 2> 993513 T5103 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@72b5615d
[junit4] 2> 993514 T5103 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/'
[junit4] 2> 993541 T5103 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/solr.xml
[junit4] 2> 993559 T5103 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/cores
[junit4] 2> 993559 T5103 oasc.CoreContainer.<init> New CoreContainer 1207612430
[junit4] 2> 993560 T5103 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001/shard-2-001/]
[junit4] 2> 993560 T5103 oasc.
[...truncated too long message...]
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1621)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1642)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:877)Throwable #6: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5515, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:34150/_zyp/zb: collection already exists: awholynewstresscollection_collection5_0
[junit4] > at __randomizedtesting.SeedInfo.seed([6EF3FEF1907850D8]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1621)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1642)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:877)Throwable #7: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=5510, name=collection0, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
[junit4] > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:51195/_zyp/zb: Could not find collection : awholynewstresscollection_collection0_0
[junit4] > at __randomizedtesting.SeedInfo.seed([6EF3FEF1907850D8]:0)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
[junit4] > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:376)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:328)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:856)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:799)
[junit4] > at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
[junit4] > at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:884)
[junit4] 2> 1333093 T5103 c:control_collection s:shard1 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.CollectionsAPIDistributedZkTest 6EF3FEF1907850D8-001
[junit4] 2> 346492 T5102 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {a_i1=PostingsFormat(name=LuceneFixedGap), range_facet_l_dv=PostingsFormat(name=LuceneVarGapDocFreqInterval), intDefault=PostingsFormat(name=Memory doPackFST= true), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=PostingsFormat(name=Direct), timestamp=PostingsFormat(name=LuceneFixedGap), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), other_tl1=PostingsFormat(name=Memory doPackFST= true), _version_=PostingsFormat(name=Memory doPackFST= true), a_t=PostingsFormat(name=LuceneFixedGap), range_facet_l=PostingsFormat(name=LuceneFixedGap), multiDefault=PostingsFormat(name=LuceneFixedGap)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Asserting)}, sim=DefaultSimilarity, locale=de_LU, timezone=Asia/Riyadh88
[junit4] 2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=18252864,total=533725184
[junit4] 2> NOTE: All tests run in this JVM: [TestCSVLoader, TestJmxIntegration, DocValuesMissingTest, AliasIntegrationTest, QueryElevationComponentTest, IndexSchemaTest, PeerSyncTest, TestBinaryField, UpdateRequestProcessorFactoryTest, ConnectionManagerTest, TestExceedMaxTermLength, UniqFieldsUpdateProcessorFactoryTest, HdfsDirectoryTest, TestJoin, TestFileDictionaryLookup, BasicZkTest, SyncSliceTest, TermVectorComponentTest, IndexBasedSpellCheckerTest, SignatureUpdateProcessorFactoryTest, StandardRequestHandlerTest, DistribJoinFromCollectionTest, HighlighterConfigTest, MBeansHandlerTest, TestStressLucene, CloudExitableDirectoryReaderTest, DistributedFacetPivotLargeTest, AnalyticsQueryTest, TestRealTimeGet, TestManagedSchemaFieldTypeResource, TestFunctionQuery, TriLevelCompositeIdRoutingTest, TestJmxMonitoredMap, DistributedSuggestComponentTest, HdfsUnloadDistributedZkTest, TestRangeQuery, DistributedSpellCheckComponentTest, TestReversedWildcardFilterFactory, TestBadConfig, TestIndexingPerformance, URLClassifyProcessorTest, TestLazyCores, SuggesterFSTTest, TestReloadAndDeleteDocs, SimplePostToolTest, AssignTest, BufferStoreTest, TestRemoteStreaming, CSVRequestHandlerTest, HdfsWriteToMultipleCollectionsTest, ParsingFieldUpdateProcessorsTest, DistributedFacetPivotWhiteBoxTest, FastVectorHighlighterTest, HighlighterMaxOffsetTest, ChaosMonkeyNothingIsSafeTest, OverseerStatusTest, SchemaVersionSpecificBehaviorTest, CursorMarkTest, TimeZoneUtilsTest, TestSolr4Spatial, TestExpandComponent, TestDocumentBuilder, UUIDFieldTest, TestRandomMergePolicy, TestSolrDeletionPolicy1, TestMergePolicyConfig, PrimitiveFieldTypeTest, SolrRequestParserTest, TestSchemaManager, DefaultValueUpdateProcessorTest, SharedFSAutoReplicaFailoverTest, DistributedQueueTest, TestPivotHelperCode, ZkNodePropsTest, TestEmbeddedSolrServerConstructors, LeaderElectionIntegrationTest, BasicDistributedZkTest, SolrIndexConfigTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
[junit4] Completed [226/496] on J0 in 346.82s, 1 test, 1 error <<< FAILURES!
[...truncated 879 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:543: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:991: There were test failures: 496 suites, 1972 tests, 1 error, 51 ignored (10 assumptions)
Total time: 170 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-NightlyTests-5.x #852
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 620148433 bytes
Compression is 0.0%
Took 1 min 57 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure