You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/19 18:13:13 UTC
[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.7.0_21) - Build #
2908 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2908/
Java: 64bit/jdk1.7.0_21 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
4 tests failed.
REGRESSION: org.apache.solr.cloud.ShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:63236/brdt/df returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:63236/brdt/df returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([18805E6D89FB7A2D:9966D075FEA41A11]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.GeneratedMethodAccessor55.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 305 from http://127.0.0.1:59820/collection1lastClient and got 257 from http://127.0.0.1:59839/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 305 from http://127.0.0.1:59820/collection1lastClient and got 257 from http://127.0.0.1:59839/collection1
at __randomizedtesting.SeedInfo.seed([18805E6D89FB7A2D:9966D075FEA41A11]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1018)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:238)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
REGRESSION: org.apache.solr.spelling.suggest.SuggesterTest.testRebuild
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([18805E6D89FB7A2D:43A5FC2EBDFB00B7]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:527)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:494)
at org.apache.solr.spelling.suggest.SuggesterTest.testRebuild(SuggesterTest.java:105)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//lst[@name='spellcheck']/lst[@name='suggestions']/lst[@name='ac']/int[@name='numFound'][.='2']
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1</int></lst><lst name="spellcheck"><lst name="suggestions"/></lst>
</response>
request was:q=ac&spellcheck.count=2&qt=/suggest&spellcheck.onlyMorePopular=true
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:520)
... 42 more
FAILED: org.apache.solr.cloud.RecoveryZkTest.testDistribSearch
Error Message:
expected:<202> but was:<58>
Stack Trace:
java.lang.AssertionError: expected:<202> but was:<58>
at __randomizedtesting.SeedInfo.seed([18805E6D89FB7A2D:9966D075FEA41A11]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.RecoveryZkTest.doTest(RecoveryZkTest.java:108)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9231 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4:junit4] 2> 241721 T595 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 241731 T595 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-SyncSliceTest-1371655757476
[junit4:junit4] 2> 241735 T595 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 241737 T596 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 241842 T595 oasc.ZkTestServer.run start zk server on port:59801
[junit4:junit4] 2> 241845 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 241871 T602 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d426dd8 name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 241871 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 241871 T595 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 241891 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 241899 T604 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33073e36 name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 241900 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 241901 T595 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 241911 T595 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 241924 T595 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 241931 T595 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 241939 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 241941 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 241956 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 241958 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 241965 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 241967 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 241974 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 241974 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 241983 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 241984 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 241992 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 241994 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 242000 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242001 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 242008 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242009 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 242016 T595 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242017 T595 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 242515 T595 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 242523 T595 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59808
[junit4:junit4] 2> 242524 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 242524 T595 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 242525 T595 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770
[junit4:junit4] 2> 242525 T595 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\solr.xml
[junit4:junit4] 2> 242525 T595 oasc.CoreContainer.<init> New CoreContainer 1351199447
[junit4:junit4] 2> 242525 T595 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\'
[junit4:junit4] 2> 242526 T595 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\'
[junit4:junit4] 2> 242698 T595 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 242699 T595 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 242700 T595 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 242700 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 242701 T595 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 242702 T595 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 242702 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 242703 T595 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 242704 T595 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 242705 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 242721 T595 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 242721 T595 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59801/solr
[junit4:junit4] 2> 242722 T595 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 242726 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242745 T615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@251c6c74 name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242746 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242750 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 242762 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 242768 T617 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ebb607d name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 242769 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 242774 T595 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 242787 T595 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 242805 T595 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 242812 T595 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59808_
[junit4:junit4] 2> 242816 T595 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59808_
[junit4:junit4] 2> 242825 T595 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 242842 T595 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 242850 T595 oasc.Overseer.start Overseer (id=89892831722799107-127.0.0.1:59808_-n_0000000000) starting
[junit4:junit4] 2> 242862 T595 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 242874 T619 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 242876 T595 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 242883 T595 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 242887 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 242892 T618 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 242899 T620 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 242899 T620 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 244464 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 244466 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59808_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59808"}
[junit4:junit4] 2> 244466 T618 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 244467 T618 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 244478 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 244984 T620 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\collection1
[junit4:junit4] 2> 244984 T620 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 244986 T620 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 244986 T620 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 244988 T620 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\collection1\'
[junit4:junit4] 2> 244990 T620 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 244992 T620 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770/collection1/lib/README' to classloader
[junit4:junit4] 2> 245078 T620 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 245166 T620 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 245170 T620 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 245176 T620 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 246034 T620 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 246051 T620 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 246055 T620 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 246084 T620 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 246090 T620 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 246096 T620 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 246099 T620 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 246099 T620 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 246099 T620 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 246101 T620 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 246101 T620 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 246101 T620 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 246145 T620 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-controljetty-1371655757770\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/control/data\
[junit4:junit4] 2> 246145 T620 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c048ed9
[junit4:junit4] 2> 246146 T620 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 246147 T620 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data
[junit4:junit4] 2> 246149 T620 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/control/data\index/
[junit4:junit4] 2> 246150 T620 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 246150 T620 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index
[junit4:junit4] 2> 246163 T620 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 246163 T620 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 246168 T620 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 246168 T620 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 246169 T620 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 246169 T620 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 246170 T620 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 246170 T620 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 246170 T620 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 246171 T620 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 246171 T620 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 246181 T620 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 246195 T620 oass.SolrIndexSearcher.<init> Opening Searcher@41aff17b main
[junit4:junit4] 2> 246198 T620 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 246199 T620 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 246205 T621 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41aff17b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 246207 T620 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 246208 T620 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59808 collection:control_collection shard:shard1
[junit4:junit4] 2> 246209 T620 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 246232 T620 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 246239 T620 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 246239 T620 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 246239 T620 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59808/collection1/
[junit4:junit4] 2> 246240 T620 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 246240 T620 oasc.SyncStrategy.syncToMe http://127.0.0.1:59808/collection1/ has no replicas
[junit4:junit4] 2> 246240 T620 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59808/collection1/
[junit4:junit4] 2> 246242 T620 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 247612 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 247636 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 247686 T620 oasc.ZkController.register We are http://127.0.0.1:59808/collection1/ and leader is http://127.0.0.1:59808/collection1/
[junit4:junit4] 2> 247686 T620 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59808
[junit4:junit4] 2> 247686 T620 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 247687 T620 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 247687 T620 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 247691 T620 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 247693 T595 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 247693 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 247694 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 247707 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 247710 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 247715 T624 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29772c98 name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 247716 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 247719 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 247725 T595 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 248159 T595 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 248164 T595 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59820
[junit4:junit4] 2> 248166 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 248166 T595 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 248167 T595 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467
[junit4:junit4] 2> 248167 T595 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\solr.xml
[junit4:junit4] 2> 248168 T595 oasc.CoreContainer.<init> New CoreContainer 1873952919
[junit4:junit4] 2> 248168 T595 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\'
[junit4:junit4] 2> 248169 T595 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\'
[junit4:junit4] 2> 248297 T595 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 248298 T595 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 248298 T595 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 248298 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 248299 T595 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 248299 T595 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 248300 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 248300 T595 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 248301 T595 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 248301 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 248311 T595 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 248312 T595 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59801/solr
[junit4:junit4] 2> 248312 T595 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 248314 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 248332 T635 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d85c0f0 name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 248333 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248337 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 248338 T597 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5d0ddeb10005, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 248348 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 248353 T637 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d52b856 name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 248353 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 248364 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 249237 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 249238 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59808__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59808_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59808"}
[junit4:junit4] 2> 249249 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249249 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249249 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 249460 T595 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59820_
[junit4:junit4] 2> 249464 T595 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59820_
[junit4:junit4] 2> 249474 T617 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249474 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249475 T624 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249475 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249476 T637 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 249476 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 249488 T638 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 249489 T638 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 250979 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 250980 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59820_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59820"}
[junit4:junit4] 2> 250980 T618 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 1
[junit4:junit4] 2> 250980 T618 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 250994 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 250995 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 250995 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 251779 T638 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\collection1
[junit4:junit4] 2> 251779 T638 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 251782 T638 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 251782 T638 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 251784 T638 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\collection1\'
[junit4:junit4] 2> 251786 T638 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 251787 T638 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467/collection1/lib/README' to classloader
[junit4:junit4] 2> 251869 T638 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 251945 T638 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 251947 T638 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 251958 T638 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 252751 T638 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 252765 T638 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 252770 T638 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 252805 T638 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252814 T638 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 252822 T638 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252825 T638 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252827 T638 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252827 T638 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 252830 T638 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 252830 T638 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 252830 T638 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 252831 T638 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty1-1371655763467\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty1\
[junit4:junit4] 2> 252831 T638 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c048ed9
[junit4:junit4] 2> 252832 T638 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 252834 T638 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1
[junit4:junit4] 2> 252835 T638 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty1\index/
[junit4:junit4] 2> 252836 T638 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 252836 T638 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index
[junit4:junit4] 2> 252853 T638 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 252853 T638 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 252857 T638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 252859 T638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 252859 T638 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 252860 T638 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 252861 T638 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 252861 T638 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 252861 T638 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 252863 T638 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 252863 T638 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 252874 T638 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 252887 T638 oass.SolrIndexSearcher.<init> Opening Searcher@7e1c7163 main
[junit4:junit4] 2> 252890 T638 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 252890 T638 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 252898 T639 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7e1c7163 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 252900 T638 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 252900 T638 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59820 collection:collection1 shard:shard1
[junit4:junit4] 2> 252902 T638 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 252925 T638 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 252933 T638 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 252933 T638 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 252933 T638 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 252935 T638 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 252935 T638 oasc.SyncStrategy.syncToMe http://127.0.0.1:59820/collection1/ has no replicas
[junit4:junit4] 2> 252935 T638 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 252935 T638 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 254440 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 254463 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254464 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254463 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 254524 T638 oasc.ZkController.register We are http://127.0.0.1:59820/collection1/ and leader is http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 254524 T638 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59820
[junit4:junit4] 2> 254524 T638 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 254525 T638 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 254525 T638 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 254530 T638 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 254532 T595 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 254532 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 254532 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 255027 T595 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 255032 T595 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59829
[junit4:junit4] 2> 255036 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 255036 T595 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 255037 T595 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291
[junit4:junit4] 2> 255037 T595 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\solr.xml
[junit4:junit4] 2> 255038 T595 oasc.CoreContainer.<init> New CoreContainer 416174184
[junit4:junit4] 2> 255038 T595 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\'
[junit4:junit4] 2> 255039 T595 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\'
[junit4:junit4] 2> 255180 T595 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 255180 T595 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 255180 T595 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 255181 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 255181 T595 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 255181 T595 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 255183 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 255183 T595 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 255183 T595 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 255183 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 255193 T595 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 255193 T595 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59801/solr
[junit4:junit4] 2> 255194 T595 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 255197 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 255219 T651 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c3aee5b name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 255220 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 255225 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 255232 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 255238 T653 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c60c393 name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 255238 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 255248 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 256195 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 256196 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59820__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59820_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59820"}
[junit4:junit4] 2> 256209 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 256210 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 256209 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 256211 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 256399 T595 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59829_
[junit4:junit4] 2> 256402 T595 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59829_
[junit4:junit4] 2> 256410 T624 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 256411 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256412 T653 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 256412 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256413 T637 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 256414 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256414 T617 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 256415 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 256430 T654 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 256431 T654 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 257944 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 257946 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59829_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59829"}
[junit4:junit4] 2> 257946 T618 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 257946 T618 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 257962 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257962 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257962 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 257962 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 258722 T654 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\collection1
[junit4:junit4] 2> 258722 T654 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 258724 T654 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 258724 T654 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 258727 T654 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\collection1\'
[junit4:junit4] 2> 258729 T654 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 258730 T654 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291/collection1/lib/README' to classloader
[junit4:junit4] 2> 258797 T654 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 258876 T654 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 258880 T654 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 258885 T654 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 259660 T654 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 259672 T654 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 259681 T654 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 259711 T654 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 259716 T654 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 259722 T654 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 259725 T654 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 259725 T654 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 259725 T654 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 259728 T654 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 259728 T654 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 259728 T654 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 259729 T654 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty2-1371655770291\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty2\
[junit4:junit4] 2> 259729 T654 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c048ed9
[junit4:junit4] 2> 259729 T654 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 259730 T654 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2
[junit4:junit4] 2> 259731 T654 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty2\index/
[junit4:junit4] 2> 259733 T654 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 259733 T654 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index
[junit4:junit4] 2> 259748 T654 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@605e1db8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 259748 T654 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 259754 T654 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 259754 T654 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 259756 T654 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 259757 T654 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 259757 T654 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 259758 T654 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 259758 T654 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 259759 T654 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 259759 T654 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 259770 T654 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 259782 T654 oass.SolrIndexSearcher.<init> Opening Searcher@3778a52 main
[junit4:junit4] 2> 259785 T654 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 259786 T654 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 259791 T655 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3778a52 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 259798 T654 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 259798 T654 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59829 collection:collection1 shard:shard1
[junit4:junit4] 2> 259805 T654 oasc.ZkController.register We are http://127.0.0.1:59829/collection1/ and leader is http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 259806 T654 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59829
[junit4:junit4] 2> 259806 T654 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 259806 T654 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C338 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C338_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 259808 T656 C338 P59829 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 259809 T656 C338 P59829 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 259809 T656 C338 P59829 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 259809 T656 C338 P59829 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 259809 T654 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 259814 T656 C338 P59829 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 259815 T595 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 259816 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 259816 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 259826 T629 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:59829__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 260282 T595 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 260287 T595 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59839
[junit4:junit4] 2> 260288 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 260290 T595 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 260290 T595 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566
[junit4:junit4] 2> 260291 T595 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\solr.xml
[junit4:junit4] 2> 260291 T595 oasc.CoreContainer.<init> New CoreContainer 1745890414
[junit4:junit4] 2> 260291 T595 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\'
[junit4:junit4] 2> 260292 T595 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\'
[junit4:junit4] 2> 260437 T595 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 260437 T595 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 260437 T595 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 260439 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 260439 T595 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 260442 T595 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 260442 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 260443 T595 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 260443 T595 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 260445 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 260459 T595 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 260461 T595 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59801/solr
[junit4:junit4] 2> 260461 T595 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 260463 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 260485 T668 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ee6a099 name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 260486 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 260493 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 260493 T597 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5d0ddeb10009, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 260501 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 260506 T670 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dc7a0ef name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 260506 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 260517 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 261513 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 261514 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59829__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59829_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59829"}
[junit4:junit4] 2> 261526 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 261526 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 261527 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 261527 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 261529 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 261782 T595 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59839_
[junit4:junit4] 2> 261785 T595 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59839_
[junit4:junit4] 2> 261791 T670 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 261791 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261793 T624 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 261794 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261794 T617 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 261795 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261795 T653 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 261796 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261795 T637 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 261798 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 261817 T671 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 261819 T671 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 262289 T629 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:59829__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 262289 T629 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:59829__collection1&state=recovering&nodeName=127.0.0.1:59829_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2464
[junit4:junit4] 2> 263428 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 263429 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59839_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59839"}
[junit4:junit4] 2> 263429 T618 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 263429 T618 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 263445 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 263447 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 263447 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 263448 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 263448 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 264338 T671 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\collection1
[junit4:junit4] 2> 264338 T671 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 264340 T671 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 264340 T671 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 264344 T671 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\collection1\'
[junit4:junit4] 2> 264346 T671 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 264349 T671 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566/collection1/lib/README' to classloader
[junit4:junit4] 2> 264436 T671 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 264519 T671 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 264524 T671 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 264539 T671 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C339 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C339_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 264807 T656 C339 P59829 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59820/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 264807 T656 C339 P59829 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59829 START replicas=[http://127.0.0.1:59820/collection1/] nUpdates=100
[junit4:junit4] 2> 264808 T656 C339 P59829 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 264808 T656 C339 P59829 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 264808 T656 C339 P59829 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 264808 T656 C339 P59829 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 264809 T656 C339 P59829 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 264809 T656 C339 P59829 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59820/collection1/. core=collection1
[junit4:junit4] 2> 264816 T656 C339 P59829 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C340 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C340_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 264856 T629 C340 P59820 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=33
[junit4:junit4] 2> ASYNC NEW_CORE C341 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C341_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 264922 T631 C341 P59820 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C342 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C342_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 264935 T631 C342 P59820 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 264938 T631 C342 P59820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 264953 T631 C342 P59820 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 264954 T631 C342 P59820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 264957 T631 C342 P59820 oass.SolrIndexSearcher.<init> Opening Searcher@15bb517c realtime
[junit4:junit4] 2> 264957 T631 C342 P59820 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 264957 T631 C342 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 36
[junit4:junit4] 2> ASYNC NEW_CORE C343 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C343_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 264959 T656 C343 P59829 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 264961 T656 C343 P59829 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 264965 T633 C342 P59820 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 264967 T633 C342 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=3
[junit4:junit4] 2> 264967 T656 C343 P59829 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 264967 T656 C343 P59829 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 264968 T656 C343 P59829 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> ASYNC NEW_CORE C344 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C344_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 264979 T628 C344 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=7
[junit4:junit4] 2> ASYNC NEW_CORE C345 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C345_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 264980 T656 C345 P59829 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 264983 T656 C345 P59829 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722
[junit4:junit4] 2> 264984 T656 C345 P59829 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722 lockFactory=org.apache.lucene.store.NativeFSLockFactory@375bb910; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 264989 T630 C344 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 264991 T656 C345 P59829 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 265000 T656 C345 P59829 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 265000 T656 C345 P59829 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> ASYNC NEW_CORE C346 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C346_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 265016 T656 C346 P59829 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@605e1db8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@605e1db8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 265017 T656 C346 P59829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 265017 T656 C346 P59829 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 265020 T656 C346 P59829 oass.SolrIndexSearcher.<init> Opening Searcher@11198845 main
[junit4:junit4] 2> 265091 T655 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@11198845 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> ASYNC NEW_CORE C347 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C347_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 265102 T656 C347 P59829 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722;done=true>>]
[junit4:junit4] 2> 265102 T656 C347 P59829 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722
[junit4:junit4] 2> 265102 T656 C347 P59829 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index.20130619222940722
[junit4:junit4] 2> 265103 T656 C347 P59829 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 265103 T656 C347 P59829 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 265103 T656 C347 P59829 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 265104 T656 C347 P59829 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 265109 T656 C347 P59829 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 265348 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 265349 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59829__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59829_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59829"}
[junit4:junit4] 2> 265369 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 265369 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 265369 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 265377 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 265377 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 265515 T671 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 265531 T671 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 265536 T671 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 265570 T671 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 265590 T671 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 265596 T671 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 265600 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 265600 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 265600 T671 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 265602 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 265603 T671 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 265603 T671 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 265603 T671 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty3-1371655775566\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty3\
[junit4:junit4] 2> 265603 T671 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c048ed9
[junit4:junit4] 2> 265606 T671 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 265607 T671 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3
[junit4:junit4] 2> 265608 T671 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty3\index/
[junit4:junit4] 2> 265609 T671 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 265609 T671 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index
[junit4:junit4] 2> 265622 T671 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f3c744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 265622 T671 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 265628 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 265628 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 265629 T671 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 265629 T671 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 265630 T671 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 265630 T671 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 265636 T671 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 265643 T671 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 265644 T671 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 265657 T671 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 265670 T671 oass.SolrIndexSearcher.<init> Opening Searcher@1f7f6aba main
[junit4:junit4] 2> 265671 T671 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 265671 T671 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 265681 T674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f7f6aba main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 265683 T671 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 265683 T671 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59839 collection:collection1 shard:shard1
[junit4:junit4] 2> 265692 T671 oasc.ZkController.register We are http://127.0.0.1:59839/collection1/ and leader is http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 265692 T671 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59839
[junit4:junit4] 2> 265692 T671 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 265692 T671 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C348 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C348_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 265694 T675 C348 P59839 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 265695 T675 C348 P59839 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 265695 T671 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 265697 T675 C348 P59839 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 265697 T675 C348 P59839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 265699 T595 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 265700 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 265700 T675 C348 P59839 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 265702 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 265721 T631 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:59839__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 266220 T595 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 266229 T595 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59852
[junit4:junit4] 2> 266231 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 266231 T595 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 266232 T595 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457
[junit4:junit4] 2> 266232 T595 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\solr.xml
[junit4:junit4] 2> 266232 T595 oasc.CoreContainer.<init> New CoreContainer 2006077878
[junit4:junit4] 2> 266235 T595 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\'
[junit4:junit4] 2> 266235 T595 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\'
[junit4:junit4] 2> 266387 T595 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 266387 T595 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 266388 T595 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 266390 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 266390 T595 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 266391 T595 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 266392 T595 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 266392 T595 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 266392 T595 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 266393 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 266402 T595 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 266403 T595 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59801/solr
[junit4:junit4] 2> 266403 T595 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 266406 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 266425 T687 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@782fc4a8 name:ZooKeeperConnection Watcher:127.0.0.1:59801 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 266427 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 266433 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 266444 T595 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 266450 T689 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37c686a3 name:ZooKeeperConnection Watcher:127.0.0.1:59801/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 266450 T595 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 266461 T595 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 267279 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 267282 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59839__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59839_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59839"}
[junit4:junit4] 2> 267314 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267315 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267317 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267315 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267317 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267315 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267725 T595 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59852_
[junit4:junit4] 2> 267729 T595 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59852_
[junit4:junit4] 2> 267735 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 267736 T670 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267738 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267739 T624 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267739 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267739 T617 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267740 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267739 T637 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267741 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267739 T653 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267743 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 267747 T689 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 267757 T690 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 267757 T690 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 268239 T631 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:59839__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 268239 T631 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:59839__collection1&state=recovering&nodeName=127.0.0.1:59839_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2518
[junit4:junit4] 2> 269218 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 269221 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59852_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59852"}
[junit4:junit4] 2> 269221 T618 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4:junit4] 2> 269221 T618 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 269238 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269238 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269239 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269238 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269238 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 269238 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 270279 T690 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\collection1
[junit4:junit4] 2> 270279 T690 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 270280 T690 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 270280 T690 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 270284 T690 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\collection1\'
[junit4:junit4] 2> 270287 T690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 270287 T690 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457/collection1/lib/README' to classloader
[junit4:junit4] 2> 270369 T690 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 270452 T690 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 270456 T690 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 270463 T690 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C349 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C349_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 270762 T675 C349 P59839 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59820/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 270764 T675 C349 P59839 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59839 START replicas=[http://127.0.0.1:59820/collection1/] nUpdates=100
[junit4:junit4] 2> 270764 T675 C349 P59839 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 270764 T675 C349 P59839 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 270765 T675 C349 P59839 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 270765 T675 C349 P59839 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 270765 T675 C349 P59839 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 270767 T675 C349 P59839 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59820/collection1/. core=collection1
[junit4:junit4] 2> 270767 T675 C349 P59839 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C350 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C350_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 270781 T632 C350 P59820 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 270791 T633 C350 P59820 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 270808 T632 C350 P59820 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 270808 T632 C350 P59820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 270811 T632 C350 P59820 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 270811 T632 C350 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 31
[junit4:junit4] 2> 270815 T675 C349 P59839 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 270815 T675 C349 P59839 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> ASYNC NEW_CORE C351 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C351_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 270823 T630 C351 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C352 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C352_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 270824 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Master's generation: 3
[junit4:junit4] 2> 270826 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 270826 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 270832 T629 C351 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=3&version=2} status=0 QTime=3
[junit4:junit4] 2> 270833 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 270835 T675 C352 P59839 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575
[junit4:junit4] 2> 270838 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575 lockFactory=org.apache.lucene.store.NativeFSLockFactory@36ae2b0; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 270843 T631 C351 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_3&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=3} status=0 QTime=0
[junit4:junit4] 2> 270845 T675 C352 P59839 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> ASYNC NEW_CORE C353 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C353_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 270858 T675 C353 P59839 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 270859 T675 C353 P59839 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 270867 T675 C353 P59839 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f3c744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f3c744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 270869 T675 C353 P59839 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 270869 T675 C353 P59839 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 270871 T675 C353 P59839 oass.SolrIndexSearcher.<init> Opening Searcher@56a6ee83 main
[junit4:junit4] 2> 270872 T674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@56a6ee83 main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> 270874 T675 C353 P59839 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575;done=true>>]
[junit4:junit4] 2> 270874 T675 C353 P59839 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575
[junit4:junit4] 2> 270874 T675 C353 P59839 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index.20130619222946575
[junit4:junit4] 2> 270875 T675 C353 P59839 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 270875 T675 C353 P59839 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 270876 T675 C353 P59839 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 270876 T675 C353 P59839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 270881 T675 C353 P59839 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 271140 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 271143 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59839__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59839_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59839"}
[junit4:junit4] 2> 271161 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271161 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271162 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271162 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271164 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271164 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 271422 T690 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 271435 T690 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 271440 T690 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 271472 T690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 271489 T690 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 271497 T690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 271499 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 271499 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 271500 T690 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 271503 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 271503 T690 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 271503 T690 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 271504 T690 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.SyncSliceTest-jetty4-1371655781457\collection1\, dataDir=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty4\
[junit4:junit4] 2> 271504 T690 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c048ed9
[junit4:junit4] 2> 271504 T690 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
[junit4:junit4] 2> 271505 T690 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4
[junit4:junit4] 2> 271506 T690 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.SyncSliceTest-1371655757473/jetty4\index/
[junit4:junit4] 2> 271508 T690 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 271508 T690 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index
[junit4:junit4] 2> 271520 T690 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@aaadc72; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 271520 T690 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 271528 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 271528 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 271531 T690 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 271531 T690 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 271532 T690 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 271532 T690 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 271538 T690 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 271538 T690 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 271540 T690 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 271551 T690 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 271562 T690 oass.SolrIndexSearcher.<init> Opening Searcher@28e80113 main
[junit4:junit4] 2> 271565 T690 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 271565 T690 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 271573 T693 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28e80113 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 271575 T690 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 271575 T690 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59852 collection:collection1 shard:shard1
[junit4:junit4] 2> 271584 T690 oasc.ZkController.register We are http://127.0.0.1:59852/collection1/ and leader is http://127.0.0.1:59820/collection1/
[junit4:junit4] 2> 271584 T690 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59852
[junit4:junit4] 2> 271584 T690 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 271584 T690 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C354 name=collection1 org.apache.solr.core.SolrCore@75928c69 url=http://127.0.0.1:59852/collection1 node=127.0.0.1:59852_ C354_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:59852_, base_url=http://127.0.0.1:59852}
[junit4:junit4] 2> 271585 T694 C354 P59852 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 271586 T694 C354 P59852 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 271586 T694 C354 P59852 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 271586 T694 C354 P59852 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 271586 T690 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 271590 T694 C354 P59852 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 271592 T595 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 271592 T595 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 271594 T595 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 271605 T632 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:59852__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 271606 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 271607 T595 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 271608 T595 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 271610 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 272870 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 273079 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 273081 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59852__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59852_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59852"}
[junit4:junit4] 2> 273096 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 273097 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 273097 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 273097 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 273098 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 273098 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 274240 T632 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:59852__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 274240 T632 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:59852__collection1&state=recovering&nodeName=127.0.0.1:59852_&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2635
[junit4:junit4] 2> 274250 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 275637 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C354_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59852_, base_url=http://127.0.0.1:59852}
[junit4:junit4] 2> 277010 T694 C354 P59852 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59820/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 277010 T694 C354 P59852 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59852 START replicas=[http://127.0.0.1:59820/collection1/] nUpdates=100
[junit4:junit4] 2> 277011 T694 C354 P59852 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 277011 T694 C354 P59852 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 277011 T694 C354 P59852 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 277014 T694 C354 P59852 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 277014 T694 C354 P59852 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 277014 T694 C354 P59852 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59820/collection1/. core=collection1
[junit4:junit4] 2> 277015 T694 C354 P59852 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C355 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C355_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 277015 T632 C355 P59820 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 277025 T630 C355 P59820 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 277026 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 277044 T630 C355 P59820 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> ASYNC NEW_CORE C356 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C356_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 277052 T630 C356 P59820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 277056 T630 C356 P59820 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 277056 T630 C356 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 31
[junit4:junit4] 2> ASYNC NEW_CORE C357 name=collection1 org.apache.solr.core.SolrCore@75928c69 url=http://127.0.0.1:59852/collection1 node=127.0.0.1:59852_ C357_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59852_, base_url=http://127.0.0.1:59852}
[junit4:junit4] 2> 277058 T694 C357 P59852 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 277058 T694 C357 P59852 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 277061 T631 C356 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=0
[junit4:junit4] 2> 277063 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Master's generation: 4
[junit4:junit4] 2> 277063 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 277063 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 277069 T633 C356 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=4&version=2} status=0 QTime=2
[junit4:junit4] 2> 277071 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 277073 T694 C357 P59852 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814
[junit4:junit4] 2> 277075 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Starting download to NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814 lockFactory=org.apache.lucene.store.NativeFSLockFactory@2d0153ef; maxCacheMB=48.0 maxMergeSizeMB=4.0) fullCopy=false
[junit4:junit4] 2> 277081 T628 C356 P59820 oasc.SolrCore.execute [collection1] webapp= path=/replication params={file=segments_4&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=4} status=0 QTime=1
[junit4:junit4] 2> 277084 T694 C357 P59852 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 277091 T694 C357 P59852 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 277091 T694 C357 P59852 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 277098 T694 C357 P59852 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@aaadc72; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@aaadc72; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 277100 T694 C357 P59852 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 277102 T694 C357 P59852 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 277106 T694 C357 P59852 oass.SolrIndexSearcher.<init> Opening Searcher@16e2e222 main
[junit4:junit4] 2> 277107 T693 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16e2e222 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 277107 T694 C357 P59852 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814;done=true>>]
[junit4:junit4] 2> 277108 T694 C357 P59852 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814
[junit4:junit4] 2> 277108 T694 C357 P59852 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index.20130619222952814
[junit4:junit4] 2> 277111 T694 C357 P59852 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 277111 T694 C357 P59852 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 277113 T694 C357 P59852 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 277113 T694 C357 P59852 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 277118 T694 C357 P59852 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 277269 T618 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 277271 T618 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59852__collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59852_",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59852"}
[junit4:junit4] 2> 277287 T670 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 277287 T653 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 277288 T637 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 277287 T689 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 277287 T624 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 277287 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 278415 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 278417 T595 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C358 name=collection1 org.apache.solr.core.SolrCore@693addf0 url=http://127.0.0.1:59808/collection1 node=127.0.0.1:59808_ C358_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:59808_, base_url=http://127.0.0.1:59808, leader=true}
[junit4:junit4] 2> 278433 T611 C358 P59808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 278444 T611 C358 P59808 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> 278445 T611 C358 P59808 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 278457 T611 C358 P59808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> 278457 T611 C358 P59808 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 278463 T611 C358 P59808 oass.SolrIndexSearcher.<init> Opening Searcher@45589605 main
[junit4:junit4] 2> 278464 T611 C358 P59808 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 278464 T621 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@45589605 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 278465 T611 C358 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 32
[junit4:junit4] 2> ASYNC NEW_CORE C359 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C359_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 278480 T629 C359 P59820 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:59820/collection1/, StdNode: http://127.0.0.1:59829/collection1/, StdNode: http://127.0.0.1:59839/collection1/, StdNode: http://127.0.0.1:59852/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 278491 T631 C359 P59820 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C360 name=collection1 org.apache.solr.core.SolrCore@75928c69 url=http://127.0.0.1:59852/collection1 node=127.0.0.1:59852_ C360_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59852_, base_url=http://127.0.0.1:59852}
[junit4:junit4] 2> 278510 T685 C360 P59852 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> ASYNC NEW_CORE C361 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C361_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 278510 T666 C361 P59839 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 278520 T631 C359 P59820 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=3
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty1\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@57929093; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 278525 T631 C359 P59820 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 278529 T631 C359 P59820 oass.SolrIndexSearcher.<init> Opening Searcher@41bd058e main
[junit4:junit4] 2> 278529 T631 C359 P59820 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 278530 T666 C361 P59839 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f3c744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty3\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@4f3c744; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> 278530 T666 C361 P59839 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4:junit4] 2> 278534 T639 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@41bd058e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 278534 T631 C359 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 44
[junit4:junit4] 2> 278541 T666 C361 P59839 oass.SolrIndexSearcher.<init> Opening Searcher@2323368c main
[junit4:junit4] 2> 278543 T666 C361 P59839 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> ASYNC NEW_CORE C362 name=collection1 org.apache.solr.core.SolrCore@75928c69 url=http://127.0.0.1:59852/collection1 node=127.0.0.1:59852_ C362_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59852_, base_url=http://127.0.0.1:59852}
[junit4:junit4] 2> 278549 T685 C362 P59852 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@aaadc72; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_4,generation=4}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty4\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@aaadc72; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_5,generation=5}
[junit4:junit4] 2> 278551 T685 C362 P59852 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
[junit4:junit4] 2> 278549 T674 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2323368c main{StandardDirectoryReader(segments_3:1:nrt)}
[junit4:junit4] 2> ASYNC NEW_CORE C363 name=collection1 org.apache.solr.core.SolrCore@6b16a5c8 url=http://127.0.0.1:59839/collection1 node=127.0.0.1:59839_ C363_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59839_, base_url=http://127.0.0.1:59839}
[junit4:junit4] 2> 278553 T666 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 43
[junit4:junit4] 2> 278555 T685 C362 P59852 oass.SolrIndexSearcher.<init> Opening Searcher@436f2ad1 main
[junit4:junit4] 2> 278556 T685 C362 P59852 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 278557 T693 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@436f2ad1 main{StandardDirectoryReader(segments_4:1:nrt)}
[junit4:junit4] 2> 278559 T685 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 49
[junit4:junit4] 2> ASYNC NEW_CORE C364 name=collection1 org.apache.solr.core.SolrCore@4eb7a276 url=http://127.0.0.1:59829/collection1 node=127.0.0.1:59829_ C364_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59829_, base_url=http://127.0.0.1:59829}
[junit4:junit4] 2> 278560 T648 C364 P59829 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 278571 T648 C364 P59829 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@605e1db8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\jetty2\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@605e1db8; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 278571 T648 C364 P59829 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 278578 T648 C364 P59829 oass.SolrIndexSearcher.<init> Opening Searcher@4f1934c main
[junit4:junit4] 2> 278579 T648 C364 P59829 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 278579 T655 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4f1934c main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 278580 T648 C364 P59829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 21
[junit4:junit4] 2> ASYNC NEW_CORE C365 name=collection1 org.apache.solr.core.SolrCore@2637bb6a url=http://127.0.0.1:59820/collection1 node=127.0.0.1:59820_ C365_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59820_, base_url=http://127.0.0.1:59820, leader=true}
[junit4:junit4] 2> 278582 T629 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 102
[junit4:junit4] 2> 278584 T595 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 278588 T633 C365 P59820 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 278593 T644 C364 P59829 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=2
[junit4:junit4] 2> 278597 T661 C363 P59839 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 278599 T680 C362 P59852 oasc.SolrCore.execute [collection1] webapp= path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> ASYNC NEW_CORE C366 name=collection1 org.apache.solr.core.SolrCore@693addf0 url=http://127.0.0.1:59808/collection1 node=127.0.0.1:59808_ C366_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:59808_, base_url=http://127.0.0.1:59808, leader=true}
[junit4:junit4] 2> 281377 T611 C366 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438285349115658240)} 0 6
[junit4:junit4] 2> 281394 T680 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438285349124046848&update.from=http://127.0.0.1:59820/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438285349124046848)} 0 4
[junit4:junit4] 2> 281397 T661 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438285349124046848&update.from=http://127.0.0.1:59820/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438285349124046848)} 0 7
[junit4:junit4] 2> 281400 T644 C364 P59829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={update.distrib=FROMLEADER&_version_=-1438285349124046848&update.from=http://127.0.0.1:59820/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1438285349124046848)} 0 8
[junit4:junit4] 2> 281401 T633 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1438285349124046848)} 0 20
[junit4:junit4] 2> 281416 T612 C366 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0 (1438285349152358400)]} 0 8
[junit4:junit4] 2> 281447 T682 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438285349173329920)]} 0 9
[junit4:junit4] 2> 281447 T645 C364 P59829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438285349173329920)]} 0 9
[junit4:junit4] 2> 281450 T662 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1438285349173329920)]} 0 8
[junit4:junit4] 2> 281453 T628 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59852/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[0 (1438285349173329920)]} 0 25
[junit4:junit4] 2> 281454 T681 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[0]} 0 33
[junit4:junit4] 2> 281461 T613 C366 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1 (1438285349204787200)]} 0 4
[junit4:junit4] 2> 281480 T646 C364 P59829 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438285349218418688)]} 0 2
[junit4:junit4] 2> 281484 T683 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438285349218418688)]} 0 6
[junit4:junit4] 2> 281484 T664 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1438285349218418688)]} 0 4
[junit4:junit4] 2> 281486 T632 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59839/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[1 (1438285349218418688)]} 0 16
[junit4:junit4] 2> 281488 T663 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[1]} 0 23
[junit4:junit4] 2> 281494 T608 C366 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[2 (1438285349241487360)]} 0 2
[junit4:junit4] 2> 281505 T630 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:59829/collection1/]
[junit4:junit4] 2> 281507 T630 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59829/collection1/ against:[http://127.0.0.1:59829/collection1/] result:true
[junit4:junit4] 2> 281508 T630 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59839/collection1/ against:[http://127.0.0.1:59829/collection1/] result:false
[junit4:junit4] 2> 281508 T630 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59852/collection1/ against:[http://127.0.0.1:59829/collection1/] result:false
[junit4:junit4] 2> 281519 T666 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[2 (1438285349258264576)]} 0 4
[junit4:junit4] 2> 281519 T684 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[2 (1438285349258264576)]} 0 4
[junit4:junit4] 2> 281521 T630 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59839/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[2 (1438285349258264576)]} 0 16
[junit4:junit4] 2> 281523 T665 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[2]} 0 23
[junit4:junit4] 2> 281531 T609 C366 P59808 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={wt=javabin&version=2} {add=[3 (1438285349280284672)]} 0 4
[junit4:junit4] 2> 281551 T631 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest test.distrib.skip.servers was found and contains:[http://127.0.0.1:59829/collection1/]
[junit4:junit4] 2> 281551 T631 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59829/collection1/ against:[http://127.0.0.1:59829/collection1/] result:true
[junit4:junit4] 2> 281551 T631 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59839/collection1/ against:[http://127.0.0.1:59829/collection1/] result:false
[junit4:junit4] 2> 281551 T631 C365 P59820 oasup.DistributedUpdateProcessor.setupRequest check url:http://127.0.0.1:59852/collection1/ against:[http://127.0.0.1:59829/collection1/] result:false
[junit4:junit4] 2> 281569 T680 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[3 (1438285349305450496)]} 0 3
[junit4:junit4] 2> 281569 T661 C363 P59839 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59820/collection1/&update.distrib=FROMLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[3 (1438285349305450496)]} 0 3
[junit4:junit4] 2> 281571 T631 C365 P59820 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={distrib.from=http://127.0.0.1:59852/collection1/&update.distrib=TOLEADER&test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&wt=javabin&version=2} {add=[3 (1438285349305450496)]} 0 21
[junit4:junit4] 2> 281573 T685 C362 P59852 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={test.distrib.skip.servers=http://127.0.0.1:59829/collection1/&test.distrib.skip.servers=http://127.0.0.1:59839/collection1/&wt=javabin&version=2} {add=[3]} 0 27
[junit4:junit4] 2> 281577 T610 C366 P59808 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 281631 T610 C366 P59808 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.SyncSliceTest-1371655757473\control\data\index lockFactory=org.apache.lucene.store.NativeFSLockFactory@6b729f89; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_3,generation=3}
[junit4:junit4] 2> 281634 T610 C366 P59808 oasc.SolrDeletionPolicy.updateCommits newest commit generation
[...truncated too long message...]
49 T7347 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 63224
[junit4:junit4] 2> 2719253 T7438 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2720452 T7438 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 2720470 T7347 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 2720470 T7347 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:63217 63217
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ShardSplitTest -Dtests.method=testDistribSearch -Dtests.seed=18805E6D89FB7A2D -Dtests.slow=true -Dtests.locale=hr -Dtests.timezone=Africa/Lusaka -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 66.4s | ShardSplitTest.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:63236/brdt/df returned non ok status:500, message:Server Error
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([18805E6D89FB7A2D:9966D075FEA41A11]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:228)
[junit4:junit4] > at org.apache.solr.cloud.ShardSplitTest.doTest(ShardSplitTest.java:150)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2> 2720477 T7347 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {id=PostingsFormat(name=MockRandom), _version_=Pulsing41(freqCutoff=7 minBlockSize=44 maxBlockSize=160), n_ti=Pulsing41(freqCutoff=7 minBlockSize=44 maxBlockSize=160)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=hr, timezone=Africa/Lusaka
[junit4:junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=2,threads=2,free=79880184,total=362840064
[junit4:junit4] 2> NOTE: All tests run in this JVM: [LeaderElectionIntegrationTest, TestWordDelimiterFilterFactory, SolrTestCaseJ4Test, TestSuggestSpellingConverter, ChaosMonkeySafeLeaderTest, SolrCoreTest, DirectUpdateHandlerTest, URLClassifyProcessorTest, SyncSliceTest, FileBasedSpellCheckerTest, CopyFieldTest, TestFieldTypeResource, CollectionsAPIDistributedZkTest, TestFunctionQuery, TestStressVersions, RecoveryZkTest, DateFieldTest, ZkSolrClientTest, TestRealTimeGet, TestIndexSearcher, TestStressReorder, DistanceFunctionTest, DocumentBuilderTest, TestBM25SimilarityFactory, DistributedTermsComponentTest, TestFiltering, TestFoldingMultitermQuery, TestSolrQueryParserResource, UniqFieldsUpdateProcessorFactoryTest, TestSolrQueryParser, TestRangeQuery, TestLMDirichletSimilarityFactory, ClusterStateUpdateTest, TestIndexingPerformance, TestSchemaNameResource, SpatialFilterTest, TestCopyFieldCollectionResource, UUIDFieldTest, TestSolrQueryParserDefaultOperatorResource, FullSolrCloudDistribCmdsTest, SpellCheckCollatorTest, SignatureUpdateProcessorFactoryTest, RequiredFieldsTest, SolrCoreCheckLockOnStartupTest, TestMergePolicyConfig, TestMaxScoreQueryParser, CSVRequestHandlerTest, TestSolr4Spatial, NoCacheHeaderTest, TestBadConfig, ResourceLoaderTest, TestFieldResource, TestFieldCollectionResource, IndexSchemaRuntimeFieldTest, SchemaVersionSpecificBehaviorTest, ExternalFileFieldSortTest, TestValueSourceCache, TestQueryTypes, SpellCheckComponentTest, TestDefaultSimilarityFactory, PeerSyncTest, TestSearchPerf, AlternateDirectoryTest, TestManagedSchema, SolrRequestParserTest, TestDefaultSearchFieldResource, StatelessScriptUpdateProcessorFactoryTest, IndexReaderFactoryTest, DistributedSpellCheckComponentTest, TimeZoneUtilsTest, RequestHandlersTest, QueryResultKeyTest, TestCSVResponseWriter, LegacyHTMLStripCharFilterTest, SpellPossibilityIteratorTest, SoftAutoCommitTest, CircularListTest, TestJmxIntegration, TestWriterPerf, TestSchemaResource, SliceStateTest, TestUniqueKeyFieldResource, BasicDistributedZk2Test, TestFuzzyAnalyzedSuggestions, TestSerializedLuceneMatchVersion, TestElisionMultitermQuery, ChaosMonkeyNothingIsSafeTest, SpellingQueryConverterTest, DocValuesTest, NumericFieldsTest, BadComponentTest, TestDynamicFieldResource, TestAnalyzedSuggestions, TestIBSimilarityFactory, QueryEqualityTest, PreAnalyzedUpdateProcessorTest, TestNumberUtils, XmlUpdateRequestHandlerTest, LeaderElectionTest, TestSolrDeletionPolicy2, TestSolrXMLSerializer, TestAddFieldRealTimeGet, TestRemoteStreaming, TestComponentsName, TestReload, SuggesterFSTTest, DocValuesMultiTest, TestCodecSupport, SearchHandlerTest, SampleTest, TestPropInjectDefaults, SliceStateUpdateTest, TestJoin, TestMultiCoreConfBootstrap, DocumentAnalysisRequestHandlerTest, TestSchemaSimilarityResource, StandardRequestHandlerTest, ConvertedLegacyTest, TestRandomDVFaceting, SolrCmdDistributorTest, ReturnFieldsTest, HighlighterTest, TestLRUCache, TestFieldTypeCollectionResource, DefaultValueUpdateProcessorTest, TestUtils, CurrencyFieldXmlFileTest, TestZkChroot, ShowFileRequestHandlerTest, TestPhraseSuggestions, AutoCommitTest, TestRTGBase, ShardRoutingCustomTest, TestQueryUtils, TestSchemaVersionResource, TestPostingsSolrHighlighter, TestSystemIdResolver, TestArbitraryIndexDir, TestJmxMonitoredMap, TestStressRecovery, MultiTermTest, NotRequiredUniqueKeyTest, CacheHeaderTest, TestShardHandlerFactory, SystemInfoHandlerTest, DebugComponentTest, BasicDistributedZkTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler, TestRandomFaceting, ZkCLITest, TestDistributedSearch, TestDistributedGrouping, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, HardAutoCommitTest, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, TestGroupingSearch, QueryElevationComponentTest, BadIndexSchemaTest, TestSort, BasicFunctionalityTest, TestLazyCores, OverseerCollectionProcessorTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, TestTrie, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestPseudoReturnFields, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, LukeRequestHandlerTest, DisMaxRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, TestCollationField, UpdateRequestProcessorFactoryTest, JSONWriterTest, MBeansHandlerTest, QueryParsingTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, PingRequestHandlerTest, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, SOLR749Test, TestPropInject, TestQuerySenderListener, UpdateParamsTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, TestDocSet, TestBinaryField, MinimalSchemaTest, TestConfig, OutputWriterTest, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, TestCharFilters, SynonymTokenizerTest, TestXIncludeConfig, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMJelinekMercerSimilarityFactory, TestFastWriter, TestPluginEnable, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, PreAnalyzedFieldTest, PrimUtilsTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestDocumentBuilder, ZkNodePropsTest, FileUtilsTest, TestCollationKeyRangeQueries, AliasIntegrationTest, ChaosMonkeyShardSplitTest, ShardSplitTest]
[junit4:junit4] Completed in 66.39s, 1 test, 1 error <<< FAILURES!
[...truncated 45 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1253 tests, 2 errors, 2 failures, 18 ignored (12 assumptions)
Total time: 70 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.7.0_21) - Build #
2909 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/2909/
Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
ERROR: SolrIndexSearcher opens=63 closes=62
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=63 closes=62
at __randomizedtesting.SeedInfo.seed([6856F6E3C3FF0FD0]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:254)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:102)
at sun.reflect.GeneratedMethodAccessor24.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9685 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4:junit4] 2> 904715 T2025 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /uru/q
[junit4:junit4] 2> 904723 T2025 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1371682771378
[junit4:junit4] 2> 904730 T2025 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 904731 T2026 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 904854 T2025 oasc.ZkTestServer.run start zk server on port:52678
[junit4:junit4] 2> 904856 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 904869 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4312eebb name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 904869 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 904869 T2025 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 904883 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 904889 T2034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e265cbe name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 904890 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 904892 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 904902 T2025 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 904912 T2025 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 904919 T2025 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 904930 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 904931 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 904957 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 904958 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 904971 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 904973 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 904984 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 904985 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 904995 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 904996 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 905004 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 905005 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 905013 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 905014 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 905022 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 905022 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 905030 T2025 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 905032 T2025 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 905592 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 905605 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52685
[junit4:junit4] 2> 905606 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 905606 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 905606 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690
[junit4:junit4] 2> 905607 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\solr.xml
[junit4:junit4] 2> 905607 T2025 oasc.CoreContainer.<init> New CoreContainer 1978713104
[junit4:junit4] 2> 905607 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\'
[junit4:junit4] 2> 905607 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\'
[junit4:junit4] 2> 905776 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 905777 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 905777 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 905778 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 905778 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 905779 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 905779 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 905779 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 905780 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 905780 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 905793 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 905793 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 905794 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 905798 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 905819 T2045 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@35caa3ea name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 905821 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 905827 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 905837 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 905843 T2047 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@27b1f715 name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 905843 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 905849 T2025 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 905860 T2025 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 905868 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 905874 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52685_uru%2Fq
[junit4:junit4] 2> 905880 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52685_uru%2Fq
[junit4:junit4] 2> 905889 T2025 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 905905 T2025 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 905912 T2025 oasc.Overseer.start Overseer (id=89894602105880579-127.0.0.1:52685_uru%2Fq-n_0000000000) starting
[junit4:junit4] 2> 905925 T2025 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 905936 T2049 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 905938 T2025 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 905946 T2025 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 905953 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 905961 T2048 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 905964 T2050 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 905965 T2050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 907793 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 907794 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52685_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52685/uru/q"}
[junit4:junit4] 2> 907794 T2048 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 907794 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 907809 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 908399 T2050 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\collection1
[junit4:junit4] 2> 908399 T2050 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 908401 T2050 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 908401 T2050 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 908405 T2050 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\collection1\'
[junit4:junit4] 2> 908408 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 908411 T2050 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690/collection1/lib/README' to classloader
[junit4:junit4] 2> 908504 T2050 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 908620 T2050 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 908624 T2050 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 908634 T2050 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 909479 T2050 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 909490 T2050 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 909494 T2050 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 909522 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 909527 T2050 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 909533 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 909536 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 909536 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 909536 T2050 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 909538 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 909538 T2050 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 909538 T2050 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 909573 T2050 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1371682771690\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/control/data\
[junit4:junit4] 2> 909573 T2050 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 909573 T2050 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 909574 T2050 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\control\data
[junit4:junit4] 2> 909574 T2050 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/control/data\index/
[junit4:junit4] 2> 909574 T2050 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\control\data\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 909574 T2050 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\control\data\index
[junit4:junit4] 2> 909583 T2050 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\control\data\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 909583 T2050 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 909587 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 909588 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 909588 T2050 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 909589 T2050 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 909589 T2050 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 909589 T2050 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 909589 T2050 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 909591 T2050 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 909591 T2050 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 909603 T2050 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 909615 T2050 oass.SolrIndexSearcher.<init> Opening Searcher@54cbee1a main
[junit4:junit4] 2> 909618 T2050 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 909618 T2050 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 909624 T2051 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@54cbee1a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 909625 T2050 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 909625 T2050 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52685/uru/q collection:control_collection shard:shard1
[junit4:junit4] 2> 909627 T2050 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 909647 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 909654 T2050 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 909654 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 909654 T2050 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52685/uru/q/collection1/
[junit4:junit4] 2> 909654 T2050 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 909655 T2050 oasc.SyncStrategy.syncToMe http://127.0.0.1:52685/uru/q/collection1/ has no replicas
[junit4:junit4] 2> 909655 T2050 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52685/uru/q/collection1/
[junit4:junit4] 2> 909655 T2050 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 911268 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 911298 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 911337 T2050 oasc.ZkController.register We are http://127.0.0.1:52685/uru/q/collection1/ and leader is http://127.0.0.1:52685/uru/q/collection1/
[junit4:junit4] 2> 911337 T2050 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52685/uru/q
[junit4:junit4] 2> 911337 T2050 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 911337 T2050 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 911338 T2050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 911343 T2050 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 911344 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 911345 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 911345 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 911357 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 911361 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 911365 T2054 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@402c93da name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 911366 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 911369 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 911376 T2025 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 911880 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 911885 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52697
[junit4:junit4] 2> 911887 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 911887 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 911888 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026
[junit4:junit4] 2> 911888 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\solr.xml
[junit4:junit4] 2> 911888 T2025 oasc.CoreContainer.<init> New CoreContainer 894779284
[junit4:junit4] 2> 911888 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\'
[junit4:junit4] 2> 911889 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\'
[junit4:junit4] 2> 912024 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 912025 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 912025 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 912026 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 912026 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 912026 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 912027 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 912027 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 912028 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 912028 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 912037 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 912038 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 912038 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 912040 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 912053 T2065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29ed1abe name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 912054 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 912058 T2027 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5eaa11bf0005, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 912058 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 912068 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 912072 T2067 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bdc9089 name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 912073 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 912084 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 912952 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 912953 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52685_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52685_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52685/uru/q"}
[junit4:junit4] 2> 912968 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 912968 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 912970 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 913184 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52697_uru%2Fq
[junit4:junit4] 2> 913188 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52697_uru%2Fq
[junit4:junit4] 2> 913194 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 913195 T2067 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 913195 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 913197 T2054 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 913197 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 913202 T2047 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 913210 T2068 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 913211 T2068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 914620 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 914621 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52697_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52697/uru/q"}
[junit4:junit4] 2> 914621 T2048 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 3
[junit4:junit4] 2> 914621 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 914637 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 914638 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 914637 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 915402 T2068 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\collection1
[junit4:junit4] 2> 915402 T2068 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 915403 T2068 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 915404 T2068 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 915407 T2068 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\collection1\'
[junit4:junit4] 2> 915409 T2068 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 915409 T2068 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026/collection1/lib/README' to classloader
[junit4:junit4] 2> 915473 T2068 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 915552 T2068 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 915556 T2068 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 915561 T2068 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 916312 T2068 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 916322 T2068 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 916327 T2068 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 916348 T2068 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 916354 T2068 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 916361 T2068 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 916363 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 916364 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 916364 T2068 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 916366 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 916366 T2068 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 916366 T2068 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 916367 T2068 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1371682778026\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty1\
[junit4:junit4] 2> 916367 T2068 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 916367 T2068 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 916369 T2068 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1
[junit4:junit4] 2> 916370 T2068 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty1\index/
[junit4:junit4] 2> 916370 T2068 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 916370 T2068 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index
[junit4:junit4] 2> 916381 T2068 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 916381 T2068 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 916387 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 916387 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 916390 T2068 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 916391 T2068 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 916392 T2068 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 916392 T2068 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 916392 T2068 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 916393 T2068 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 916394 T2068 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 916408 T2068 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 916422 T2068 oass.SolrIndexSearcher.<init> Opening Searcher@421852b5 main
[junit4:junit4] 2> 916425 T2068 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 916425 T2068 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 916437 T2068 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 916437 T2068 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52697/uru/q collection:collection1 shard:shard1
[junit4:junit4] 2> 916438 T2069 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@421852b5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 916441 T2068 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 916468 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 916475 T2068 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 916475 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 916475 T2068 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52697/uru/q/collection1/
[junit4:junit4] 2> 916475 T2068 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 916475 T2068 oasc.SyncStrategy.syncToMe http://127.0.0.1:52697/uru/q/collection1/ has no replicas
[junit4:junit4] 2> 916475 T2068 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52697/uru/q/collection1/
[junit4:junit4] 2> 916476 T2068 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 917933 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 917957 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 917958 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 917963 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 918008 T2068 oasc.ZkController.register We are http://127.0.0.1:52697/uru/q/collection1/ and leader is http://127.0.0.1:52697/uru/q/collection1/
[junit4:junit4] 2> 918008 T2068 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52697/uru/q
[junit4:junit4] 2> 918008 T2068 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 918008 T2068 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 918008 T2068 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 918014 T2068 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 918017 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 918017 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 918017 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 918521 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 918525 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52706
[junit4:junit4] 2> 918526 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 918527 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 918527 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681
[junit4:junit4] 2> 918527 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\solr.xml
[junit4:junit4] 2> 918527 T2025 oasc.CoreContainer.<init> New CoreContainer 306983683
[junit4:junit4] 2> 918527 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\'
[junit4:junit4] 2> 918530 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\'
[junit4:junit4] 2> 918665 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 918665 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 918666 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 918666 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 918667 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 918667 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 918668 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 918668 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 918668 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 918668 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 918677 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 918678 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 918678 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 918694 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 918713 T2081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d90bc4c name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 918715 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 918720 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 918728 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 918733 T2083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d0c20db name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 918734 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 918744 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 919619 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 919620 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52697_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52697_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52697/uru/q"}
[junit4:junit4] 2> 919634 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 919635 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 919634 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 919636 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 919844 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52706_uru%2Fq
[junit4:junit4] 2> 919846 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52706_uru%2Fq
[junit4:junit4] 2> 919852 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 919853 T2083 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 919853 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 919854 T2054 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 919854 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 919855 T2067 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 919855 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 919858 T2047 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 919868 T2084 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 919868 T2084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 921201 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 921202 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52706_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52706/uru/q"}
[junit4:junit4] 2> 921202 T2048 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 921202 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 921216 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 921217 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 921217 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 921216 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 921893 T2084 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\collection1
[junit4:junit4] 2> 921893 T2084 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 921894 T2084 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 921894 T2084 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 921898 T2084 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\collection1\'
[junit4:junit4] 2> 921899 T2084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 921900 T2084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681/collection1/lib/README' to classloader
[junit4:junit4] 2> 921954 T2084 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 922021 T2084 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 922024 T2084 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 922029 T2084 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 922667 T2084 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 922677 T2084 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 922681 T2084 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 922707 T2084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 922714 T2084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 922724 T2084 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 922728 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 922728 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 922728 T2084 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 922730 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 922730 T2084 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 922730 T2084 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 922731 T2084 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1371682784681\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty2\
[junit4:junit4] 2> 922731 T2084 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 922731 T2084 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 922732 T2084 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2
[junit4:junit4] 2> 922732 T2084 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty2\index/
[junit4:junit4] 2> 922734 T2084 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 922734 T2084 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index
[junit4:junit4] 2> 922782 T2084 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 922782 T2084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 922786 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 922788 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 922789 T2084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 922790 T2084 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 922791 T2084 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 922791 T2084 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 922791 T2084 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 922792 T2084 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 922792 T2084 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 922801 T2084 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 922834 T2084 oass.SolrIndexSearcher.<init> Opening Searcher@4e82c8d6 main
[junit4:junit4] 2> 922835 T2084 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 922836 T2084 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 922843 T2084 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 922844 T2084 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52706/uru/q collection:collection1 shard:shard2
[junit4:junit4] 2> 922845 T2085 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4e82c8d6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 922846 T2084 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 922865 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 922871 T2084 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 922872 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 922872 T2084 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52706/uru/q/collection1/
[junit4:junit4] 2> 922872 T2084 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 922873 T2084 oasc.SyncStrategy.syncToMe http://127.0.0.1:52706/uru/q/collection1/ has no replicas
[junit4:junit4] 2> 922873 T2084 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52706/uru/q/collection1/
[junit4:junit4] 2> 922873 T2084 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 924225 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 924241 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 924242 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 924242 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 924243 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 924250 T2084 oasc.ZkController.register We are http://127.0.0.1:52706/uru/q/collection1/ and leader is http://127.0.0.1:52706/uru/q/collection1/
[junit4:junit4] 2> 924250 T2084 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52706/uru/q
[junit4:junit4] 2> 924250 T2084 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 924251 T2084 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 924251 T2084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 924255 T2084 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 924259 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 924259 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 924260 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 924630 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 924635 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52715
[junit4:junit4] 2> 924636 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 924637 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 924638 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917
[junit4:junit4] 2> 924638 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\solr.xml
[junit4:junit4] 2> 924638 T2025 oasc.CoreContainer.<init> New CoreContainer 582402736
[junit4:junit4] 2> 924639 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\'
[junit4:junit4] 2> 924639 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\'
[junit4:junit4] 2> 924764 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 924764 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 924765 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 924768 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 924769 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 924769 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 924770 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 924771 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 924771 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 924772 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 924784 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 924785 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 924785 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 924809 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 924831 T2097 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f1f54ab name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 924832 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 924838 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 924844 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 924854 T2099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@796ea166 name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 924855 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 924867 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 925842 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 925843 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52706_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52706_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52706/uru/q"}
[junit4:junit4] 2> 925852 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925854 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925854 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925855 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925855 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925858 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52715_uru%2Fq
[junit4:junit4] 2> 925860 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52715_uru%2Fq
[junit4:junit4] 2> 925865 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925867 T2054 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 925867 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 925867 T2067 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 925868 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 925869 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 925867 T2083 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 925869 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 925871 T2099 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 925876 T2047 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 925882 T2100 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 925882 T2100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 927343 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 927344 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52715_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52715/uru/q"}
[junit4:junit4] 2> 927344 T2048 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 927344 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 927362 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 927362 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 927363 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 927363 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 927363 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 927853 T2100 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\collection1
[junit4:junit4] 2> 927853 T2100 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 927854 T2100 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 927854 T2100 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 927858 T2100 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\collection1\'
[junit4:junit4] 2> 927859 T2100 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 927860 T2100 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917/collection1/lib/README' to classloader
[junit4:junit4] 2> 927916 T2100 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 927991 T2100 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 927994 T2100 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 927999 T2100 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 928653 T2100 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 928664 T2100 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 928667 T2100 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 928688 T2100 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 928693 T2100 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 928706 T2100 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 928708 T2100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 928709 T2100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 928709 T2100 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 928711 T2100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 928711 T2100 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 928711 T2100 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 928712 T2100 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1371682790917\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty3\
[junit4:junit4] 2> 928712 T2100 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 928712 T2100 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 928713 T2100 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty3
[junit4:junit4] 2> 928714 T2100 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty3\index/
[junit4:junit4] 2> 928715 T2100 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty3\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 928716 T2100 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty3\index
[junit4:junit4] 2> 928729 T2100 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty3\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 928729 T2100 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 928734 T2100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 928734 T2100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 928735 T2100 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 928736 T2100 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 928736 T2100 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 928736 T2100 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 928736 T2100 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 928738 T2100 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 928738 T2100 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 928749 T2100 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 928760 T2100 oass.SolrIndexSearcher.<init> Opening Searcher@6edf7ee0 main
[junit4:junit4] 2> 928762 T2100 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 928762 T2100 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 928769 T2101 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6edf7ee0 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 928771 T2100 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 928771 T2100 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52715/uru/q collection:collection1 shard:shard3
[junit4:junit4] 2> 928772 T2100 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4:junit4] 2> 928785 T2100 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 928791 T2100 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 928791 T2100 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 928792 T2100 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52715/uru/q/collection1/
[junit4:junit4] 2> 928792 T2100 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 928792 T2100 oasc.SyncStrategy.syncToMe http://127.0.0.1:52715/uru/q/collection1/ has no replicas
[junit4:junit4] 2> 928792 T2100 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52715/uru/q/collection1/
[junit4:junit4] 2> 928792 T2100 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4:junit4] 2> 928849 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 928866 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 928867 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 928867 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 928867 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 928868 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 928904 T2100 oasc.ZkController.register We are http://127.0.0.1:52715/uru/q/collection1/ and leader is http://127.0.0.1:52715/uru/q/collection1/
[junit4:junit4] 2> 928905 T2100 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52715/uru/q
[junit4:junit4] 2> 928905 T2100 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 928905 T2100 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 928905 T2100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 928909 T2100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 928911 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 928911 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 928911 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 929310 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 929315 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52724
[junit4:junit4] 2> 929317 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 929317 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 929318 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570
[junit4:junit4] 2> 929318 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\solr.xml
[junit4:junit4] 2> 929319 T2025 oasc.CoreContainer.<init> New CoreContainer 1122709658
[junit4:junit4] 2> 929319 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\'
[junit4:junit4] 2> 929319 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\'
[junit4:junit4] 2> 929437 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 929437 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 929438 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 929439 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 929439 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 929440 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 929440 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 929440 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 929441 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 929441 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 929448 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 929449 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 929449 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 929451 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 929480 T2113 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64af0cf8 name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 929481 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 929486 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 929492 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 929497 T2115 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16cd6b5a name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 929498 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 929507 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 930346 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 930347 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52715_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52715_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52715/uru/q"}
[junit4:junit4] 2> 930355 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930357 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930358 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930358 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930359 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930359 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930474 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52724_uru%2Fq
[junit4:junit4] 2> 930477 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52724_uru%2Fq
[junit4:junit4] 2> 930481 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930482 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 930483 T2054 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930483 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 930483 T2115 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930483 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 930483 T2083 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930484 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 930484 T2067 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930484 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 930489 T2047 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930490 T2099 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 930497 T2116 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 930497 T2116 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 931698 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 931699 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52724_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52724/uru/q"}
[junit4:junit4] 2> 931699 T2048 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 931699 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 931713 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 931714 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 931715 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 931714 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 931714 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 931714 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 932271 T2116 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\collection1
[junit4:junit4] 2> 932271 T2116 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 932273 T2116 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 932273 T2116 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 932276 T2116 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\collection1\'
[junit4:junit4] 2> 932277 T2116 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 932278 T2116 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570/collection1/lib/README' to classloader
[junit4:junit4] 2> 932331 T2116 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 932406 T2116 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 932410 T2116 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 932417 T2116 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 933018 T2116 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 933027 T2116 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 933030 T2116 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 933048 T2116 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 933062 T2116 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 933067 T2116 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 933070 T2116 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 933071 T2116 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 933071 T2116 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 933072 T2116 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 933072 T2116 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 933072 T2116 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 933073 T2116 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty4-1371682795570\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty4\
[junit4:junit4] 2> 933073 T2116 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 933073 T2116 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 933074 T2116 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4
[junit4:junit4] 2> 933075 T2116 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty4\index/
[junit4:junit4] 2> 933076 T2116 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 933076 T2116 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index
[junit4:junit4] 2> 933085 T2116 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 933085 T2116 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 933088 T2116 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 933088 T2116 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 933089 T2116 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 933090 T2116 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 933090 T2116 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 933091 T2116 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 933091 T2116 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 933091 T2116 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 933091 T2116 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 933101 T2116 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 933111 T2116 oass.SolrIndexSearcher.<init> Opening Searcher@a6f679a main
[junit4:junit4] 2> 933114 T2116 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 933114 T2116 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 933118 T2117 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a6f679a main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 933120 T2116 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 933120 T2116 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52724/uru/q collection:collection1 shard:shard1
[junit4:junit4] 2> 933125 T2116 oasc.ZkController.register We are http://127.0.0.1:52724/uru/q/collection1/ and leader is http://127.0.0.1:52697/uru/q/collection1/
[junit4:junit4] 2> 933126 T2116 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52724/uru/q
[junit4:junit4] 2> 933126 T2116 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 933126 T2116 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C4803 name=collection1 org.apache.solr.core.SolrCore@1d4c7f9c url=http://127.0.0.1:52724/uru/q/collection1 node=127.0.0.1:52724_uru%2Fq C4803_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52724_uru%2Fq, base_url=http://127.0.0.1:52724/uru/q}
[junit4:junit4] 2> 933127 T2118 C4803 P52724 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 933127 T2118 C4803 P52724 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 933128 T2118 C4803 P52724 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 933128 T2118 C4803 P52724 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 933128 T2116 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 933130 T2118 C4803 P52724 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 933131 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 933132 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 933132 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 933139 T2058 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52724_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 933520 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 933524 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52734
[junit4:junit4] 2> 933526 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 933527 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 933527 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787
[junit4:junit4] 2> 933527 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\solr.xml
[junit4:junit4] 2> 933527 T2025 oasc.CoreContainer.<init> New CoreContainer 1452558223
[junit4:junit4] 2> 933528 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\'
[junit4:junit4] 2> 933528 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\'
[junit4:junit4] 2> 933627 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 933628 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 933628 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 933628 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 933629 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 933629 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 933629 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 933629 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 933630 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 933630 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 933638 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 933638 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 933639 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 933641 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 933657 T2130 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32b67f28 name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 933658 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 933662 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 933662 T2027 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5eaa11bf000d, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 933670 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 933674 T2132 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bd3b0d5 name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 933674 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 933683 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 934396 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 934397 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52724_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52724_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52724/uru/q"}
[junit4:junit4] 2> 934406 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934407 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934408 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934408 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934408 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934408 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934409 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934574 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52734_uru%2Fq
[junit4:junit4] 2> 934577 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52734_uru%2Fq
[junit4:junit4] 2> 934580 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934581 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934582 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 934583 T2115 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934583 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 934583 T2083 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934584 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 934584 T2067 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934584 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 934584 T2054 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934585 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 934588 T2099 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934589 T2047 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934590 T2132 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4:junit4] 2> 934597 T2133 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 934597 T2133 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 934911 T2058 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52724_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 934911 T2058 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52724_uru%252Fq_collection1&state=recovering&nodeName=127.0.0.1:52724_uru%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1772
[junit4:junit4] 2> 935754 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 935756 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52734_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52734/uru/q"}
[junit4:junit4] 2> 935756 T2048 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 935756 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 935768 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 935769 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 936372 T2133 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\collection1
[junit4:junit4] 2> 936372 T2133 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 936372 T2133 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 936372 T2133 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 936375 T2133 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\collection1\'
[junit4:junit4] 2> 936377 T2133 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 936378 T2133 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787/collection1/lib/README' to classloader
[junit4:junit4] 2> 936426 T2133 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 936493 T2133 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 936495 T2133 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 936499 T2133 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C4804 name=collection1 org.apache.solr.core.SolrCore@1d4c7f9c url=http://127.0.0.1:52724/uru/q/collection1 node=127.0.0.1:52724_uru%2Fq C4804_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52724_uru%2Fq, base_url=http://127.0.0.1:52724/uru/q}
[junit4:junit4] 2> 936684 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52697/uru/q/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 936684 T2118 C4804 P52724 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52724/uru/q START replicas=[http://127.0.0.1:52697/uru/q/collection1/] nUpdates=100
[junit4:junit4] 2> 936684 T2118 C4804 P52724 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52697/uru/q/collection1/. core=collection1
[junit4:junit4] 2> 936686 T2118 C4804 P52724 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C4805 name=collection1 org.apache.solr.core.SolrCore@50f6880e url=http://127.0.0.1:52697/uru/q/collection1 node=127.0.0.1:52697_uru%2Fq C4805_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52697_uru%2Fq, base_url=http://127.0.0.1:52697/uru/q, leader=true}
[junit4:junit4] 2> 936702 T2060 C4805 P52697 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 936704 T2060 C4805 P52697 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 936710 T2060 C4805 P52697 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 936711 T2060 C4805 P52697 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 936717 T2060 C4805 P52697 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty1\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 936718 T2060 C4805 P52697 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 936719 T2060 C4805 P52697 oass.SolrIndexSearcher.<init> Opening Searcher@67e5e12e realtime
[junit4:junit4] 2> 936719 T2060 C4805 P52697 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 936720 T2060 C4805 P52697 oasup.LogUpdateProcessor.finish [collection1] webapp=/uru/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 16
[junit4:junit4] 2> 936722 T2118 C4804 P52724 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 936722 T2118 C4804 P52724 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 936725 T2062 C4805 P52697 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 936726 T2062 C4805 P52697 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 936726 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 936727 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 936727 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 936730 T2063 C4805 P52697 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=1
[junit4:junit4] 2> 936731 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 936734 T2118 C4804 P52724 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381
[junit4:junit4] 2> 936736 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5c3e4c35 fullCopy=false
[junit4:junit4] 2> 936739 T2059 C4805 P52697 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 936741 T2118 C4804 P52724 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 936746 T2118 C4804 P52724 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 936747 T2118 C4804 P52724 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 936752 T2118 C4804 P52724 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 936754 T2118 C4804 P52724 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 936754 T2118 C4804 P52724 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 936755 T2118 C4804 P52724 oass.SolrIndexSearcher.<init> Opening Searcher@319ddb6 main
[junit4:junit4] 2> 936756 T2117 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@319ddb6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 936756 T2118 C4804 P52724 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381;done=true>>]
[junit4:junit4] 2> 936756 T2118 C4804 P52724 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381
[junit4:junit4] 2> 936756 T2118 C4804 P52724 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty4\index.20130619210003381
[junit4:junit4] 2> 936758 T2118 C4804 P52724 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 936759 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 936759 T2118 C4804 P52724 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 936759 T2118 C4804 P52724 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 936762 T2118 C4804 P52724 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 937109 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 937110 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52724_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52724_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52724/uru/q"}
[junit4:junit4] 2> 937128 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937128 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937128 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937129 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937129 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937130 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937131 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 937166 T2133 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 937188 T2133 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 937192 T2133 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 937215 T2133 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 937228 T2133 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 937233 T2133 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 937236 T2133 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 937236 T2133 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 937236 T2133 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 937237 T2133 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 937237 T2133 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 937238 T2133 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 937238 T2133 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty5-1371682799787\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty5\
[junit4:junit4] 2> 937238 T2133 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 937239 T2133 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 937240 T2133 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5
[junit4:junit4] 2> 937241 T2133 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty5\index/
[junit4:junit4] 2> 937242 T2133 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 937242 T2133 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index
[junit4:junit4] 2> 937250 T2133 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 937250 T2133 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 937254 T2133 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 937255 T2133 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 937255 T2133 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 937256 T2133 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 937256 T2133 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 937256 T2133 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 937262 T2133 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 937262 T2133 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 937262 T2133 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 937272 T2133 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 937282 T2133 oass.SolrIndexSearcher.<init> Opening Searcher@7ee113e6 main
[junit4:junit4] 2> 937283 T2133 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 937283 T2133 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 937288 T2136 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ee113e6 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 937292 T2133 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 937292 T2133 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52734/uru/q collection:collection1 shard:shard2
[junit4:junit4] 2> 937298 T2133 oasc.ZkController.register We are http://127.0.0.1:52734/uru/q/collection1/ and leader is http://127.0.0.1:52706/uru/q/collection1/
[junit4:junit4] 2> 937298 T2133 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52734/uru/q
[junit4:junit4] 2> 937298 T2133 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 937298 T2133 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C4806 name=collection1 org.apache.solr.core.SolrCore@765e4e0e url=http://127.0.0.1:52734/uru/q/collection1 node=127.0.0.1:52734_uru%2Fq C4806_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52734_uru%2Fq, base_url=http://127.0.0.1:52734/uru/q}
[junit4:junit4] 2> 937299 T2137 C4806 P52734 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 937300 T2137 C4806 P52734 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 937300 T2137 C4806 P52734 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 937301 T2137 C4806 P52734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 937301 T2133 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 937303 T2137 C4806 P52734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 937304 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 937304 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 937305 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 937317 T2077 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52734_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 937683 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 937688 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52747
[junit4:junit4] 2> 937690 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 937690 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 937690 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964
[junit4:junit4] 2> 937690 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\solr.xml
[junit4:junit4] 2> 937690 T2025 oasc.CoreContainer.<init> New CoreContainer 1786260907
[junit4:junit4] 2> 937692 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\'
[junit4:junit4] 2> 937692 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\'
[junit4:junit4] 2> 937787 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 937787 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 937787 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 937788 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 937788 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 937788 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 937788 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 937789 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 937790 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 937790 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 937796 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 937797 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 937797 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 937800 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 937814 T2149 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d3ce1f7 name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 937815 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 937820 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 937820 T2027 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5eaa11bf000f, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 937829 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 937833 T2151 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13d592ac name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 937833 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 937843 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 938475 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 938476 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52734_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52734_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52734/uru/q"}
[junit4:junit4] 2> 938486 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938486 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938486 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938487 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938487 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938488 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938487 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938488 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938734 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52747_uru%2Fq
[junit4:junit4] 2> 938740 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52747_uru%2Fq
[junit4:junit4] 2> 938743 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938745 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938744 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 6)
[junit4:junit4] 2> 938747 T2115 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938747 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 938748 T2083 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938748 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 938749 T2067 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938749 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 938749 T2151 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938749 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 938749 T2054 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938749 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 938755 T2132 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938755 T2047 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938756 T2099 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4:junit4] 2> 938770 T2152 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 938770 T2152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 939089 T2077 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52734_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 939090 T2077 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=127.0.0.1:52734_uru%252Fq_collection1&state=recovering&nodeName=127.0.0.1:52734_uru%252Fq&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1773
[junit4:junit4] 2> 939756 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 939757 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52747_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52747/uru/q"}
[junit4:junit4] 2> 939757 T2048 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4:junit4] 2> 939757 T2048 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard3
[junit4:junit4] 2> 939764 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939766 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 939765 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940401 T2152 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\collection1
[junit4:junit4] 2> 940401 T2152 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 940402 T2152 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 940402 T2152 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 940405 T2152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\collection1\'
[junit4:junit4] 2> 940406 T2152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 940406 T2152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964/collection1/lib/README' to classloader
[junit4:junit4] 2> 940454 T2152 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_44
[junit4:junit4] 2> 940503 T2152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 940505 T2152 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 940509 T2152 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> ASYNC NEW_CORE C4807 name=collection1 org.apache.solr.core.SolrCore@765e4e0e url=http://127.0.0.1:52734/uru/q/collection1 node=127.0.0.1:52734_uru%2Fq C4807_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52734_uru%2Fq, base_url=http://127.0.0.1:52734/uru/q}
[junit4:junit4] 2> 940688 T2137 C4807 P52734 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:52706/uru/q/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 940688 T2137 C4807 P52734 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:52734/uru/q START replicas=[http://127.0.0.1:52706/uru/q/collection1/] nUpdates=100
[junit4:junit4] 2> 940689 T2137 C4807 P52734 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 940689 T2137 C4807 P52734 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 940690 T2137 C4807 P52734 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 940690 T2137 C4807 P52734 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 940690 T2137 C4807 P52734 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 940690 T2137 C4807 P52734 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:52706/uru/q/collection1/. core=collection1
[junit4:junit4] 2> 940690 T2137 C4807 P52734 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C4808 name=collection1 org.apache.solr.core.SolrCore@612341c0 url=http://127.0.0.1:52706/uru/q/collection1 node=127.0.0.1:52706_uru%2Fq C4808_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52706_uru%2Fq, base_url=http://127.0.0.1:52706/uru/q, leader=true}
[junit4:junit4] 2> 940701 T2079 C4808 P52706 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 940702 T2074 C4808 P52706 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 940711 T2074 C4808 P52706 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 940712 T2074 C4808 P52706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 940721 T2074 C4808 P52706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty2\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 940721 T2074 C4808 P52706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 940723 T2074 C4808 P52706 oass.SolrIndexSearcher.<init> Opening Searcher@59986230 realtime
[junit4:junit4] 2> 940723 T2074 C4808 P52706 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 940724 T2074 C4808 P52706 oasup.LogUpdateProcessor.finish [collection1] webapp=/uru/q path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 22
[junit4:junit4] 2> 940725 T2137 C4807 P52734 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 940725 T2137 C4807 P52734 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 940727 T2075 C4808 P52706 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 940727 T2075 C4808 P52706 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> ASYNC NEW_CORE C4809 name=collection1 org.apache.solr.core.SolrCore@765e4e0e url=http://127.0.0.1:52734/uru/q/collection1 node=127.0.0.1:52734_uru%2Fq C4809_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:52734_uru%2Fq, base_url=http://127.0.0.1:52734/uru/q}
[junit4:junit4] 2> 940735 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 940736 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 940736 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> ASYNC NEW_CORE C4810 name=collection1 org.apache.solr.core.SolrCore@612341c0 url=http://127.0.0.1:52706/uru/q/collection1 node=127.0.0.1:52706_uru%2Fq C4810_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:52706_uru%2Fq, base_url=http://127.0.0.1:52706/uru/q, leader=true}
[junit4:junit4] 2> 940743 T2076 C4810 P52706 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=4
[junit4:junit4] 2> 940744 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 940746 T2137 C4809 P52734 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394
[junit4:junit4] 2> 940746 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Starting download to org.apache.lucene.store.MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7d551ce7 fullCopy=false
[junit4:junit4] 2> 940749 T2078 C4810 P52706 oasc.SolrCore.execute [collection1] webapp=/uru/q path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 940751 T2137 C4809 P52734 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 940753 T2137 C4809 P52734 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 940754 T2137 C4809 P52734 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 940760 T2137 C4809 P52734 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index,segFN=segments_2,generation=2}
[junit4:junit4] 2> 940760 T2137 C4809 P52734 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 940760 T2137 C4809 P52734 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 940762 T2137 C4809 P52734 oass.SolrIndexSearcher.<init> Opening Searcher@612f079d main
[junit4:junit4] 2> 940763 T2136 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@612f079d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 940763 T2137 C4809 P52734 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394;done=true>>]
[junit4:junit4] 2> 940763 T2137 C4809 P52734 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394
[junit4:junit4] 2> 940763 T2137 C4809 P52734 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty5\index.20130619210007394
[junit4:junit4] 2> 940764 T2137 C4809 P52734 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 940764 T2137 C4809 P52734 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 940765 T2137 C4809 P52734 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 940765 T2137 C4809 P52734 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 940767 T2137 C4809 P52734 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 940971 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 940973 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52734_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52734_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52734/uru/q"}
[junit4:junit4] 2> 940981 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940982 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940982 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940983 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940983 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940984 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940984 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 940984 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 941075 T2152 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 941085 T2152 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 941087 T2152 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 941108 T2152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 941123 T2152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 941130 T2152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 941132 T2152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 941132 T2152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 941132 T2152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 941134 T2152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 941134 T2152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 941135 T2152 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 941136 T2152 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty6-1371682803964\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty6\
[junit4:junit4] 2> 941136 T2152 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@334cc8ce
[junit4:junit4] 2> 941136 T2152 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4:junit4] 2> 941138 T2152 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty6
[junit4:junit4] 2> 941139 T2152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374/jetty6\index/
[junit4:junit4] 2> 941140 T2152 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty6\index' doesn't exist. Creating new index...
[junit4:junit4] 2> 941141 T2152 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty6\index
[junit4:junit4] 2> 941152 T2152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\jetty6\index,segFN=segments_1,generation=1}
[junit4:junit4] 2> 941152 T2152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 941155 T2152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 941155 T2152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 941156 T2152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 941157 T2152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 941157 T2152 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 941157 T2152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 941161 T2152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 941162 T2152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 941162 T2152 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 941171 T2152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 941179 T2152 oass.SolrIndexSearcher.<init> Opening Searcher@ed96f5b main
[junit4:junit4] 2> 941182 T2152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 941182 T2152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 941185 T2155 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ed96f5b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 941186 T2152 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 941186 T2152 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52747/uru/q collection:collection1 shard:shard3
[junit4:junit4] 2> 941192 T2152 oasc.ZkController.register We are http://127.0.0.1:52747/uru/q/collection1/ and leader is http://127.0.0.1:52715/uru/q/collection1/
[junit4:junit4] 2> 941192 T2152 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52747/uru/q
[junit4:junit4] 2> 941192 T2152 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 941192 T2152 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C4811 name=collection1 org.apache.solr.core.SolrCore@2dadfed3 url=http://127.0.0.1:52747/uru/q/collection1 node=127.0.0.1:52747_uru%2Fq C4811_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:52747_uru%2Fq, base_url=http://127.0.0.1:52747/uru/q}
[junit4:junit4] 2> 941192 T2156 C4811 P52747 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 941193 T2156 C4811 P52747 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 941193 T2156 C4811 P52747 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 941193 T2156 C4811 P52747 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 941194 T2152 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 941196 T2156 C4811 P52747 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 941197 T2025 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4:junit4] 2> 941197 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 941198 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 941204 T2094 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:52747_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 941548 T2025 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 941552 T2025 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52760
[junit4:junit4] 2> 941553 T2025 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 941553 T2025 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 941554 T2025 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371682807853
[junit4:junit4] 2> 941554 T2025 oasc.CoreContainer$Initializer.initialize looking for solr config file: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371682807853\solr.xml
[junit4:junit4] 2> 941554 T2025 oasc.CoreContainer.<init> New CoreContainer 1201363271
[junit4:junit4] 2> 941555 T2025 oasc.CoreContainer.load Loading CoreContainer using Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371682807853\'
[junit4:junit4] 2> 941555 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty7-1371682807853\'
[junit4:junit4] 2> 941642 T2025 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 941642 T2025 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 941642 T2025 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 941643 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 941643 T2025 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 941643 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 941643 T2025 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 941644 T2025 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 941644 T2025 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 941645 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 941650 T2025 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 941651 T2025 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52678/solr
[junit4:junit4] 2> 941651 T2025 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 941653 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 941666 T2168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61ca7349 name:ZooKeeperConnection Watcher:127.0.0.1:52678 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 941667 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 941670 T2025 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 941670 T2027 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5eaa11bf0011, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 941677 T2025 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 941680 T2170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55a577ac name:ZooKeeperConnection Watcher:127.0.0.1:52678/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 941680 T2025 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 941688 T2025 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 942190 T2048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 942191 T2048 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52747_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard3",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52747_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52747/uru/q"}
[junit4:junit4] 2> 942214 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942215 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942215 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942215 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942216 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942216 T2170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942216 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942216 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942216 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942489 T2025 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52760_uru%2Fq
[junit4:junit4] 2> 942493 T2025 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52760_uru%2Fq
[junit4:junit4] 2> 942497 T2132 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942498 T2170 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942499 T2099 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942500 T2054 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942500 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 942500 T2047 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 7)
[junit4:junit4] 2> 942501 T2115 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942502 T2115 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 942502 T2083 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942502 T2083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 942503 T2067 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942503 T2067 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 942503 T2151 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942503 T2151 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 8)
[junit4:junit4] 2> 942503 T2132 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942506 T2170 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942507 T2099 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942510 T2047 oascc.ZkStateReader$3.process Updating live nodes... (8)
[junit4:junit4] 2> 942514 T2171 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 942515 T2171 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 942798 T2094 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:52747_uru%2Fq_collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 942798 T2094 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={
[...truncated too long message...]
teState Update state numShards=3 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:52806_uru%2Fq_collection1",
[junit4:junit4] 2> "numShards":"3",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:52806_uru%2Fq",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:52806/uru/q"}
[junit4:junit4] 2> 1122785 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1122785 T2313 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1122934 T2474 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89894602105880606-127.0.0.1:52817_uru%2Fq-n_0000000013) am no longer a leader.
[junit4:junit4] 2> 1122937 T2313 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1122938 T2313 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1122938 T2313 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1122938 T2054 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4:junit4] 2> 1122940 T2054 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 0)
[junit4:junit4] 2> 1122952 T2025 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/uru/q,null}
[junit4:junit4] 2> 1123006 T2027 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x13f5eaa11bf0004, likely client has closed socket
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4:junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] 2>
[junit4:junit4] 2> 1123007 T2025 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 52685
[junit4:junit4] 2> 1123164 T2393 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1123164 T2393 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\zookeeper\server1\data\version-2\log.1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\zookeeper\server1\data\version-2 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\zookeeper\server1\data FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\zookeeper\server1 FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374\zookeeper FAILED !!!!!
[junit4:junit4] 2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1371682771374 FAILED !!!!!
[junit4:junit4] 2> 1123457 T2025 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 1123461 T2025 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:52678 52678
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> safe stop:
[junit4:junit4] 1> safe stop:
[junit4:junit4] 2> 1125682 T2025 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 1236897 T2025 oas.SolrTestCaseJ4.endTrackingSearchers ERROR ERROR: SolrIndexSearcher opens=63 closes=62
[junit4:junit4] 2> NOTE: test params are: codec=Lucene40, sim=DefaultSimilarity, locale=uk_UA, timezone=Brazil/DeNoronha
[junit4:junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_21 (64-bit)/cpus=2,threads=2,free=25097176,total=236855296
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestMergePolicyConfig, XmlUpdateRequestHandlerTest, DebugComponentTest, TestUtils, TestIBSimilarityFactory, OpenExchangeRatesOrgProviderTest, TestQueryTypes, RAMDirectoryFactoryTest, TestLRUCache, TermVectorComponentTest, TestDefaultSimilarityFactory, TestLMJelinekMercerSimilarityFactory, DistributedSpellCheckComponentTest, TestSolrJ, HardAutoCommitTest, TimeZoneUtilsTest, EchoParamsTest, SliceStateTest, SoftAutoCommitTest, TestRecovery, TestFastLRUCache, DistanceFunctionTest, DisMaxRequestHandlerTest, PolyFieldTest, ResourceLoaderTest, TestCollationField, SpellPossibilityIteratorTest, TestConfig, BasicFunctionalityTest, DefaultValueUpdateProcessorTest, TestDocSet, ScriptEngineTest, TestUpdate, TestElisionMultitermQuery, DateMathParserTest, TestManagedSchemaFieldResource, SolrCmdDistributorTest, TestClassNameShortening, TestIndexSearcher, DirectSolrConnectionTest, TestIndexingPerformance, TestLFUCache, BasicZkTest, DocValuesTest, TestJmxMonitoredMap, TestSystemIdResolver, ShowFileRequestHandlerTest, DocValuesMultiTest, URLClassifyProcessorTest, TestFastWriter, TestSchemaSimilarityResource, TestExtendedDismaxParser, TestCodecSupport, TestPluginEnable, TestJoin, TestMultiCoreConfBootstrap, TestFiltering, CoreContainerCoreInitFailuresTest, TestFuzzyAnalyzedSuggestions, SolrIndexSplitterTest, TestZkChroot, TestStressVersions, StatsComponentTest, DistributedTermsComponentTest, TestFieldResource, AutoCommitTest, SpatialFilterTest, PluginInfoTest, DirectSolrSpellCheckerTest, SpellCheckCollatorTest, PathHierarchyTokenizerFactoryTest, OpenCloseCoreStressTest, CacheHeaderTest, TestSweetSpotSimilarityFactory, WordBreakSolrSpellCheckerTest, FieldAnalysisRequestHandlerTest, HighlighterTest, TestQuerySenderListener, DirectUpdateHandlerTest, ShardRoutingCustomTest, FileBasedSpellCheckerTest, IndexSchemaRuntimeFieldTest, TestQueryUtils, TestCSVLoader, TestLMDirichletSimilarityFactory, SampleTest, CachingDirectoryFactoryTest, TestJmxIntegration, TermsComponentTest, PreAnalyzedFieldTest, TestDFRSimilarityFactory, TestHashPartitioner, SolrPluginUtilsTest, MultiTermTest, BadIndexSchemaTest, TestSolrCoreProperties, TestCoreContainer, FullSolrCloudDistribCmdsTest, UpdateRequestProcessorFactoryTest, RegexBoostProcessorTest, JsonLoaderTest, UpdateParamsTest, TestFaceting, TestComponentsName, SolrCoreTest, TestTrie, CollectionsAPIDistributedZkTest, TestArbitraryIndexDir, LeaderElectionIntegrationTest, LoggingHandlerTest, TestSolrXml, CurrencyFieldOpenExchangeTest, IndexReaderFactoryTest, SolrInfoMBeanTest, CoreAdminHandlerTest, ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=6856F6E3C3FF0FD0 -Dtests.slow=true -Dtests.locale=uk_UA -Dtests.timezone=Brazil/DeNoronha -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=63 closes=62
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([6856F6E3C3FF0FD0]:0)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:254)
[junit4:junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:102)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] Completed in 332.26s, 1 test, 1 failure <<< FAILURES!
[...truncated 560 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:392: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:372: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:181: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:437: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1246: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:890: There were test failures: 298 suites, 1255 tests, 1 suite-level error, 18 ignored (12 assumptions)
Total time: 72 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_21 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure