You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/11/21 23:03:54 UTC
[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_45) - Build #
3491 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3491/
Java: 64bit/jdk1.7.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC
4 tests failed.
REGRESSION: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:64166/re/o, http://127.0.0.1:64157/re/o, http://127.0.0.1:64139/re/o, http://127.0.0.1:64148/re/o, http://127.0.0.1:64127/re/o]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:64166/re/o, http://127.0.0.1:64157/re/o, http://127.0.0.1:64139/re/o, http://127.0.0.1:64148/re/o, http://127.0.0.1:64127/re/o]
at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB:2D5A46BF9092D1E7]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:354)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:126)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:102)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletereplica the collection time out:60s
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
... 45 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
ERROR: SolrZkClient opens=15 closes=14
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
at sun.reflect.GeneratedMethodAccessor25.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest: 1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068) 2) Thread[id=1875, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest]
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
2) Thread[id=1875, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest] at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method) at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296) at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278) at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest]
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)
Build Log:
[...truncated 10160 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
[junit4] 2> 592964 T1788 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /re/o
[junit4] 2> 592983 T1788 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-DeleteReplicaTest-1385070941903
[junit4] 2> 592985 T1788 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 592987 T1789 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 593057 T1788 oasc.ZkTestServer.run start zk server on port:64120
[junit4] 2> 593058 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 593063 T1795 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@368394ff name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 593064 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 593064 T1788 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 593068 T1790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1427ca956d60000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 593071 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 593073 T1797 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7670fea8 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 593073 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 593074 T1788 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 593078 T1788 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 593082 T1788 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 593085 T1788 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 593089 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 593089 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 593096 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4] 2> 593096 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 593102 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 593102 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 593106 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 593106 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 593111 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 593112 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 593116 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 593116 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 593120 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 593120 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 593124 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 593124 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 593128 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 593128 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 593131 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 593131 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 593136 T1788 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 593136 T1788 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 593141 T1790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1427ca956d60001, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 593476 T1788 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 593481 T1788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64127
[junit4] 2> 593481 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 593481 T1788 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 593481 T1788 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062
[junit4] 2> 593481 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\'
[junit4] 2> 593503 T1788 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\solr.xml
[junit4] 2> 593564 T1788 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 593564 T1788 oasc.CoreContainer.<init> New CoreContainer 1823435003
[junit4] 2> 593564 T1788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\]
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 593566 T1788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 593569 T1788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 593571 T1788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 593571 T1788 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 593571 T1788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64120/solr
[junit4] 2> 593571 T1788 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 593572 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 593578 T1808 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78c5250b name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 593579 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 593584 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 593586 T1810 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b4f5092 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 593586 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 593589 T1788 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 593595 T1788 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 593599 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 593602 T1788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64127_re%2Fo
[junit4] 2> 593604 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64127_re%2Fo
[junit4] 2> 593608 T1788 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 593617 T1788 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 593621 T1788 oasc.Overseer.start Overseer (id=90772009249013763-127.0.0.1:64127_re%2Fo-n_0000000000) starting
[junit4] 2> 593628 T1788 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 593638 T1812 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 593639 T1788 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 593645 T1788 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 593649 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 593654 T1811 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 593660 T1788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062
[junit4] 2> 593848 T1788 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\conf\
[junit4] 2> 593856 T1788 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 593857 T1788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 593857 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 593861 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 593864 T1815 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36acd8f7 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 593864 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 593865 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 593868 T1788 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 594279 T1788 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 594282 T1788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64139
[junit4] 2> 594283 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 594283 T1788 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 594283 T1788 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787
[junit4] 2> 594283 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\'
[junit4] 2> 594309 T1788 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\solr.xml
[junit4] 2> 594387 T1788 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 594387 T1788 oasc.CoreContainer.<init> New CoreContainer 800630818
[junit4] 2> 594388 T1788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\]
[junit4] 2> 594390 T1788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 594390 T1788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 594390 T1788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 594391 T1788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 594393 T1788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 594393 T1788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 594395 T1788 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 594395 T1788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64120/solr
[junit4] 2> 594395 T1788 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 594397 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 594403 T1826 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18da555d name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 594404 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 594409 T1790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1427ca956d60005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 594412 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 594415 T1828 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c74d71e name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 594415 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 594422 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 595200 T1788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64139_re%2Fo
[junit4] 2> 595201 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64139_re%2Fo
[junit4] 2> 595207 T1810 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 595208 T1828 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 595209 T1815 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 595218 T1788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787
[junit4] 2> 595438 T1788 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\conf\
[junit4] 2> 595447 T1788 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 595447 T1788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 595447 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 595821 T1788 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 595825 T1788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64148
[junit4] 2> 595826 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 595827 T1788 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 595827 T1788 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369
[junit4] 2> 595827 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\'
[junit4] 2> 595846 T1788 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\solr.xml
[junit4] 2> 595902 T1788 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 595902 T1788 oasc.CoreContainer.<init> New CoreContainer 1125406568
[junit4] 2> 595902 T1788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\]
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 595904 T1788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 595906 T1788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 595907 T1788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 595909 T1788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 595909 T1788 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 595909 T1788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64120/solr
[junit4] 2> 595909 T1788 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 595911 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 595917 T1840 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34ff7a60 name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 595917 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 595920 T1790 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1427ca956d60007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 595923 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 595926 T1842 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b894d73 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 595926 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 595932 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 596710 T1788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64148_re%2Fo
[junit4] 2> 596712 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64148_re%2Fo
[junit4] 2> 596718 T1815 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 596719 T1828 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 596719 T1810 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 596719 T1842 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 596729 T1788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369
[junit4] 2> 596883 T1788 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\conf\
[junit4] 2> 596891 T1788 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 596893 T1788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 596893 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 597254 T1788 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 597258 T1788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64157
[junit4] 2> 597260 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 597260 T1788 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 597260 T1788 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815
[junit4] 2> 597260 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\'
[junit4] 2> 597281 T1788 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\solr.xml
[junit4] 2> 597347 T1788 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 597347 T1788 oasc.CoreContainer.<init> New CoreContainer 1000186864
[junit4] 2> 597348 T1788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\]
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 597349 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 597350 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 597350 T1788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 597350 T1788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 597354 T1788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 597355 T1788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 597355 T1788 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 597355 T1788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64120/solr
[junit4] 2> 597356 T1788 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 597357 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 597361 T1854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5060fd45 name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 597362 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 597366 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 597369 T1856 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@67b8aa6a name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 597369 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 597376 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 598155 T1788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64157_re%2Fo
[junit4] 2> 598157 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64157_re%2Fo
[junit4] 2> 598162 T1815 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 598162 T1828 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 598162 T1842 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 598163 T1810 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 598164 T1856 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 598172 T1788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815
[junit4] 2> 598359 T1788 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\conf\
[junit4] 2> 598368 T1788 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 598369 T1788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 598369 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 598753 T1788 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 598756 T1788 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64166
[junit4] 2> 598757 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 598757 T1788 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 598757 T1788 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291
[junit4] 2> 598757 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291\'
[junit4] 2> 598782 T1788 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291\solr.xml
[junit4] 2> 598844 T1788 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 598844 T1788 oasc.CoreContainer.<init> New CoreContainer 1953197151
[junit4] 2> 598844 T1788 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291\]
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 598846 T1788 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 598848 T1788 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 598848 T1788 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 598848 T1788 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 598848 T1788 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64120/solr
[junit4] 2> 598850 T1788 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 598852 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 598861 T1868 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bbf5099 name:ZooKeeperConnection Watcher:127.0.0.1:64120 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 598862 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 598866 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 598869 T1870 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64a54ee1 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 598869 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 598875 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 599653 T1788 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64166_re%2Fo
[junit4] 2> 599655 T1788 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64166_re%2Fo
[junit4] 2> 599660 T1828 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599662 T1842 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599663 T1815 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599663 T1870 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599663 T1810 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599663 T1856 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 599672 T1788 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291
[junit4] 2> 599843 T1788 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty4-1385070947291\conf\
[junit4] 2> 599852 T1788 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 599854 T1788 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 599854 T1788 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 599859 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 599861 T1873 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@794440cd name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 599862 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 599863 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 599868 T1788 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 599871 T1875 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41fbad3 name:ZooKeeperConnection Watcher:127.0.0.1:64120/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 599872 T1788 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 599873 T1788 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 599879 T1822 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=delLiveColl&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 599880 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599882 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599882 T1812 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 599882 T1812 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delLiveColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 599888 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599890 T1811 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 599891 T1811 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl
[junit4] 2> 599891 T1811 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2]
[junit4] 2> 599894 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599896 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599897 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599897 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599897 T1810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599898 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599898 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599899 T1875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599898 T1873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 599965 T1812 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 599966 T1812 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:64148_re%2Fo
[junit4] 2> 599967 T1812 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:64157_re%2Fo
[junit4] 2> 599967 T1812 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:64139_re%2Fo
[junit4] 2> 599968 T1812 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:64127_re%2Fo
[junit4] 2> 599971 T1834 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down
[junit4] 2> 599971 T1851 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down
[junit4] 2> 599973 T1823 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down
[junit4] 2> 599975 T1805 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down
[junit4] 2> 599975 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599975 T1834 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 599975 T1851 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 599976 T1823 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 599977 T1805 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 599978 T1811 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 599979 T1811 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64148/re/o",
[junit4] 2> "core":"delLiveColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64148_re%2Fo",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 599983 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599984 T1811 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64157/re/o",
[junit4] 2> "core":"delLiveColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64157_re%2Fo",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 599987 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599989 T1811 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64139/re/o",
[junit4] 2> "core":"delLiveColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64139_re%2Fo",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 599993 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 599994 T1811 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:64127/re/o",
[junit4] 2> "core":"delLiveColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:64127_re%2Fo",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delLiveColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 599998 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 600079 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600080 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600080 T1875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600080 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600082 T1810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600080 T1873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600082 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600080 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 600749 T1834 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
[junit4] 2> 600749 T1851 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
[junit4] 2> 600750 T1851 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\delLiveColl_shard1_replica2
[junit4] 2> 600750 T1851 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 600750 T1823 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
[junit4] 2> 600751 T1805 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
[junit4] 2> 600750 T1834 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1
[junit4] 2> 600751 T1834 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 600752 T1851 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 600752 T1851 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 600754 T1834 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 600754 T1834 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 600755 T1805 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2
[junit4] 2> 600755 T1805 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 600756 T1851 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 600756 T1851 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 600757 T1834 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 600757 T1834 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 600757 T1805 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delLiveColl
[junit4] 2> 600758 T1805 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 600759 T1823 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard2_replica1' using instanceDir: .\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1
[junit4] 2> 600759 T1823 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
[junit4] 2> 600761 T1805 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 600762 T1805 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
[junit4] 2> 600762 T1823 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 600762 T1823 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 600762 T1851 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 600764 T1834 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 600766 T1851 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty3-1385070945815\delLiveColl_shard1_replica2\'
[junit4] 2> 600766 T1823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\'
[junit4] 2> 600768 T1834 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\'
[junit4] 2> 600770 T1805 oasc.ZkController.readConfigName Load collection config from:/collections/delLiveColl
[junit4] 2> 600771 T1805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\'
[junit4] 2> 600853 T1834 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 600855 T1823 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 600917 T1834 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 600920 T1805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 600960 T1823 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 600975 T1805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 600979 T1823 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 600979 T1805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 600988 T1823 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
[junit4] 2> 600991 T1805 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
[junit4] 2> 601005 T1834 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 601014 T1834 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
[junit4] 2> 601072 T1851 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 601148 T1851 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 601264 T1851 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 601337 T1851 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
[junit4] 2> 601596 T1834 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 601604 T1834 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 601607 T1834 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 601923 T1834 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 601932 T1834 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 601938 T1834 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 601943 T1834 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 601944 T1834 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 601944 T1834 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 602016 T1834 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 602016 T1834 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 602016 T1834 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 602016 T1834 oasc.SolrCore.<init> [delLiveColl_shard1_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\data\
[junit4] 2> 602016 T1834 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d8a080e
[junit4] 2> 602017 T1834 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\data\
[junit4] 2> 602017 T1834 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\data\index/
[junit4] 2> 602017 T1834 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\data\index' doesn't exist. Creating new index...
[junit4] 2> 602019 T1834 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteReplicaTest-jetty2-1385070944369\delLiveColl_shard1_replica1\data\index
[junit4] 2> 602020 T1834 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2307039322162229]
[junit4] 2> 602020 T1834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2e71e6ad lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e4bd736),segFN=segments_1,generation=1}
[junit4] 2> 602021 T1834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 602025 T1834 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 602026 T1834 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 602026 T1834 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 602026 T1834 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 602027 T1834 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 602027 T1834 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 602029 T1834 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 602029 T1834 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 602029 T1834 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 602030 T1834 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 602031 T1834 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 602031 T1834 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 602031 T1834 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 602031 T1834 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 602032 T1834 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 602032 T1834 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 602154 T1834 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 602162 T1834 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 602163 T1834 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 602164 T1834 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=31, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=32.892578125, floorSegmentMB=1.3955078125, forceMergeDeletesPctAllowed=6.893335893694509, segmentsPerTier=25.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 602164 T1834 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@2e71e6ad lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4e4bd736),segFN=segments_1,generation=1}
[junit4] 2> 602164 T1834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 602164 T1834 oass.SolrIndexSearcher.<init> Opening Searcher@6670ca28 main
[junit4] 2> 602169 T1880 oasc.SolrCore.registerSearcher [delLiveColl_shard1_replica1] Registered new searcher Searcher@6670ca28 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 602171 T1834 oasc.CoreContainer.registerCore registering core: delLiveColl_shard1_replica1
[junit4] 2> 602171 T1834 oasc.ZkController.register Register replica - core:delLiveColl_shard1_replica1 address:http://127.0.0.1:64148/re/o collection:delLiveColl shard:shard1
[junit4] 2> 602321 T1823 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 602326 T1823 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 602330 T1823 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 602341 T1805 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 602373 T1805 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 602378 T1805 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 602385 T1834 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard1/election
[junit4] 2> 602469 T1834 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 602473 T1823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 602474 T1851 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 602481 T1823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 602482 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 602486 T1851 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 602489 T1851 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 602493 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 602493 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 602493 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 602494 T1834 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=179999
[junit4] 2> 602498 T1823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 602503 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 602503 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 602503 T1823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 602504 T1811 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 602504 T1805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 602506 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 602506 T1823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 602506 T1823 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 602507 T1823 oasc.SolrCore.<init> [delLiveColl_shard2_replica1] Opening new SolrCore at .\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\, dataDir=.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\data\
[junit4] 2> 602507 T1823 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d8a080e
[junit4] 2> 602508 T1823 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\data\
[junit4] 2> 602508 T1823 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\data\index/
[junit4] 2> 602508 T1823 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica1] Solr index directory '.\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\data\index' doesn't exist. Creating new index...
[junit4] 2> 602510 T1823 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteReplicaTest-jetty1-1385070942787\delLiveColl_shard2_replica1\data\index
[junit4] 2> 602511 T1823 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2307039322162229]
[junit4] 2> 602511 T1823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3a14c2e8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2e4800f3),segFN=segments_1,generation=1}
[junit4] 2> 602511 T1823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 602515 T1805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 602515 T1823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 602516 T1823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 602518 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 602518 T1823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 602518 T1810 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 602519 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 602519 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 602520 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 602521 T1805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 602522 T1870 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602522 T1842 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602523 T1828 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602523 T1856 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602523 T1810 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602519 T1823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 602523 T1875 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602524 T1823 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 602524 T1823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 602524 T1823 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 602525 T1823 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 602527 T1823 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 602527 T1823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 602527 T1823 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 602523 T1873 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602523 T1815 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 602529 T1823 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 602529 T1823 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 602530 T1823 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 602532 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 602532 T1805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 602532 T1823 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 602532 T1805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 602534 T1805 oasc.SolrCore.<init> [delLiveColl_shard2_replica2] Opening new SolrCore at .\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\, dataDir=.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\data\
[junit4] 2> 602534 T1805 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5d8a080e
[junit4] 2> 602535 T1805 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\data\
[junit4] 2> 602535 T1805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\data\index/
[junit4] 2> 602535 T1805 oasc.SolrCore.initIndex WARN [delLiveColl_shard2_replica2] Solr index directory '.\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\data\index' doesn't exist. Creating new index...
[junit4] 2> 602536 T1805 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteReplicaTest-controljetty-1385070942062\delLiveColl_shard2_replica2\data\index
[junit4] 2> 602537 T1805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=47, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2307039322162229]
[junit4] 2> 602537 T1851 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 602538 T1805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@7a415f0d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3bf1c3dc),se
[...truncated too long message...]
Session 0x1427ca956d6000e for server null, unexpected error, closing socket connection and attempting reconnect java.nio.channels.ClosedByInterruptException
[junit4] 2> at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:202)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:771)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2>
[junit4] 2> 983318 T1874 oaz.ClientCnxn$SendThread.run WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2>
[junit4] 2> 983819 T1874 oazc.StaticHostProvider.next WARN Unexpected exception java.lang.InterruptedException: sleep interrupted
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] 2>
[junit4] 2> 391356 T1787 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest]
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] 2> NOTE: test params are: codec=Lucene42, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=ar_OM, timezone=Etc/GMT-4
[junit4] 2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_45 (64-bit)/cpus=2,threads=2,free=116730080,total=309329920
[junit4] 2> NOTE: All tests run in this JVM: [OpenCloseCoreStressTest, CoreMergeIndexesAdminHandlerTest, TestElisionMultitermQuery, PathHierarchyTokenizerFactoryTest, OutputWriterTest, TestSolrXMLSerializer, TestSolrQueryParser, BlockDirectoryTest, TestLazyCores, FieldFacetExtrasTest, SchemaVersionSpecificBehaviorTest, TestStressLucene, TestUniqueKeyFieldResource, HdfsUnloadDistributedZkTest, TestDefaultSearchFieldResource, TestCloudManagedSchema, TestXIncludeConfig, DOMUtilTest, DistributedTermsComponentTest, PingRequestHandlerTest, SearchHandlerTest, UnloadDistributedZkTest, StatsComponentTest, TestConfig, TestRandomMergePolicy, DirectUpdateHandlerTest, FunctionTest, TestDynamicFieldResource, SortByFunctionTest, TestSolrXmlPersistor, TestCodecSupport, FieldMutatingUpdateProcessorTest, EchoParamsTest, TestBinaryField, TestSolrQueryParserDefaultOperatorResource, TestSchemaVersionResource, SolrTestCaseJ4Test, DeleteShardTest, BasicFunctionalityTest, XsltUpdateRequestHandlerTest, NotRequiredUniqueKeyTest, RegexBoostProcessorTest, BasicDistributedZkTest, TestDistribDocBasedVersion, SpellCheckComponentTest, RequiredFieldsTest, TestSolrQueryParserResource, FieldFacetTest, TestCollationField, TestSweetSpotSimilarityFactory, TestJmxIntegration, TestFastWriter, NoCacheHeaderTest, ShowFileRequestHandlerTest, MoreLikeThisHandlerTest, DateMathParserTest, CoreAdminHandlerTest, TestCopyFieldCollectionResource, TestFieldTypeCollectionResource, TestLRUCache, AddSchemaFieldsUpdateProcessorFactoryTest, InfoHandlerTest, OverseerCollectionProcessorTest, ParsingFieldUpdateProcessorsTest, SpellPossibilityIteratorTest, DistanceFunctionTest, TestQueryTypes, TestReloadAndDeleteDocs, QueryResultKeyTest, TestExtendedDismaxParser, SolrCmdDistributorTest, LoggingHandlerTest, TestAnalyzeInfixSuggestions, LeaderElectionTest, TestJmxMonitoredMap, CSVRequestHandlerTest, TestFaceting, DeleteReplicaTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.seed=ACBCC8A7E7CDB1DB -Dtests.slow=true -Dtests.locale=ar_OM -Dtests.timezone=Etc/GMT-4 -Dtests.file.encoding=Cp1252
[junit4] ERROR 0.00s | DeleteReplicaTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
[junit4] > at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
[junit4] > at java.lang.Thread.run(Thread.java:744)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
[junit4] > 1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest]
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
[junit4] > at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] > 2) Thread[id=1875, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] > at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=1874, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[ACBCC8A7E7CDB1DB]-SendThread(127.0.0.1:64120), state=RUNNABLE, group=TGRP-DeleteReplicaTest]
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
[junit4] > at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
[junit4] > at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] > at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4] > at __randomizedtesting.SeedInfo.seed([ACBCC8A7E7CDB1DB]:0)
[junit4] Completed in 391.39s, 1 test, 1 failure, 3 errors <<< FAILURES!
[...truncated 808 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:489: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1272: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 349 suites, 1551 tests, 3 suite-level errors, 1 error, 1132 ignored (4 assumptions)
Total time: 42 minutes 4 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_45 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_45) - Build #
3492 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3492/
Java: 32bit/jdk1.7.0_45 -server -XX:+UseParallelGC
5 tests failed.
FAILED: org.apache.solr.cloud.DeleteInactiveReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:56075/a_av/dx, http://127.0.0.1:56045/a_av/dx]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:56075/a_av/dx, http://127.0.0.1:56045/a_av/dx]
at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1:7C35F1E1EC2E07DD]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:354)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteInactiveReplicaTest.deleteInactiveReplicaTest(DeleteInactiveReplicaTest.java:120)
at org.apache.solr.cloud.DeleteInactiveReplicaTest.doTest(DeleteInactiveReplicaTest.java:43)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletereplica the collection unkown case
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
... 45 more
FAILED: org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:58577/cfx, http://127.0.0.1:58556/cfx, http://127.0.0.1:58595/cfx, http://127.0.0.1:58586/cfx, http://127.0.0.1:58568/cfx]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:58577/cfx, http://127.0.0.1:58556/cfx, http://127.0.0.1:58595/cfx, http://127.0.0.1:58586/cfx, http://127.0.0.1:58568/cfx]
at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1:7C35F1E1EC2E07DD]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:354)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:138)
at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:126)
at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:102)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:835)
at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: deletereplica the collection time out:60s
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:491)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:197)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:285)
... 44 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
ERROR: SolrZkClient opens=15 closes=14
Stack Trace:
java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
at sun.reflect.GeneratedMethodAccessor22.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest: 1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993) 2) Thread[id=9472, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
2) Thread[id=9472, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DeleteReplicaTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)
Build Log:
[...truncated 10408 lines...]
[junit4] Suite: org.apache.solr.cloud.DeleteInactiveReplicaTest
[junit4] 2> 1366106 T4383 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /a_av/dx
[junit4] 2> 1366122 T4383 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-DeleteInactiveReplicaTest-1385095237201
[junit4] 2> 1366122 T4383 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1366122 T4384 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1366231 T4383 oasc.ZkTestServer.run start zk server on port:56038
[junit4] 2> 1366231 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366231 T4390 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cc271c name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366231 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366231 T4383 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1366247 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366247 T4392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5288b3 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366247 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366247 T4383 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1366247 T4383 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1366247 T4383 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1366263 T4383 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1366263 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1366263 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1366263 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1366263 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1366278 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1366278 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1366278 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1366278 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1366278 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1366278 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1366278 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1366278 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1366294 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1366294 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1366294 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1366294 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1366294 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1366294 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1366309 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1366309 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1366309 T4383 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1366309 T4383 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1366747 T4383 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1366763 T4383 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56045
[junit4] 2> 1366763 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1366763 T4383 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1366763 T4383 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404
[junit4] 2> 1366763 T4383 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\'
[junit4] 2> 1366778 T4383 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\solr.xml
[junit4] 2> 1366856 T4383 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1366856 T4383 oasc.CoreContainer.<init> New CoreContainer 9458250
[junit4] 2> 1366856 T4383 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\]
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1366856 T4383 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1366856 T4383 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1366856 T4383 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1366856 T4383 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1366856 T4383 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56038/solr
[junit4] 2> 1366856 T4383 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1366856 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366872 T4403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c00275 name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366872 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366872 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1366872 T4405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef6561 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1366872 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1366872 T4383 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1366888 T4383 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1366888 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1366888 T4383 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56045_a_av%2Fdx
[junit4] 2> 1366888 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56045_a_av%2Fdx
[junit4] 2> 1366888 T4383 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1366903 T4383 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1366903 T4383 oasc.Overseer.start Overseer (id=90773601466253315-127.0.0.1:56045_a_av%2Fdx-n_0000000000) starting
[junit4] 2> 1366903 T4383 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1366919 T4407 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1366919 T4383 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1366919 T4383 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1366919 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1366919 T4406 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1366934 T4383 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404
[junit4] 2> 1367153 T4383 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\conf\
[junit4] 2> 1367153 T4383 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1367153 T4383 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1367153 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1367169 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1367169 T4410 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@decea2 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1367169 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1367169 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1367169 T4383 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1367591 T4383 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1367591 T4383 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56057
[junit4] 2> 1367591 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1367591 T4383 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1367591 T4383 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248
[junit4] 2> 1367591 T4383 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\'
[junit4] 2> 1367622 T4383 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\solr.xml
[junit4] 2> 1367684 T4383 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1367684 T4383 oasc.CoreContainer.<init> New CoreContainer 22590055
[junit4] 2> 1367684 T4383 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\]
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1367684 T4383 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1367684 T4383 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1367684 T4383 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1367684 T4383 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1367684 T4383 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56038/solr
[junit4] 2> 1367684 T4383 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1367700 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1367700 T4421 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9c11aa name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1367700 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1367716 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1367716 T4423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1140b6e name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1367716 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1367731 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1368731 T4383 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56057_a_av%2Fdx
[junit4] 2> 1368731 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56057_a_av%2Fdx
[junit4] 2> 1368731 T4410 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1368731 T4423 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1368731 T4405 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1368747 T4383 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248
[junit4] 2> 1368950 T4383 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\conf\
[junit4] 2> 1368966 T4383 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1368966 T4383 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1368966 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1369403 T4383 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1369403 T4383 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56066
[junit4] 2> 1369403 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1369403 T4383 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1369403 T4383 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045
[junit4] 2> 1369403 T4383 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\'
[junit4] 2> 1369434 T4383 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\solr.xml
[junit4] 2> 1369497 T4383 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1369497 T4383 oasc.CoreContainer.<init> New CoreContainer 27059591
[junit4] 2> 1369497 T4383 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\]
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1369497 T4383 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1369497 T4383 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1369497 T4383 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1369497 T4383 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1369497 T4383 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56038/solr
[junit4] 2> 1369497 T4383 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1369497 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1369513 T4435 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4fd3e5 name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1369513 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1369528 T4385 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1427e1c0e610007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 1369528 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1369528 T4437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d48ffd name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1369528 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1369528 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1370544 T4383 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56066_a_av%2Fdx
[junit4] 2> 1370544 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56066_a_av%2Fdx
[junit4] 2> 1370544 T4410 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1370544 T4405 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1370544 T4437 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1370544 T4423 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1370559 T4383 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045
[junit4] 2> 1370763 T4383 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\conf\
[junit4] 2> 1370778 T4383 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1370778 T4383 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1370778 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1371200 T4383 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1371200 T4383 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56075
[junit4] 2> 1371200 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1371200 T4383 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1371200 T4383 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857
[junit4] 2> 1371200 T4383 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857\'
[junit4] 2> 1371231 T4383 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857\solr.xml
[junit4] 2> 1371294 T4383 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1371294 T4383 oasc.CoreContainer.<init> New CoreContainer 19536994
[junit4] 2> 1371294 T4383 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857\]
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1371294 T4383 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1371294 T4383 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1371294 T4383 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1371294 T4383 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1371294 T4383 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56038/solr
[junit4] 2> 1371309 T4383 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1371309 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1371309 T4449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@651795 name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1371325 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1371325 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1371325 T4451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a24bd5 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1371325 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1371325 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1372341 T4383 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56075_a_av%2Fdx
[junit4] 2> 1372341 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56075_a_av%2Fdx
[junit4] 2> 1372341 T4410 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1372341 T4405 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1372341 T4437 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1372341 T4451 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1372341 T4423 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1372356 T4383 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857
[junit4] 2> 1372559 T4383 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty3-1385095241857\conf\
[junit4] 2> 1372575 T4383 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1372575 T4383 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1372575 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1372997 T4383 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1372997 T4383 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56084
[junit4] 2> 1372997 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1372997 T4383 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1372997 T4383 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654
[junit4] 2> 1372997 T4383 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\'
[junit4] 2> 1373028 T4383 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\solr.xml
[junit4] 2> 1373091 T4383 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1373091 T4383 oasc.CoreContainer.<init> New CoreContainer 25161025
[junit4] 2> 1373091 T4383 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\]
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1373091 T4383 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1373106 T4383 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1373106 T4383 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1373106 T4383 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1373106 T4383 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56038/solr
[junit4] 2> 1373106 T4383 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1373106 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1373106 T4463 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12d25ac name:ZooKeeperConnection Watcher:127.0.0.1:56038 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1373106 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1373122 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1373122 T4465 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166e346 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1373122 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1373122 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1374138 T4383 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56084_a_av%2Fdx
[junit4] 2> 1374138 T4383 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56084_a_av%2Fdx
[junit4] 2> 1374138 T4405 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374138 T4437 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374138 T4451 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374138 T4465 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374138 T4423 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374138 T4410 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1374153 T4383 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654
[junit4] 2> 1374356 T4383 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\conf\
[junit4] 2> 1374372 T4383 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1374372 T4383 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
[junit4] 2> 1374372 T4383 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1374372 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1374388 T4468 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1562fb7 name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1374388 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1374388 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1374388 T4383 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1374388 T4470 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@117de8b name:ZooKeeperConnection Watcher:127.0.0.1:56038/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1374388 T4383 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1374388 T4383 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1374403 T4396 oasha.CollectionsHandler.handleCreateAction Creating Collection : numShards=2&maxShardsPerNode=2&name=delDeadColl&replicationFactor=2&action=CREATE&wt=javabin&version=2
[junit4] 2> 1374403 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374403 T4407 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delDeadColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1374403 T4407 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"delDeadColl",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"2",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1374419 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374419 T4406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374419 T4406 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delDeadColl
[junit4] 2> 1374419 T4406 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delDeadColl with shards [shard1, shard2]
[junit4] 2> 1374419 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374434 T4468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374434 T4423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374528 T4407 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 1374528 T4407 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard1_replica1 as part of slice shard1 of collection delDeadColl on 127.0.0.1:56045_a_av%2Fdx
[junit4] 2> 1374528 T4407 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard1_replica2 as part of slice shard1 of collection delDeadColl on 127.0.0.1:56066_a_av%2Fdx
[junit4] 2> 1374528 T4407 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard2_replica1 as part of slice shard2 of collection delDeadColl on 127.0.0.1:56084_a_av%2Fdx
[junit4] 2> 1374528 T4407 oasc.OverseerCollectionProcessor.createCollection Creating shard delDeadColl_shard2_replica2 as part of slice shard2 of collection delDeadColl on 127.0.0.1:56057_a_av%2Fdx
[junit4] 2> 1374544 T4428 oasc.ZkController.publish publishing core=delDeadColl_shard1_replica2 state=down
[junit4] 2> 1374544 T4419 oasc.ZkController.publish publishing core=delDeadColl_shard2_replica2 state=down
[junit4] 2> 1374544 T4459 oasc.ZkController.publish publishing core=delDeadColl_shard2_replica1 state=down
[junit4] 2> 1374544 T4398 oasc.ZkController.publish publishing core=delDeadColl_shard1_replica1 state=down
[junit4] 2> 1374559 T4428 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1374559 T4398 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1374559 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374559 T4419 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1374559 T4459 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1374559 T4406 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1374559 T4406 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56066/a_av/dx",
[junit4] 2> "core":"delDeadColl_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56066_a_av%2Fdx",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1374575 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374575 T4406 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56057/a_av/dx",
[junit4] 2> "core":"delDeadColl_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56057_a_av%2Fdx",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1374575 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374575 T4406 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56084/a_av/dx",
[junit4] 2> "core":"delDeadColl_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56084_a_av%2Fdx",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1374575 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374575 T4406 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56045/a_av/dx",
[junit4] 2> "core":"delDeadColl_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56045_a_av%2Fdx",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"delDeadColl",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1374591 T4405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1374700 T4468 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4410 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4437 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4405 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4465 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1374700 T4470 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 1375559 T4398 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard1_replica1
[junit4] 2> 1375559 T4459 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard2_replica1
[junit4] 2> 1375559 T4419 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard2_replica2
[junit4] 2> 1375559 T4428 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delDeadColl_shard1_replica2
[junit4] 2> 1375559 T4419 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard2_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\delDeadColl_shard2_replica2
[junit4] 2> 1375559 T4428 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard1_replica2' using instanceDir: .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2
[junit4] 2> 1375559 T4419 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1375559 T4428 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1375559 T4398 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1
[junit4] 2> 1375559 T4398 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1375559 T4459 oasc.CoreContainer.create Creating SolrCore 'delDeadColl_shard2_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1
[junit4] 2> 1375559 T4459 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delDeadColl
[junit4] 2> 1375559 T4428 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1375559 T4428 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1375559 T4419 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1375559 T4419 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1375559 T4459 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1375559 T4459 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1375559 T4398 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:delDeadColl
[junit4] 2> 1375559 T4428 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1375559 T4428 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1375559 T4398 oasc.ZkController.getConfName Looking for collection configName
[junit4] 2> 1375559 T4419 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1375559 T4419 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1375559 T4459 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1375559 T4459 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1375559 T4398 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4] 2> 1375559 T4398 oascc.SolrZkClient.makePath makePath: /collections/delDeadColl
[junit4] 2> 1375559 T4428 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1375575 T4419 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1375575 T4459 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1375575 T4428 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\'
[junit4] 2> 1375575 T4419 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty1-1385095238248\delDeadColl_shard2_replica2\'
[junit4] 2> 1375575 T4459 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\'
[junit4] 2> 1375575 T4398 oasc.ZkController.readConfigName Load collection config from:/collections/delDeadColl
[junit4] 2> 1375575 T4398 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\'
[junit4] 2> 1375669 T4419 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1375684 T4428 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1375731 T4419 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1375747 T4428 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1375778 T4398 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1375778 T4459 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1375841 T4398 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1375841 T4459 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1375841 T4419 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1375841 T4428 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1375841 T4419 oass.IndexSchema.readSchema [delDeadColl_shard2_replica2] Schema name=test
[junit4] 2> 1375841 T4428 oass.IndexSchema.readSchema [delDeadColl_shard1_replica2] Schema name=test
[junit4] 2> 1375919 T4398 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1375919 T4398 oass.IndexSchema.readSchema [delDeadColl_shard1_replica1] Schema name=test
[junit4] 2> 1375934 T4459 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1375934 T4459 oass.IndexSchema.readSchema [delDeadColl_shard2_replica1] Schema name=test
[junit4] 2> 1376888 T4428 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1377013 T4428 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1377013 T4428 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1377028 T4398 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1377028 T4398 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1377028 T4398 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1377075 T4459 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1377075 T4459 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1377091 T4459 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1377122 T4428 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377122 T4398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377122 T4428 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377138 T4398 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377138 T4419 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1377138 T4428 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377138 T4398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377138 T4419 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1377138 T4428 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377138 T4428 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377138 T4428 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377153 T4398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377153 T4398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377153 T4398 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377153 T4459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377153 T4419 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1377153 T4428 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377153 T4428 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377153 T4428 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1377153 T4428 oasc.SolrCore.<init> [delDeadColl_shard1_replica2] Opening new SolrCore at .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\, dataDir=.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\data\
[junit4] 2> 1377153 T4428 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a75a57
[junit4] 2> 1377153 T4398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377153 T4398 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377153 T4398 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1377153 T4398 oasc.SolrCore.<init> [delDeadColl_shard1_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\data\
[junit4] 2> 1377153 T4398 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a75a57
[junit4] 2> 1377153 T4428 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\data\
[junit4] 2> 1377153 T4428 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\data\index/
[junit4] 2> 1377153 T4428 oasc.SolrCore.initIndex WARN [delDeadColl_shard1_replica2] Solr index directory '.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\data\index' doesn't exist. Creating new index...
[junit4] 2> 1377153 T4398 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\data\
[junit4] 2> 1377153 T4398 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\data\index/
[junit4] 2> 1377153 T4398 oasc.SolrCore.initIndex WARN [delDeadColl_shard1_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\data\index' doesn't exist. Creating new index...
[junit4] 2> 1377153 T4459 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1377153 T4398 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-controljetty-1385095237404\delDeadColl_shard1_replica1\data\index
[junit4] 2> 1377153 T4398 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1377153 T4428 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty2-1385095240045\delDeadColl_shard1_replica2\data\index
[junit4] 2> 1377153 T4428 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1377153 T4398 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@3e16cd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1b41147),segFN=segments_1,generation=1}
[junit4] 2> 1377153 T4398 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1377153 T4428 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@4986b1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@16efc15),segFN=segments_1,generation=1}
[junit4] 2> 1377153 T4428 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1377169 T4459 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1377169 T4459 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1377169 T4459 oasc.SolrCore.<init> [delDeadColl_shard2_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\data\
[junit4] 2> 1377169 T4459 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1a75a57
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377169 T4459 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\data\
[junit4] 2> 1377169 T4459 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\data\index/
[junit4] 2> 1377169 T4459 oasc.SolrCore.initIndex WARN [delDeadColl_shard2_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\data\index' doesn't exist. Creating new index...
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1377169 T4459 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.DeleteInactiveReplicaTest-jetty4-1385095243654\delDeadColl_shard2_replica1\data\index
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377169 T4459 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 1377169 T4398 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377169 T4398 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1377169 T4428 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1377169 T4459 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@10b25b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17d4217),segFN=segments_1,generation=1}
[junit4] 2> 1377169 T4428 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1377169 T4459 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1377169 T4398 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1377169 T4459 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377184 T4459 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1377184 T4459 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1377184 T4459 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1377184 T4459 oasc.RequestHandlers.initHandlersFromConfig
[...truncated too long message...]
stNRTOpen, DefaultValueUpdateProcessorTest, AddBlockUpdateTest, TestDocumentBuilder, TestFoldingMultitermQuery, TestFieldTypeCollectionResource, TestSolrXmlPersistor, TestCoreDiscovery, CachingDirectoryFactoryTest, ZkCLITest, AnalysisAfterCoreReloadTest, TestJmxIntegration, SolrIndexSplitterTest, TestStressRecovery, DebugComponentTest, TestUpdate, ModifyConfFileTest, SuggesterWFSTTest, BadCopyFieldTest, SpellingQueryConverterTest, HdfsSyncSliceTest, TestSolrIndexConfig, XmlUpdateRequestHandlerTest, OutputWriterTest, BasicDistributedZk2Test, TestConfig, RegexBoostProcessorTest, CoreAdminHandlerTest, BadIndexSchemaTest, SolrCoreCheckLockOnStartupTest, RAMDirectoryFactoryTest, PreAnalyzedFieldTest, DateFieldTest, TestWordDelimiterFilterFactory, TestValueSourceCache, TestPhraseSuggestions, PathHierarchyTokenizerFactoryTest, DeleteShardTest, CacheHeaderTest, TestQueryTypes, TestReload, TestTrie, TestManagedSchema, TestFiltering, ZkSolrClientTest, TestHashPartitioner, TestFuzzyAnalyzedSuggestions, TestFieldCollectionResource, TestLMJelinekMercerSimilarityFactory, PreAnalyzedUpdateProcessorTest, MoreLikeThisHandlerTest, URLClassifyProcessorTest, CSVRequestHandlerTest, CollectionsAPIDistributedZkTest, TestPseudoReturnFields, PeerSyncTest, BasicFunctionalityTest, ReturnFieldsTest, TestSolrJ, HdfsLockFactoryTest, DocumentBuilderTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestFieldTypeResource, OverseerCollectionProcessorTest, SuggesterFSTTest, TestLMDirichletSimilarityFactory, TestSolrDeletionPolicy1, DistributedSpellCheckComponentTest, TestCoreContainer, OpenExchangeRatesOrgProviderTest, TestAnalyzedSuggestions, SpellCheckComponentTest, TestModifyConfFiles, OpenCloseCoreStressTest, MinimalSchemaTest, TriLevelCompositeIdRoutingTest, TestGroupingSearch, SignatureUpdateProcessorFactoryTest, TestUtils, SolrCmdDistributorTest, StatelessScriptUpdateProcessorFactoryTest, StatsComponentTest, TestFunctionQuery, TestRemoteStreaming, TestPHPSerializedResponseWriter, TestSolrDeletionPolicy2, TestSurroundQueryParser, HdfsDirectoryTest, SolrPluginUtilsTest, TestSuggestSpellingConverter, TestRTGBase, IndexBasedSpellCheckerTest, SystemInfoHandlerTest, WordBreakSolrSpellCheckerTest, PolyFieldTest, TestExtendedDismaxParser, TestStressReorder, ParsingFieldUpdateProcessorsTest, ResourceLoaderTest, TestNonNRTOpen, ChangedSchemaMergeTest, TestSystemIdResolver, TestFastWriter, DeleteInactiveReplicaTest, TestLuceneMatchVersion, ShardRoutingCustomTest, TestInfoStreamLogging, SoftAutoCommitTest, FieldMutatingUpdateProcessorTest, TestNumberUtils, SolrXmlInZkTest, TestManagedSchemaFieldResource, ChaosMonkeyNothingIsSafeTest, TestStressVersions, AliasIntegrationTest, CurrencyFieldXmlFileTest, MBeansHandlerTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, SyncSliceTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, SliceStateUpdateTest, TestDistributedSearch, AutoCommitTest, TestFaceting, TestRecovery, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestJoin, TestMultiCoreConfBootstrap, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, QueryElevationComponentTest, ConvertedLegacyTest, TestSort, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, SimplePostToolTest, SolrRequestParserTest, SuggesterTSTTest, SuggesterTest, SpatialFilterTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, DocValuesMultiTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermVectorComponentTest, TestIndexingPerformance, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, IndexSchemaTest, TestCollationField, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, UpdateParamsTest, TestQuerySenderNoQuery, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, MultiTermTest, TestDocSet, TestBinaryField, NumericFieldsTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, TestXIncludeConfig, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TestFastOutputStream, ScriptEngineTest, PluginInfoTest, TestSolrXMLSerializer, PrimUtilsTest, ClusterStateTest, ZkNodePropsTest, SliceStateTest, UUIDFieldTest, CircularListTest, SolrTestCaseJ4Test, AbstractAnalyticsStatsTest, NoFacetTest, ExpressionTest, AbstractAnalyticsFacetTest, FieldFacetExtrasTest, FieldFacetTest, QueryFacetTest, FunctionTest, DeleteReplicaTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DeleteReplicaTest -Dtests.seed=FDD37FF99B7167E1 -Dtests.slow=true -Dtests.locale=is_IS -Dtests.timezone=Africa/Mbabane -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s | DeleteReplicaTest (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: ERROR: SolrZkClient opens=15 closes=14
[junit4] > at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.endTrackingZkClients(SolrTestCaseJ4.java:343)
[junit4] > at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:135)
[junit4] > at java.lang.Thread.run(Thread.java:744)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.DeleteReplicaTest:
[junit4] > 1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] > 2) Thread[id=9472, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-EventThread, state=WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:491)
[junit4] > at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=9471, name=TEST-DeleteReplicaTest.testDistribSearch-seed#[FDD37FF99B7167E1]-SendThread(127.0.0.1:58549), state=TIMED_WAITING, group=TGRP-DeleteReplicaTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:86)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:937)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:993)
[junit4] > at __randomizedtesting.SeedInfo.seed([FDD37FF99B7167E1]:0)
[junit4] Completed in 377.83s, 1 test, 1 failure, 3 errors <<< FAILURES!
[...truncated 131 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:420: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:400: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:489: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1272: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:908: There were test failures: 349 suites, 1551 tests, 3 suite-level errors, 2 errors, 140 ignored (11 assumptions)
Total time: 84 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_45 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure