You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/04/20 10:14:10 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_40) - Build # 4703 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4703/
Java: 64bit/jdk1.8.0_40 -XX:-UseCompressedOops -XX:+UseG1GC

4 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
commitWithin did not work on node: http://127.0.0.1:53641/collection1 expected:<68> but was:<67>

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:53641/collection1 expected:<68> but was:<67>
	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8:9DB0674911A07120]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:344)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
ERROR: SolrIndexSearcher opens=51 closes=50

Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:496)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
	at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores:     1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)




Build Log:
[...truncated 9912 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\init-core-data-001
   [junit4]   2> 1085359 T6522 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1085363 T6522 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1085364 T6523 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1085364 T6523 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1085453 T6522 oasc.ZkTestServer.run start zk server on port:53622
   [junit4]   2> 1085478 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1085481 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1085485 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1085489 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1085491 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1085494 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1085497 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1085500 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1085503 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1085509 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1085512 T6522 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1085826 T6522 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1
   [junit4]   2> 1085830 T6522 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1085833 T6522 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@35baf3d6{/,null,AVAILABLE}
   [junit4]   2> 1085834 T6522 oejs.AbstractConnector.doStart Started ServerConnector@3a8568a3{HTTP/1.1}{127.0.0.1:53629}
   [junit4]   2> 1085835 T6522 oejs.Server.doStart Started @1087330ms
   [junit4]   2> 1085835 T6522 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\tempDir-001/control/data, hostContext=/, hostPort=53629, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores}
   [junit4]   2> 1085835 T6522 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1085836 T6522 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\'
   [junit4]   2> 1085857 T6522 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\solr.xml
   [junit4]   2> 1085864 T6522 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores
   [junit4]   2> 1085864 T6522 oasc.CoreContainer.<init> New CoreContainer 196858504
   [junit4]   2> 1085864 T6522 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\]
   [junit4]   2> 1085865 T6522 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\lib
   [junit4]   2> 1085865 T6522 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\lib).
   [junit4]   2> 1085871 T6522 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1085876 T6522 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1085876 T6522 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1085877 T6522 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1085877 T6522 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1085877 T6522 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53622/solr
   [junit4]   2> 1085877 T6522 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1085930 T6522 N:127.0.0.1:53629_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53629_
   [junit4]   2> 1085938 T6522 N:127.0.0.1:53629_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1085941 T6522 N:127.0.0.1:53629_ oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53629_
   [junit4]   2> 1085943 T6522 N:127.0.0.1:53629_ oasc.Overseer.start Overseer (id=93684832784285699-127.0.0.1:53629_-n_0000000000) starting
   [junit4]   2> 1085957 T6522 N:127.0.0.1:53629_ oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1085958 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1085963 T6552 N:127.0.0.1:53629_ oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1085969 T6522 N:127.0.0.1:53629_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores
   [junit4]   2> 1085969 T6522 N:127.0.0.1:53629_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1, collection=control_collection, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 1085970 T6522 N:127.0.0.1:53629_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\
   [junit4]   2> 1085971 T6522 N:127.0.0.1:53629_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1085974 T6554 N:127.0.0.1:53629_ C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1085974 T6554 N:127.0.0.1:53629_ C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1085975 T6554 N:127.0.0.1:53629_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1085975 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1085987 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53629",
   [junit4]   2> 	  "node_name":"127.0.0.1:53629_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 1085988 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53629",
   [junit4]   2> 	  "node_name":"127.0.0.1:53629_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1085988 T6551 N:127.0.0.1:53629_ oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 1085988 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1086859 T6554 N:127.0.0.1:53629_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1086859 T6554 N:127.0.0.1:53629_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1086860 T6554 N:127.0.0.1:53629_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1086861 T6554 N:127.0.0.1:53629_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\'
   [junit4]   2> 1086883 T6554 N:127.0.0.1:53629_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1086901 T6554 N:127.0.0.1:53629_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1086913 T6554 N:127.0.0.1:53629_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1086917 T6554 N:127.0.0.1:53629_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1086926 T6554 N:127.0.0.1:53629_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1086931 T6554 N:127.0.0.1:53629_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1086954 T6554 N:127.0.0.1:53629_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1087075 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1087086 T6554 N:127.0.0.1:53629_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1087088 T6554 N:127.0.0.1:53629_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1087104 T6554 N:127.0.0.1:53629_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1087107 T6554 N:127.0.0.1:53629_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1087109 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1087110 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1087110 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1087110 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1087112 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1087112 T6554 N:127.0.0.1:53629_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\data\
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6892090c
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\data\
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\data\index/
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\control-001\cores\collection1\data\index
   [junit4]   2> 1087113 T6554 N:127.0.0.1:53629_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1087114 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@b559ea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@77a50a03),segFN=segments_1,generation=1}
   [junit4]   2> 1087114 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1087118 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1087118 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1087118 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1087118 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1087119 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1087119 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1087119 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1087119 T6554 N:127.0.0.1:53629_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1087119 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1087122 T6554 N:127.0.0.1:53629_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1087125 T6554 N:127.0.0.1:53629_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1087127 T6554 N:127.0.0.1:53629_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1087128 T6554 N:127.0.0.1:53629_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1087131 T6554 N:127.0.0.1:53629_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1087131 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1087132 T6554 N:127.0.0.1:53629_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1087133 T6554 N:127.0.0.1:53629_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1087134 T6554 N:127.0.0.1:53629_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1087134 T6554 N:127.0.0.1:53629_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1087135 T6554 N:127.0.0.1:53629_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6291366159922623]
   [junit4]   2> 1087136 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@b559ea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@77a50a03),segFN=segments_1,generation=1}
   [junit4]   2> 1087136 T6554 N:127.0.0.1:53629_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1087136 T6554 N:127.0.0.1:53629_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@32c9feb7[collection1] main
   [junit4]   2> 1087138 T6554 N:127.0.0.1:53629_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1087139 T6554 N:127.0.0.1:53629_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1087139 T6554 N:127.0.0.1:53629_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1087140 T6554 N:127.0.0.1:53629_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1087140 T6554 N:127.0.0.1:53629_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1087141 T6554 N:127.0.0.1:53629_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1087141 T6554 N:127.0.0.1:53629_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1087141 T6554 N:127.0.0.1:53629_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1087142 T6554 N:127.0.0.1:53629_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1087142 T6555 N:127.0.0.1:53629_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@32c9feb7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1087143 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53629 collection:control_collection shard:shard1
   [junit4]   2> 1087144 T6522 N:127.0.0.1:53629_ oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1087144 T6522 N:127.0.0.1:53629_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1087156 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1087156 T6522 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1087157 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1087158 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1087159 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C607 name=collection1 org.apache.solr.core.SolrCore@18e9c21b url=http://127.0.0.1:53629/collection1 node=127.0.0.1:53629_ C607_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53629, node_name=127.0.0.1:53629_, state=down}
   [junit4]   2> 1087159 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 C607 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53629/collection1/
   [junit4]   2> 1087159 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 C607 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1087159 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 C607 oasc.SyncStrategy.syncToMe http://127.0.0.1:53629/collection1/ has no replicas
   [junit4]   2> 1087160 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53629/collection1/ shard1
   [junit4]   2> 1087161 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 1087167 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1087168 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53629",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 1087213 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:53629/collection1/ and leader is http://127.0.0.1:53629/collection1/
   [junit4]   2> 1087213 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53629
   [junit4]   2> 1087213 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1087213 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1087214 T6558 N:127.0.0.1:53629_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1087216 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1087218 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53629",
   [junit4]   2> 	  "node_name":"127.0.0.1:53629_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 2
   [junit4]   2> 1087220 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53629",
   [junit4]   2> 	  "node_name":"127.0.0.1:53629_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1087522 T6522 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1
   [junit4]   2> 1087524 T6522 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001
   [junit4]   2> 1087526 T6522 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1087529 T6522 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@6304b93a{/,null,AVAILABLE}
   [junit4]   2> 1087530 T6522 oejs.AbstractConnector.doStart Started ServerConnector@28a79ab{HTTP/1.1}{127.0.0.1:53641}
   [junit4]   2> 1087531 T6522 oejs.Server.doStart Started @1089428ms
   [junit4]   2> 1087531 T6522 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=53641, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores}
   [junit4]   2> 1087532 T6522 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1087532 T6522 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\'
   [junit4]   2> 1087565 T6522 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\solr.xml
   [junit4]   2> 1087573 T6522 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores
   [junit4]   2> 1087573 T6522 oasc.CoreContainer.<init> New CoreContainer 1978570413
   [junit4]   2> 1087574 T6522 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\]
   [junit4]   2> 1087575 T6522 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\lib
   [junit4]   2> 1087575 T6522 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\lib).
   [junit4]   2> 1087586 T6522 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1087590 T6522 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1087591 T6522 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1087591 T6522 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1087591 T6522 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1087591 T6522 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53622/solr
   [junit4]   2> 1087592 T6522 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1088493 T6522 N:127.0.0.1:53641_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53641_
   [junit4]   2> 1088500 T6522 N:127.0.0.1:53641_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1088504 T6522 N:127.0.0.1:53641_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores
   [junit4]   2> 1088504 T6522 N:127.0.0.1:53641_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1, collection=collection1, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 1088504 T6522 N:127.0.0.1:53641_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\
   [junit4]   2> 1088504 T6522 N:127.0.0.1:53641_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1088505 T6582 N:127.0.0.1:53641_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1088505 T6582 N:127.0.0.1:53641_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1088508 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1088508 T6582 N:127.0.0.1:53641_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1088509 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53641",
   [junit4]   2> 	  "node_name":"127.0.0.1:53641_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 1088510 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53641",
   [junit4]   2> 	  "node_name":"127.0.0.1:53641_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1088510 T6551 N:127.0.0.1:53629_ oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 1088510 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1089391 T6582 N:127.0.0.1:53641_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1089392 T6582 N:127.0.0.1:53641_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1089395 T6582 N:127.0.0.1:53641_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1089397 T6582 N:127.0.0.1:53641_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\'
   [junit4]   2> 1089415 T6582 N:127.0.0.1:53641_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1089419 T6582 N:127.0.0.1:53641_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1089430 T6582 N:127.0.0.1:53641_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1089433 T6582 N:127.0.0.1:53641_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1089443 T6582 N:127.0.0.1:53641_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1089445 T6582 N:127.0.0.1:53641_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1089453 T6582 N:127.0.0.1:53641_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1089601 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1089610 T6582 N:127.0.0.1:53641_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1089611 T6582 N:127.0.0.1:53641_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1089646 T6582 N:127.0.0.1:53641_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1089654 T6582 N:127.0.0.1:53641_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1089656 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1089658 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1089658 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1089658 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1089659 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1089659 T6582 N:127.0.0.1:53641_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1089659 T6582 N:127.0.0.1:53641_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1089660 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1089660 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6892090c
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\data\index/
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-1-001\cores\collection1\data\index
   [junit4]   2> 1089661 T6582 N:127.0.0.1:53641_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1089662 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@266317bf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c2c7cb9),segFN=segments_1,generation=1}
   [junit4]   2> 1089663 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1089666 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1089667 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1089668 T6582 N:127.0.0.1:53641_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1089668 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1089673 T6582 N:127.0.0.1:53641_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1089675 T6582 N:127.0.0.1:53641_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1089676 T6582 N:127.0.0.1:53641_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1089679 T6582 N:127.0.0.1:53641_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1089684 T6582 N:127.0.0.1:53641_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1089685 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1089686 T6582 N:127.0.0.1:53641_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1089686 T6582 N:127.0.0.1:53641_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1089687 T6582 N:127.0.0.1:53641_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1089687 T6582 N:127.0.0.1:53641_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1089689 T6582 N:127.0.0.1:53641_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6291366159922623]
   [junit4]   2> 1089690 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@266317bf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7c2c7cb9),segFN=segments_1,generation=1}
   [junit4]   2> 1089690 T6582 N:127.0.0.1:53641_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1089690 T6582 N:127.0.0.1:53641_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@651cd1ac[collection1] main
   [junit4]   2> 1089691 T6582 N:127.0.0.1:53641_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1089692 T6582 N:127.0.0.1:53641_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1089692 T6582 N:127.0.0.1:53641_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1089692 T6582 N:127.0.0.1:53641_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1089694 T6582 N:127.0.0.1:53641_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1089694 T6582 N:127.0.0.1:53641_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1089694 T6582 N:127.0.0.1:53641_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1089694 T6582 N:127.0.0.1:53641_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1089695 T6582 N:127.0.0.1:53641_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1089695 T6583 N:127.0.0.1:53641_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@651cd1ac[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1089698 T6522 N:127.0.0.1:53641_ oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1089698 T6522 N:127.0.0.1:53641_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1089698 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53641 collection:collection1 shard:shard2
   [junit4]   2> 1089719 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1089723 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1089729 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1089730 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C608 name=collection1 org.apache.solr.core.SolrCore@180306c3 url=http://127.0.0.1:53641/collection1 node=127.0.0.1:53641_ C608_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53641, node_name=127.0.0.1:53641_, state=down}
   [junit4]   2> 1089730 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 C608 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53641/collection1/
   [junit4]   2> 1089730 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 C608 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1089731 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 C608 oasc.SyncStrategy.syncToMe http://127.0.0.1:53641/collection1/ has no replicas
   [junit4]   2> 1089731 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53641/collection1/ shard2
   [junit4]   2> 1089732 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 1089746 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1089753 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53641",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 1089866 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register We are http://127.0.0.1:53641/collection1/ and leader is http://127.0.0.1:53641/collection1/
   [junit4]   2> 1089866 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53641
   [junit4]   2> 1089866 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1089866 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1089866 T6586 N:127.0.0.1:53641_ C:collection1 S:shard2 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1089872 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1089878 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53641",
   [junit4]   2> 	  "node_name":"127.0.0.1:53641_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 5
   [junit4]   2> 1089881 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53641",
   [junit4]   2> 	  "node_name":"127.0.0.1:53641_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1089906 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1090114 T6522 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1
   [junit4]   2> 1090118 T6522 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001
   [junit4]   2> 1090119 T6522 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 1090122 T6522 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@75f157c9{/,null,AVAILABLE}
   [junit4]   2> 1090124 T6522 oejs.AbstractConnector.doStart Started ServerConnector@482ea9b1{HTTP/1.1}{127.0.0.1:53671}
   [junit4]   2> 1090125 T6522 oejs.Server.doStart Started @1092459ms
   [junit4]   2> 1090125 T6522 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=53671, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores}
   [junit4]   2> 1090127 T6522 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1090127 T6522 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\'
   [junit4]   2> 1090155 T6522 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\solr.xml
   [junit4]   2> 1090164 T6522 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores
   [junit4]   2> 1090165 T6522 oasc.CoreContainer.<init> New CoreContainer 1780672478
   [junit4]   2> 1090165 T6522 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\]
   [junit4]   2> 1090165 T6522 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\lib
   [junit4]   2> 1090166 T6522 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\lib).
   [junit4]   2> 1090177 T6522 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1090183 T6522 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1090183 T6522 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1090183 T6522 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1090183 T6522 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 1090183 T6522 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53622/solr
   [junit4]   2> 1090184 T6522 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1091091 T6522 N:127.0.0.1:53671_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53671_
   [junit4]   2> 1091098 T6522 N:127.0.0.1:53671_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1091107 T6522 N:127.0.0.1:53671_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores
   [junit4]   2> 1091108 T6522 N:127.0.0.1:53671_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1, collection=collection1, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 1091109 T6522 N:127.0.0.1:53671_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\
   [junit4]   2> 1091109 T6522 N:127.0.0.1:53671_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1091115 T6604 N:127.0.0.1:53671_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1091115 T6604 N:127.0.0.1:53671_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1091115 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1091116 T6604 N:127.0.0.1:53671_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1091116 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53671",
   [junit4]   2> 	  "node_name":"127.0.0.1:53671_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 6
   [junit4]   2> 1091116 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53671",
   [junit4]   2> 	  "node_name":"127.0.0.1:53671_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1091116 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 1091116 T6551 N:127.0.0.1:53629_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1091998 T6604 N:127.0.0.1:53671_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1091999 T6604 N:127.0.0.1:53671_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1092001 T6604 N:127.0.0.1:53671_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1092030 T6604 N:127.0.0.1:53671_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\'
   [junit4]   2> 1092053 T6604 N:127.0.0.1:53671_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 1092056 T6604 N:127.0.0.1:53671_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 1092069 T6604 N:127.0.0.1:53671_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 1092073 T6604 N:127.0.0.1:53671_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1092084 T6604 N:127.0.0.1:53671_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1092096 T6604 N:127.0.0.1:53671_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1092103 T6604 N:127.0.0.1:53671_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1092251 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1092261 T6604 N:127.0.0.1:53671_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1092262 T6604 N:127.0.0.1:53671_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1092273 T6604 N:127.0.0.1:53671_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1092275 T6604 N:127.0.0.1:53671_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1092279 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1092282 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1092283 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1092283 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\data\
   [junit4]   2> 1092284 T6604 N:127.0.0.1:53671_ c:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6892090c
   [junit4]   2> 1092285 T6604 N:127.0.0.1:53671_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\data\
   [junit4]   2> 1092286 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\data\index/
   [junit4]   2> 1092287 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1092287 T6604 N:127.0.0.1:53671_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.BasicDistributedZkTest 15E45893BF5C1CD8-001\shard-2-001\cores\collection1\data\index
   [junit4]   2> 1092287 T6604 N:127.0.0.1:53671_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1092288 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@89a4374 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ff940d2),segFN=segments_1,generation=1}
   [junit4]   2> 1092288 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1092290 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1092293 T6604 N:127.0.0.1:53671_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1092293 T6604 N:127.0.0.1:53671_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1092296 T6604 N:127.0.0.1:53671_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1092296 T6604 N:127.0.0.1:53671_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1092302 T6604 N:127.0.0.1:53671_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1092302 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1092304 T6604 N:127.0.0.1:53671_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1092304 T6604 N:127.0.0.1:53671_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 1092306 T6604 N:127.0.0.1:53671_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1092306 T6604 N:127.0.0.1:53671_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1092307 T6604 N:127.0.0.1:53671_ c:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6291366159922623]
   [junit4]   2> 1092308 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@89a4374 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ff940d2),segFN=segments_1,generation=1}
   [junit4]   2> 1092308 T6604 N:127.0.0.1:53671_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1092308 T6604 N:127.0.0.1:53671_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@75713e4[collection1] main
   [junit4]   2> 1092309 T6604 N:127.0.0.1:53671_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1092310 T6604 N:127.0.0.1:53671_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1092311 T6604 N:127.0.0.1:53671_ c:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1092311 T6604 N:127.0.0.1:53671_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1092311 T6605 N:127.0.0.1:53671_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@75713e4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1092311 T6522 N:127.0.0.1:53671_ oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1092311 T6522 N:127.0.0.1:53671_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1092313 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:53671 collection:collection1 shard:shard1
   [junit4]   2> 1092325 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C609 name=collection1 org.apache.solr.core.SolrCore@162a609d url=http://127.0.0.1:53671/collection1 node=127.0.0.1:53671_ C609_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:53671, node_name=127.0.0.1:53671_, state=down}
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 C609 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:53671/collection1/
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 C609 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 C609 oasc.SyncStrategy.syncToMe http://127.0.0.1:53671/collection1/ has no replicas
   [junit4]   2> 1092327 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:53671/collection1/ shard1
   [junit4]   2> 1092328 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1092331 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"} current state version: 7
   [junit4]   2> 1092339 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1092340 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53671",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 7
   [junit4]   2> 1092476 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:53671/collection1/ and leader is http://127.0.0.1:53671/collection1/
   [junit4]   2> 1092476 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:53671
   [junit4]   2> 1092476 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1092485 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1092485 T6608 N:127.0.0.1:53671_ C:collection1 S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1092526 T6550 N:127.0.0.1:53629_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1092555 T6551 N:127.0.0.1:53629_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "roles":null,

[...truncated too long message...]

unit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 150881 T9812 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
   [junit4]   2> 	   1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> 154182 T9812 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
   [junit4]   2> 	   1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {v_t=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), v_s=BlockTreeOrds(blocksize=128), v_f=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=DefaultSimilarity, locale=lv_LV, timezone=America/Montevideo
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0_40 (64-bit)/cpus=3,threads=2,free=259309336,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [ConnectionManagerTest, TestSearcherReuse, IndexSchemaTest, TestExactStatsCache, HdfsThreadLeakTest, HdfsSyncSliceTest, SearchHandlerTest, DistributedMLTComponentTest, SaslZkACLProviderTest, ReplicationFactorTest, TestDocBasedVersionConstraints, TestTrie, TestHashQParserPlugin, TestSolrJ, TestAnalyzeInfixSuggestions, FacetPivotSmallTest, DistributedFacetPivotLongTailTest, TestSolrConfigHandlerCloud, TestZkChroot, TestReqParamsAPI, LoggingHandlerTest, StatsComponentTest, TestSolrDeletionPolicy1, CSVRequestHandlerTest, TestSolrQueryParserDefaultOperatorResource, TestSolrDynamicMBean, TestRawResponseWriter, UpdateRequestProcessorFactoryTest, MoreLikeThisHandlerTest, TestPseudoReturnFields, ResourceLoaderTest, CollectionReloadTest, TestObjectReleaseTracker, ZkSolrClientTest, DateFieldTest, TestImplicitCoreProperties, CollectionsAPIAsyncDistributedZkTest, TestRestManager, TestCloudManagedSchemaConcurrent, TestSolr4Spatial, NotRequiredUniqueKeyTest, TermsComponentTest, SolrCmdDistributorTest, LeaderInitiatedRecoveryOnCommitTest, TestFastWriter, TestLMJelinekMercerSimilarityFactory, StandardRequestHandlerTest, SpellingQueryConverterTest, TestRecovery, TestBadConfig, UpdateParamsTest, AnalyticsMergeStrategyTest, SpellPossibilityIteratorTest, RollingRestartTest, TestRealTimeGet, TestBulkSchemaAPI, ShardRoutingCustomTest, TestSortingResponseWriter, TestUtils, TestHdfsUpdateLog, TriLevelCompositeIdRoutingTest, DistribJoinFromCollectionTest, DistributedTermsComponentTest, TestFiltering, ParsingFieldUpdateProcessorsTest, TestFieldCollectionResource, FieldMutatingUpdateProcessorTest, TestSearchPerf, TestRemoteStreaming, HdfsBasicDistributedZkTest, TestQuerySenderListener, TestFieldTypeResource, SSLMigrationTest, TestSchemaNameResource, AnalyticsQueryTest, IndexBasedSpellCheckerTest, XsltUpdateRequestHandlerTest, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, TestDistributedGrouping, TestDFRSimilarityFactory, BinaryUpdateRequestHandlerTest, CloudMLTQParserTest, BasicDistributedZk2Test, AsyncMigrateRouteKeyTest, TermVectorComponentTest, DateRangeFieldTest, TestMiniSolrCloudClusterSSL, HdfsWriteToMultipleCollectionsTest, InfoHandlerTest, PrimitiveFieldTypeTest, TermVectorComponentDistributedTest, DeleteInactiveReplicaTest, TestFoldingMultitermQuery, QueryResultKeyTest, DocumentBuilderTest, CollectionsAPIDistributedZkTest, TestJsonFacets, SuggesterTSTTest, StatelessScriptUpdateProcessorFactoryTest, TestInitParams, TestSystemIdResolver, OpenCloseCoreStressTest, TestRandomMergePolicy, TestDynamicLoading, LeaderElectionIntegrationTest, TestLMDirichletSimilarityFactory, SegmentsInfoRequestHandlerTest, TestSchemaResource, CopyFieldTest, HighlighterTest, DocExpirationUpdateProcessorFactoryTest, TestCoreDiscovery, ResponseHeaderTest, TestRandomFaceting, OverseerTest, ZkCLITest, TestFaceting, DistributedSpellCheckComponentTest, TestStressReorder, TestStressVersions, SpellCheckComponentTest, BadIndexSchemaTest, TestSort, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=15E45893BF5C1CD8 -Dtests.slow=true -Dtests.locale=lv_LV -Dtests.timezone=America/Montevideo -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ERROR: SolrIndexSearcher opens=51 closes=50
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:496)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:232)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.core.TestLazyCores: 
   [junit4]    >    1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=9855, name=searcherExecutor-4205-thread-1, state=WAITING, group=TGRP-TestLazyCores]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([15E45893BF5C1CD8]:0)
   [junit4] Completed [373/483] on J1 in 154.23s, 7 tests, 1 failure, 2 errors <<< FAILURES!

[...truncated 342 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:526: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:474: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:229: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:512: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1415: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:973: There were test failures: 483 suites, 1915 tests, 3 suite-level errors, 1 failure, 343 ignored (31 assumptions)

Total time: 44 minutes 29 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_40) - Build # 4704 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4704/
Java: 64bit/jdk1.8.0_40 -XX:-UseCompressedOops -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.CloudSolrClientTest.test

Error Message:
Error from server at http://127.0.0.1:62293/checkStateVerCol: no servers hosting shard: 

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:62293/checkStateVerCol: no servers hosting shard: 
	at __randomizedtesting.SeedInfo.seed([2E526DF0956F451C:A606522A3B9328E4]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.stateVersionParamTest(CloudSolrClientTest.java:554)
	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.test(CloudSolrClientTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:110)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11011 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.CloudSolrClientTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\init-core-data-001
   [junit4]   2> 35639 T166 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 35639 T166 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 35646 T166 oasc.AbstractZkTestCase.<clinit> WARN TEST_HOME() does not exist - solrj test?
   [junit4]   2> 35667 T166 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 35668 T167 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 35668 T167 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 35765 T166 oasc.ZkTestServer.run start zk server on port:62122
   [junit4]   2> 35765 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 35767 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 35773 T174 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3243902a name:ZooKeeperConnection Watcher:127.0.0.1:62122 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 35774 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 35774 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 35774 T166 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 35782 T168 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14cd7282c3b0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 35783 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 35786 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 35790 T177 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a8936f name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 35791 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 35791 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 35791 T166 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 35802 T166 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 35806 T166 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 35809 T166 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 35814 T166 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 35816 T166 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 35823 T166 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 35824 T166 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 35829 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml because it doesn't exist
   [junit4]   2> 35829 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\stopwords.txt because it doesn't exist
   [junit4]   2> 35829 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\protwords.txt because it doesn't exist
   [junit4]   2> 35830 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\currency.xml because it doesn't exist
   [junit4]   2> 35830 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\enumsConfig.xml because it doesn't exist
   [junit4]   2> 35830 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\open-exchange-rates.json because it doesn't exist
   [junit4]   2> 35831 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\mapping-ISOLatin1Accent.txt because it doesn't exist
   [junit4]   2> 35831 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\old_synonyms.txt because it doesn't exist
   [junit4]   2> 35831 T166 oasc.AbstractZkTestCase.putConfig skipping C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\solrj\src\test-files\solrj\solr\collection1\conf\synonyms.txt because it doesn't exist
   [junit4]   2> 35896 T166 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1
   [junit4]   2> 35902 T166 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 35905 T166 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@4f7c1024{/,null,AVAILABLE}
   [junit4]   2> 35907 T166 oejs.AbstractConnector.doStart Started ServerConnector@3f74069e{HTTP/1.1}{127.0.0.1:62129}
   [junit4]   2> 35907 T166 oejs.Server.doStart Started @39538ms
   [junit4]   2> 35907 T166 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\tempDir-001/control/data, hostContext=/, hostPort=62129, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores}
   [junit4]   2> 35908 T166 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 35908 T166 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\'
   [junit4]   2> 35931 T166 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\solr.xml
   [junit4]   2> 35941 T166 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores
   [junit4]   2> 35941 T166 oasc.CoreContainer.<init> New CoreContainer 713012673
   [junit4]   2> 35941 T166 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\]
   [junit4]   2> 35942 T166 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\lib
   [junit4]   2> 35942 T166 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\lib).
   [junit4]   2> 35950 T166 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 35953 T166 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 35954 T166 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 35954 T166 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 35954 T166 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 35954 T166 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62122/solr
   [junit4]   2> 35955 T166 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 35955 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 35956 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 35961 T191 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@671a48c6 name:ZooKeeperConnection Watcher:127.0.0.1:62122 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 35961 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 35961 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 35967 T166 N:127.0.0.1:62129_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 35970 T194 N:127.0.0.1:62129_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@274517d0 name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 35970 T166 N:127.0.0.1:62129_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 35972 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 35977 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 35981 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 35984 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 35988 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 35994 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 35998 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 36001 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 36003 T166 N:127.0.0.1:62129_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62129_
   [junit4]   2> 36004 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62129_
   [junit4]   2> 36006 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 36009 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 36012 T166 N:127.0.0.1:62129_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 36016 T166 N:127.0.0.1:62129_ oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:62129_
   [junit4]   2> 36016 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 36020 T166 N:127.0.0.1:62129_ oasc.Overseer.start Overseer (id=93686259808665603-127.0.0.1:62129_-n_0000000000) starting
   [junit4]   2> 36026 T166 N:127.0.0.1:62129_ oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 36038 T166 N:127.0.0.1:62129_ oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 36039 T166 N:127.0.0.1:62129_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 36040 T196 N:127.0.0.1:62129_ oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 36041 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 36048 T166 N:127.0.0.1:62129_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores
   [junit4]   2> 36064 T166 N:127.0.0.1:62129_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1, collection=control_collection, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 36064 T166 N:127.0.0.1:62129_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\
   [junit4]   2> 36064 T166 N:127.0.0.1:62129_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 36066 T198 N:127.0.0.1:62129_ C:control_collection c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 36067 T198 N:127.0.0.1:62129_ C:control_collection c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 36072 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 36072 T198 N:127.0.0.1:62129_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 36076 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62129",
   [junit4]   2> 	  "node_name":"127.0.0.1:62129_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 36101 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62129",
   [junit4]   2> 	  "node_name":"127.0.0.1:62129_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 36105 T195 N:127.0.0.1:62129_ oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 36128 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 36136 T194 N:127.0.0.1:62129_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37052 T198 N:127.0.0.1:62129_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 37052 T198 N:127.0.0.1:62129_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 37053 T198 N:127.0.0.1:62129_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 37053 T198 N:127.0.0.1:62129_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 37054 T198 N:127.0.0.1:62129_ oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 37054 T198 N:127.0.0.1:62129_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\'
   [junit4]   2> 37076 T198 N:127.0.0.1:62129_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 37088 T198 N:127.0.0.1:62129_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 37099 T198 N:127.0.0.1:62129_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 37100 T198 N:127.0.0.1:62129_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 37107 T198 N:127.0.0.1:62129_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 37111 T198 N:127.0.0.1:62129_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 37118 T198 N:127.0.0.1:62129_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 37243 T198 N:127.0.0.1:62129_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 37248 T198 N:127.0.0.1:62129_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 37249 T198 N:127.0.0.1:62129_ oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 37249 T198 N:127.0.0.1:62129_ oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\data\
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\data\
   [junit4]   2> 37255 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\data\index/
   [junit4]   2> 37256 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 37256 T198 N:127.0.0.1:62129_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\control-001\cores\collection1\data\index
   [junit4]   2> 37256 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7276a9cd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@456dd4a7),segFN=segments_1,generation=1}
   [junit4]   2> 37256 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 37259 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 37262 T198 N:127.0.0.1:62129_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 37264 T198 N:127.0.0.1:62129_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 37264 T198 N:127.0.0.1:62129_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 37265 T198 N:127.0.0.1:62129_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 37266 T198 N:127.0.0.1:62129_ c:collection1 oasc.PluginBag.createPlugin requestHandler : '/replication' created with startup=lazy 
   [junit4]   2> 37285 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 37285 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 37285 T198 N:127.0.0.1:62129_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 37285 T198 N:127.0.0.1:62129_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig WARN no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 37286 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 37287 T198 N:127.0.0.1:62129_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 37287 T198 N:127.0.0.1:62129_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 37288 T198 N:127.0.0.1:62129_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 37288 T198 N:127.0.0.1:62129_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 37289 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7276a9cd lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@456dd4a7),segFN=segments_1,generation=1}
   [junit4]   2> 37289 T198 N:127.0.0.1:62129_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 37289 T198 N:127.0.0.1:62129_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@6c6aa46e[collection1] main
   [junit4]   2> 37289 T198 N:127.0.0.1:62129_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 37291 T198 N:127.0.0.1:62129_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 37291 T198 N:127.0.0.1:62129_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 37301 T198 N:127.0.0.1:62129_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 37301 T198 N:127.0.0.1:62129_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 37301 T198 N:127.0.0.1:62129_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 37302 T198 N:127.0.0.1:62129_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 37302 T198 N:127.0.0.1:62129_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 37302 T198 N:127.0.0.1:62129_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 37303 T198 N:127.0.0.1:62129_ c:collection1 oasha.AdminHandlers.inform WARN <requestHandler name="/admin/" 
   [junit4]   2> 	 class="solr.admin.AdminHandlers" /> is deprecated . It is not required anymore
   [junit4]   2> 37303 T199 N:127.0.0.1:62129_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6c6aa46e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 37308 T198 N:127.0.0.1:62129_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 37310 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62129 collection:control_collection shard:shard1
   [junit4]   2> 37310 T166 N:127.0.0.1:62129_ oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 37310 T166 N:127.0.0.1:62129_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 37313 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 37314 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 37322 T205 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54036a77 name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 37323 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 37323 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 37323 T166 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 37336 T166 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 37336 T166 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 37336 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 37338 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 37339 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 37344 T208 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45570b24 name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 37344 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 37344 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 37353 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 37384 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":"2"} current state version: 1
   [junit4]   2> 37385 T195 N:127.0.0.1:62129_ oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 37388 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 37402 T166 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1
   [junit4]   2> 37403 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 37403 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> 37404 T166 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001
   [junit4]   2> 37404 T166 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 37407 T166 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@38926720{/,null,AVAILABLE}
   [junit4]   2> 37408 T166 oejs.AbstractConnector.doStart Started ServerConnector@3e02837b{HTTP/1.1}{127.0.0.1:62144}
   [junit4]   2> 37408 T166 oejs.Server.doStart Started @41074ms
   [junit4]   2> 37408 T166 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=62144, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores}
   [junit4]   2> ASYNC  NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@7d396e2b url=http://127.0.0.1:62129/collection1 node=127.0.0.1:62129_ C6_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:62129, node_name=127.0.0.1:62129_, state=down}
   [junit4]   2> 37408 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 C6 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62129/collection1/
   [junit4]   2> 37409 T166 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 37409 T166 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\'
   [junit4]   2> 37409 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 C6 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 37410 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 C6 oasc.SyncStrategy.syncToMe http://127.0.0.1:62129/collection1/ has no replicas
   [junit4]   2> 37410 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62129/collection1/ shard1
   [junit4]   2> 37413 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 37415 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 37424 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 37429 T166 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\solr.xml
   [junit4]   2> 37434 T205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37442 T166 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores
   [junit4]   2> 37444 T166 oasc.CoreContainer.<init> New CoreContainer 977972931
   [junit4]   2> 37444 T166 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\]
   [junit4]   2> 37444 T166 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\lib
   [junit4]   2> 37445 T166 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\lib).
   [junit4]   2> 37443 T194 N:127.0.0.1:62129_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37453 T166 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 37455 T166 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 37456 T166 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 37456 T166 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 37456 T166 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 37456 T166 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62122/solr
   [junit4]   2> 37456 T166 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 37456 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 37458 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 37460 T225 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 37466 T226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3acc0052 name:ZooKeeperConnection Watcher:127.0.0.1:62122 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 37467 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 37467 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 37470 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62129",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 37475 T166 N:127.0.0.1:62144_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 37479 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 37482 T205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37482 T194 N:127.0.0.1:62129_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37482 T229 N:127.0.0.1:62144_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ef9309f name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 37483 T166 N:127.0.0.1:62144_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 37505 T166 N:127.0.0.1:62144_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 37516 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register We are http://127.0.0.1:62129/collection1/ and leader is http://127.0.0.1:62129/collection1/
   [junit4]   2> 37516 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62129
   [junit4]   2> 37516 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 37517 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 37517 T202 N:127.0.0.1:62129_ C:control_collection S:shard1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 37522 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 37524 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62129",
   [junit4]   2> 	  "node_name":"127.0.0.1:62129_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 37525 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62129",
   [junit4]   2> 	  "node_name":"127.0.0.1:62129_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 37628 T205 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37628 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 37629 T194 N:127.0.0.1:62129_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 38561 T166 N:127.0.0.1:62144_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62144_
   [junit4]   2> 38562 T166 N:127.0.0.1:62144_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62144_
   [junit4]   2> 38565 T166 N:127.0.0.1:62144_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 38574 T166 N:127.0.0.1:62144_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores
   [junit4]   2> 38575 T166 N:127.0.0.1:62144_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1, collection=collection1, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 38575 T166 N:127.0.0.1:62144_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\
   [junit4]   2> 38575 T166 N:127.0.0.1:62144_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 38580 T230 N:127.0.0.1:62144_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 38580 T230 N:127.0.0.1:62144_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 38582 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 38583 T230 N:127.0.0.1:62144_ oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 38583 T230 N:127.0.0.1:62144_ oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 38584 T230 N:127.0.0.1:62144_ oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 38584 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62144",
   [junit4]   2> 	  "node_name":"127.0.0.1:62144_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 38584 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62144",
   [junit4]   2> 	  "node_name":"127.0.0.1:62144_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 38585 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 38585 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 38588 T230 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 38588 T230 N:127.0.0.1:62144_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 38698 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 38700 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 38703 T229 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 39666 T230 N:127.0.0.1:62144_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 39666 T230 N:127.0.0.1:62144_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 39667 T230 N:127.0.0.1:62144_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 39667 T230 N:127.0.0.1:62144_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 39668 T230 N:127.0.0.1:62144_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 39668 T230 N:127.0.0.1:62144_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\'
   [junit4]   2> 39680 T230 N:127.0.0.1:62144_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 39682 T230 N:127.0.0.1:62144_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 39693 T230 N:127.0.0.1:62144_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 39696 T230 N:127.0.0.1:62144_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 39702 T230 N:127.0.0.1:62144_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 39705 T230 N:127.0.0.1:62144_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 39711 T230 N:127.0.0.1:62144_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 39776 T230 N:127.0.0.1:62144_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 39777 T230 N:127.0.0.1:62144_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 39778 T230 N:127.0.0.1:62144_ oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 39778 T230 N:127.0.0.1:62144_ oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 39779 T230 N:127.0.0.1:62144_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 39779 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 39780 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 39780 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 39780 T230 N:127.0.0.1:62144_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\data\
   [junit4]   2> 39781 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\data\index/
   [junit4]   2> 39781 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 39781 T230 N:127.0.0.1:62144_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-1-001\cores\collection1\data\index
   [junit4]   2> 39782 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7e708c6f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40780080),segFN=segments_1,generation=1}
   [junit4]   2> 39782 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 39792 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 39796 T230 N:127.0.0.1:62144_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39797 T230 N:127.0.0.1:62144_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39798 T230 N:127.0.0.1:62144_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39798 T230 N:127.0.0.1:62144_ c:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 39799 T230 N:127.0.0.1:62144_ c:collection1 oasc.PluginBag.createPlugin requestHandler : '/replication' created with startup=lazy 
   [junit4]   2> 39804 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 39805 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [org.apache.solr.handler.admin.AdminHandlers]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 39805 T230 N:127.0.0.1:62144_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/mbeans,standard,,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 39805 T230 N:127.0.0.1:62144_ c:collection1 oasc.RequestHandlers.initHandlersFromConfig WARN no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 39805 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 39806 T230 N:127.0.0.1:62144_ c:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 39806 T230 N:127.0.0.1:62144_ c:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10
   [junit4]   2> 39807 T230 N:127.0.0.1:62144_ c:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 39809 T230 N:127.0.0.1:62144_ c:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 39809 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7e708c6f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@40780080),segFN=segments_1,generation=1}
   [junit4]   2> 39809 T230 N:127.0.0.1:62144_ c:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 39809 T230 N:127.0.0.1:62144_ c:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@5133249d[collection1] main
   [junit4]   2> 39810 T230 N:127.0.0.1:62144_ c:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 39811 T230 N:127.0.0.1:62144_ c:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 39811 T230 N:127.0.0.1:62144_ c:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 39812 T230 N:127.0.0.1:62144_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 39812 T230 N:127.0.0.1:62144_ c:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 39812 T230 N:127.0.0.1:62144_ c:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 39812 T230 N:127.0.0.1:62144_ c:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 39812 T230 N:127.0.0.1:62144_ c:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 39813 T230 N:127.0.0.1:62144_ c:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 39813 T230 N:127.0.0.1:62144_ c:collection1 oasha.AdminHandlers.inform WARN <requestHandler name="/admin/" 
   [junit4]   2> 	 class="solr.admin.AdminHandlers" /> is deprecated . It is not required anymore
   [junit4]   2> 39813 T231 N:127.0.0.1:62144_ c:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5133249d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 39813 T230 N:127.0.0.1:62144_ c:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 39815 T166 N:127.0.0.1:62144_ oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 39815 T166 N:127.0.0.1:62144_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 39815 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:62144 collection:collection1 shard:shard2
   [junit4]   2> 39818 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 39826 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 39830 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@40d3736b url=http://127.0.0.1:62144/collection1 node=127.0.0.1:62144_ C7_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:62144, node_name=127.0.0.1:62144_, state=down}
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 C7 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:62144/collection1/
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 C7 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 C7 oasc.SyncStrategy.syncToMe http://127.0.0.1:62144/collection1/ has no replicas
   [junit4]   2> 39832 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:62144/collection1/ shard2
   [junit4]   2> 39833 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 39835 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 39839 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 39841 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 39842 T229 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 39850 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62144",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 39853 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 39854 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 39856 T229 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 39860 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 39876 T166 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1
   [junit4]   2> 39878 T166 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001
   [junit4]   2> 39878 T166 oejs.Server.doStart jetty-9.2.9.v20150224
   [junit4]   2> 39886 T166 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@35c6db9b{/,null,AVAILABLE}
   [junit4]   2> 39889 T166 oejs.AbstractConnector.doStart Started ServerConnector@3a743aeb{HTTP/1.1}{127.0.0.1:62153}
   [junit4]   2> 39890 T166 oejs.Server.doStart Started @43447ms
   [junit4]   2> 39890 T166 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solr.data.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=62153, coreRootDirectory=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores}
   [junit4]   2> 39891 T166 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@659e0bfd
   [junit4]   2> 39891 T166 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\'
   [junit4]   2> 39917 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register We are http://127.0.0.1:62144/collection1/ and leader is http://127.0.0.1:62144/collection1/
   [junit4]   2> 39917 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:62144
   [junit4]   2> 39917 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 39917 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 39918 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 39924 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 39925 T166 oasc.SolrXmlConfig.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\solr.xml
   [junit4]   2> 39927 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62144",
   [junit4]   2> 	  "node_name":"127.0.0.1:62144_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 39929 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62144",
   [junit4]   2> 	  "node_name":"127.0.0.1:62144_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 39933 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 39935 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 39937 T234 N:127.0.0.1:62144_ C:collection1 S:shard2 c:collection1 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 39939 T166 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores
   [junit4]   2> 39939 T166 oasc.CoreContainer.<init> New CoreContainer 1951201625
   [junit4]   2> 39939 T166 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\]
   [junit4]   2> 39939 T166 oasc.CoreContainer.load loading shared library: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\lib
   [junit4]   2> 39940 T166 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\lib).
   [junit4]   2> 39947 T166 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 39949 T166 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 39950 T166 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 39951 T166 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 39951 T166 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 39951 T166 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:62122/solr
   [junit4]   2> 39951 T166 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 39951 T166 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 39952 T166 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 39955 T229 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 39962 T248 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4047cbd1 name:ZooKeeperConnection Watcher:127.0.0.1:62122 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 39962 T166 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 39962 T166 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 39966 T168 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14cd7282c3b0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 39970 T166 N:127.0.0.1:62153_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 39976 T251 N:127.0.0.1:62153_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d2a05b6 name:ZooKeeperConnection Watcher:127.0.0.1:62122/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 39976 T166 N:127.0.0.1:62153_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 39987 T166 N:127.0.0.1:62153_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 41078 T166 N:127.0.0.1:62153_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62153_
   [junit4]   2> 41079 T166 N:127.0.0.1:62153_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:62153_
   [junit4]   2> 41086 T166 N:127.0.0.1:62153_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 41089 T166 N:127.0.0.1:62153_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores
   [junit4]   2> 41091 T166 N:127.0.0.1:62153_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1, collection=collection1, absoluteInstDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\, coreNodeName=, dataDir=data\, shard=}
   [junit4]   2> 41092 T166 N:127.0.0.1:62153_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\
   [junit4]   2> 41092 T166 N:127.0.0.1:62153_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 41096 T252 N:127.0.0.1:62153_ C:collection1 c:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 41096 T252 N:127.0.0.1:62153_ C:collection1 c:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 41099 T194 N:127.0.0.1:62129_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 41101 T252 N:127.0.0.1:62153_ oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 41101 T252 N:127.0.0.1:62153_ oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 41101 T195 N:127.0.0.1:62129_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62153",
   [junit4]   2> 	  "node_name":"127.0.0.1:62153_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 41102 T252 N:127.0.0.1:62153_ oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 41103 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:62153",
   [junit4]   2> 	  "node_name":"127.0.0.1:62153_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 41103 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 41103 T195 N:127.0.0.1:62129_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 41106 T195 N:127.0.0.1:62129_ oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 41106 T252 N:127.0.0.1:62153_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 41107 T252 N:127.0.0.1:62153_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 41107 T229 N:127.0.0.1:62144_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
   [junit4]   2> 41108 T251 N:127.0.0.1:62153_ oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 3)
   [junit4]   2> 41109 T229 N:127.0.0.1:62144_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 41110 T251 N:127.0.0.1:62153_ oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 42185 T252 N:127.0.0.1:62153_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 42185 T252 N:127.0.0.1:62153_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 42185 T252 N:127.0.0.1:62153_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 42186 T252 N:127.0.0.1:62153_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 42187 T252 N:127.0.0.1:62153_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 42187 T252 N:127.0.0.1:62153_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\'
   [junit4]   2> 42199 T252 N:127.0.0.1:62153_ oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 42203 T252 N:127.0.0.1:62153_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 42217 T252 N:127.0.0.1:62153_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 42223 T252 N:127.0.0.1:62153_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 42232 T252 N:127.0.0.1:62153_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 42236 T252 N:127.0.0.1:62153_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 42265 T252 N:127.0.0.1:62153_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 42357 T252 N:127.0.0.1:62153_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 42367 T252 N:127.0.0.1:62153_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 42369 T252 N:127.0.0.1:62153_ oass.IndexSchema.loadCopyFields WARN Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 42370 T252 N:127.0.0.1:62153_ oass.IndexSchema.loadCopyFields WARN Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 42372 T252 N:127.0.0.1:62153_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 42372 T252 N:127.0.0.1:62153_ c:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 42372 T252 N:127.0.0.1:62153_ c:collection1 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\data\
   [junit4]   2> 42372 T252 N:127.0.0.1:62153_ c:collection1 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 42372 T252 N:127.0.0.1:62153_ c:collection1 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-2-001\cores\collection1\data\
   [junit4]   2> 42373 T252 N:127.0.0.1:62153_ c:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client

[...truncated too long message...]

.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:390)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:264)
   [junit4]   2> 		at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 		at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 		at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:147)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 		at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:294)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:291)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:291)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:486)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:455)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:442)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:146)
   [junit4]   2> 		at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:142)
   [junit4]   2> 		... 12 more
   [junit4]   2> 	
   [junit4]   2> 127354 T671 N:127.0.0.1:62317_ oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 127361 T671 N:127.0.0.1:62317_ oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 127361 T671 N:127.0.0.1:62317_ oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 127365 T671 N:127.0.0.1:62317_ oasc.SolrCore.closeSearcher [multicollection2_shard1_replica1] Closing main searcher on request.
   [junit4]   2> 127366 T671 N:127.0.0.1:62317_ oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 127366 T671 N:127.0.0.1:62317_ oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\index;done=false>>]
   [junit4]   2> 127366 T671 N:127.0.0.1:62317_ oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\index
   [junit4]   2> 127366 T671 N:127.0.0.1:62317_ oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\;done=false>>]
   [junit4]   2> 127366 T671 N:127.0.0.1:62317_ oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001\shard-3-003\cores\multicollection2_shard1_replica1\data\
   [junit4]   2> 127467 T166 oejs.AbstractConnector.doStop Stopped ServerConnector@53964b81{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 127468 T166 oejsh.ContextHandler.doStop Stopped o.e.j.s.ServletContextHandler@3927acc0{/,null,UNAVAILABLE}
   [junit4]   2> 127498 T166 C:control_collection S:shard1 c:collection1 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62274 62274
   [junit4]   2> 129960 T442 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:62274 62274
   [junit4]   2> 129962 T442 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		10	/solr/aliases.json
   [junit4]   2> 		10	/solr/clusterstate.json
   [junit4]   2> 		4	/solr/configs/conf1
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		10	/solr/live_nodes
   [junit4]   2> 		3	/solr/overseer/queue
   [junit4]   2> 		3	/solr/overseer/collection-queue-work
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CloudSolrClientTest -Dtests.method=test -Dtests.seed=2E526DF0956F451C -Dtests.slow=true -Dtests.locale=da -Dtests.timezone=America/Argentina/San_Luis -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   48.9s J0 | CloudSolrClientTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:62293/checkStateVerCol: no servers hosting shard: 
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2E526DF0956F451C:A606522A3B9328E4]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:235)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:227)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:135)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:943)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:958)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.stateVersionParamTest(CloudSolrClientTest.java:554)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClientTest.test(CloudSolrClientTest.java:127)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 130021 T166 C:control_collection S:shard1 c:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\temp\solr.client.solrj.impl.CloudSolrClientTest 2E526DF0956F451C-001
   [junit4]   2> NOTE: test params are: codec=Lucene50, sim=DefaultSimilarity, locale=da, timezone=America/Argentina/San_Luis
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0_40 (64-bit)/cpus=3,threads=1,free=138628880,total=243793920
   [junit4]   2> NOTE: All tests run in this JVM: [TermsResponseTest, TestSpellCheckResponse, SolrExampleXMLTest, TestDocumentObjectBinder, TestCloudSolrClientConnections, ModifiableSolrParamsTest, NamedListTest, TestRetryUtil, TestCoreAdmin, TestXMLEscaping, CloudSolrClientTest]
   [junit4] Completed [31/57] on J0 in 94.41s, 3 tests, 1 error <<< FAILURES!

[...truncated 88 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:526: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:474: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:242: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:512: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1415: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:973: There were test failures: 57 suites, 381 tests, 1 error

Total time: 57 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any