You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/06 07:26:27 UTC

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_51) - Build # 3750 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3750/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=190, name=Overseer-91204137578790926-127.0.0.1:49565_-n_0000000019, state=RUNNABLE, group=Overseer collection creation process.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=190, name=Overseer-91204137578790926-127.0.0.1:49565_-n_0000000019, state=RUNNABLE, group=Overseer collection creation process.]
	at __randomizedtesting.SeedInfo.seed([305C701DE741FC23:B1BAFE05901E9C1F]:0)
Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([305C701DE741FC23]:0)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000004
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1266)
	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:291)
	at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:288)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:288)
	at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:474)
	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:190)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
	... 1 more


FAILED:  org.apache.solr.TestDistributedSearch.testDistribSearch

Error Message:
Expected the partialResults header to be null

Stack Trace:
java.lang.AssertionError: Expected the partialResults header to be null
	at __randomizedtesting.SeedInfo.seed([305C701DE741FC23:B1BAFE05901E9C1F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:873)
	at sun.reflect.GeneratedMethodAccessor70.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 9865 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout.
   [junit4]   2> 2234 T10 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2296 T10 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerRolesTest-1391664696690
   [junit4]   2> 2306 T10 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 2313 T11 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2526 T10 oasc.ZkTestServer.run start zk server on port:49510
   [junit4]   2> 2767 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3049 T17 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1290d3 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3051 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3056 T10 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3149 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3155 T19 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@79a5ea name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3156 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3177 T10 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 3186 T10 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 3194 T10 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 3200 T10 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 3209 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3246 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3260 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3260 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 3275 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3276 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3284 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3285 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3292 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3293 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3300 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3301 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 3308 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3308 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3318 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3320 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3328 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3328 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3335 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3336 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3343 T10 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3346 T10 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4681 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4915 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49517
   [junit4]   2> 4967 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 5061 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 5061 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067
   [junit4]   2> 5062 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\'
   [junit4]   2> 5623 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\solr.xml
   [junit4]   2> 6111 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 6143 T10 oasc.CoreContainer.<init> New CoreContainer 21666602
   [junit4]   2> 6144 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\]
   [junit4]   2> 6261 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 6261 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 6262 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 6262 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 6262 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 6262 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 6265 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 6265 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 6267 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 6586 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6590 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6598 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 6599 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 6626 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 6628 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6637 T31 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@367152 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6637 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6648 T12 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14405ae0e6e0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 6651 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6655 T33 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e4cc68 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6655 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6665 T10 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 6683 T10 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 6716 T10 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 6722 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49517_
   [junit4]   2> 6729 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49517_
   [junit4]   2> 6737 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 6742 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 6767 T10 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49517_
   [junit4]   2> 6768 T10 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 6775 T10 oasc.Overseer.start Overseer (id=91204137578790915-127.0.0.1:49517_-n_0000000000) starting
   [junit4]   2> 6809 T10 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 6863 T10 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 6865 T35 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 6867 T10 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 6872 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 6896 T35 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 6900 T34 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 7099 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067
   [junit4]   2> 7468 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\conf\
   [junit4]   2> 7477 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 7486 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 7487 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 7562 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 7567 T38 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57e272 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 7568 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 7570 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 7578 T10 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 8091 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 8097 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 8102 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49529
   [junit4]   2> 8103 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 8103 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 8103 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969
   [junit4]   2> 8103 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\'
   [junit4]   2> 8138 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\solr.xml
   [junit4]   2> 8271 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 8273 T10 oasc.CoreContainer.<init> New CoreContainer 28714143
   [junit4]   2> 8273 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\]
   [junit4]   2> 8277 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 8277 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 8278 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 8278 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 8279 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 8279 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 8280 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 8280 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 8281 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 8286 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 8287 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 8287 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 8288 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 8288 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 8291 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8301 T49 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11e4cd5 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8302 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8309 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 8314 T51 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@150796b name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 8314 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 8325 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 9398 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49529_
   [junit4]   2> 9401 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49529_
   [junit4]   2> 9415 T38 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 9416 T33 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 9415 T51 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 9435 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969
   [junit4]   2> 9707 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\conf\
   [junit4]   2> 9719 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 9721 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 9721 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 10225 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 10227 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 10232 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49538
   [junit4]   2> 10233 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 10234 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 10234 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113
   [junit4]   2> 10234 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\'
   [junit4]   2> 10263 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\solr.xml
   [junit4]   2> 10382 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 10383 T10 oasc.CoreContainer.<init> New CoreContainer 4499214
   [junit4]   2> 10383 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\]
   [junit4]   2> 10386 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 10387 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 10387 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 10388 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 10388 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 10388 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 10389 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 10389 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 10390 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 10393 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 10393 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 10396 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 10396 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 10396 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 10399 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 10421 T63 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@133c8e5 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 10422 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 10429 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 10432 T65 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@50b3cf name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 10433 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 10443 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 11516 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49538_
   [junit4]   2> 11519 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49538_
   [junit4]   2> 11527 T38 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 11527 T33 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 11527 T51 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 11528 T65 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 11541 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113
   [junit4]   2> 11791 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\conf\
   [junit4]   2> 11804 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 11805 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 11805 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 12326 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 12327 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 12332 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49547
   [junit4]   2> 12332 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 12332 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 12332 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196
   [junit4]   2> 12334 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\'
   [junit4]   2> 12368 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\solr.xml
   [junit4]   2> 12495 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 12496 T10 oasc.CoreContainer.<init> New CoreContainer 12239140
   [junit4]   2> 12497 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\]
   [junit4]   2> 12499 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 12500 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 12500 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 12500 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 12501 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 12501 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 12502 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 12503 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 12503 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 12509 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 12511 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 12511 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 12512 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 12512 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 12514 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12523 T77 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@de25ef name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12524 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12532 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12537 T79 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3564a1 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12538 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12548 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 13530 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49547_
   [junit4]   2> 13533 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49547_
   [junit4]   2> 13542 T51 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 13542 T79 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 13543 T38 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 13544 T33 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 13544 T65 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 13559 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196
   [junit4]   2> 13793 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\conf\
   [junit4]   2> 13802 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 13805 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 13805 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 14269 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 14271 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 14276 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49556
   [junit4]   2> 14277 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 14277 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 14277 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196
   [junit4]   2> 14279 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\'
   [junit4]   2> 14306 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\solr.xml
   [junit4]   2> 14415 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 14416 T10 oasc.CoreContainer.<init> New CoreContainer 25082732
   [junit4]   2> 14416 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\]
   [junit4]   2> 14418 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 14418 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 14418 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 14419 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 14419 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 14420 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 14420 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 14420 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 14421 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 14427 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 14428 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 14428 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 14428 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 14430 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 14432 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 14439 T91 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142d526 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 14440 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 14444 T12 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14405ae0e6e000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 14446 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 14449 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@515062 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 14449 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 14457 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 15423 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49556_
   [junit4]   2> 15426 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49556_
   [junit4]   2> 15432 T65 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15433 T33 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15433 T93 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15434 T38 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15434 T51 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15435 T79 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 15446 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196
   [junit4]   2> 15667 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\conf\
   [junit4]   2> 15678 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 15681 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 15681 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 16132 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 16133 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 16138 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49565
   [junit4]   2> 16139 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 16139 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 16139 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072
   [junit4]   2> 16139 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\'
   [junit4]   2> 16168 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\solr.xml
   [junit4]   2> 16278 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 16278 T10 oasc.CoreContainer.<init> New CoreContainer 32264119
   [junit4]   2> 16279 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\]
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 16281 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 16282 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 16282 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 16283 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 16286 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 16286 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 16286 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 16289 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 16289 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 16291 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16299 T105 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14cd7b3 name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16300 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16304 T12 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14405ae0e6e000d, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 16306 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 16309 T107 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb62bd name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 16309 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 16317 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 17283 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49565_
   [junit4]   2> 17285 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49565_
   [junit4]   2> 17294 T65 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17295 T33 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17296 T51 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17296 T38 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17297 T107 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17298 T93 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17299 T79 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 17313 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072
   [junit4]   2> 17569 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\conf\
   [junit4]   2> 17582 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 17584 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 17584 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 18055 T10 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 18057 T10 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 18061 T10 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49574
   [junit4]   2> 18062 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 18062 T10 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 18063 T10 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975
   [junit4]   2> 18063 T10 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\'
   [junit4]   2> 18094 T10 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\solr.xml
   [junit4]   2> 18206 T10 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 18206 T10 oasc.CoreContainer.<init> New CoreContainer 24409729
   [junit4]   2> 18206 T10 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\]
   [junit4]   2> 18208 T10 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 18208 T10 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 18208 T10 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 18209 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 18209 T10 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 18209 T10 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 18210 T10 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 18210 T10 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 18210 T10 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 18215 T10 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 18216 T10 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 18216 T10 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 18216 T10 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49510/solr
   [junit4]   2> 18216 T10 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 18219 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 18231 T119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11010ec name:ZooKeeperConnection Watcher:127.0.0.1:49510 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 18232 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 18235 T12 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14405ae0e6e000f, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 18237 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 18240 T121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bb8cc9 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 18240 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 18248 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 19214 T10 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49574_
   [junit4]   2> 19217 T10 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49574_
   [junit4]   2> 19228 T107 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19228 T79 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19230 T38 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19231 T121 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19231 T93 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19231 T65 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19232 T33 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19232 T51 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 19243 T10 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975
   [junit4]   2> 19492 T10 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\conf\
   [junit4]   2> 19503 T10 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 19504 T10 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 19504 T10 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 19507 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 19510 T124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10354e2 name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 19511 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 19514 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 19524 T10 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 19526 T126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@118cbff name:ZooKeeperConnection Watcher:127.0.0.1:49510/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 19527 T10 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 19530 T10 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 20586 T26 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=testOverseerCol&replicationFactor=2&version=2&maxShardsPerNode=2&wt=javabin&numShards=4&action=CREATE
   [junit4]   2> 20590 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20596 T35 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 20596 T35 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 20600 T35 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 20600 T35 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol 
   [junit4]   2> 20600 T35 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
   [junit4]   2> 20608 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20610 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 20612 T34 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
   [junit4]   2> 20612 T34 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 20632 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20643 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20643 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20644 T79 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20644 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20645 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20645 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20645 T51 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20647 T38 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20648 T126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20649 T124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20705 T35 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
   [junit4]   2> 20705 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:49538_
   [junit4]   2> 20720 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:49565_
   [junit4]   2> 20721 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:49529_
   [junit4]   2> 20722 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:49547_
   [junit4]   2> 20722 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:49574_
   [junit4]   2> 20723 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:49556_
   [junit4]   2> 20723 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:49517_
   [junit4]   2> 20724 T35 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:49538_
   [junit4]   2> 20780 T61 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
   [junit4]   2> 20785 T42 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
   [junit4]   2> 20784 T115 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
   [junit4]   2> 20784 T98 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
   [junit4]   2> 20783 T75 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
   [junit4]   2> 20781 T25 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
   [junit4]   2> 20789 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20789 T61 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20780 T60 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
   [junit4]   2> 20791 T42 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20780 T86 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
   [junit4]   2> 20795 T115 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20795 T75 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20795 T25 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20795 T98 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20797 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20797 T86 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20797 T60 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 20797 T34 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 20799 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49538",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49538_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20810 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49529",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49529_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20815 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20817 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49565",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49565_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20822 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20824 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49574",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49574_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20830 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20832 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49547",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49547_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20837 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20839 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49517",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49517_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20843 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20845 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49538",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49538_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20851 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20853 T34 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49556",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:49556_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 20858 T33 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 20961 T121 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20962 T107 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20962 T79 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20962 T93 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20963 T126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20963 T38 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20964 T124 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20964 T65 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20964 T33 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 20964 T51 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 21751 T61 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
   [junit4]   2> 21754 T42 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
   [junit4]   2> 21756 T98 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
   [junit4]   2> 21756 T115 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
   [junit4]   2> 21759 T98 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\testOverseerCol_shard1_replica2
   [junit4]   2> 21759 T98 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21759 T115 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\testOverseerCol_shard3_replica1
   [junit4]   2> 21760 T115 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21760 T86 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
   [junit4]   2> 21756 T25 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
   [junit4]   2> 21761 T98 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21761 T98 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21762 T25 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\testOverseerCol_shard4_replica1
   [junit4]   2> 21762 T25 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21756 T61 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\testOverseerCol_shard1_replica1
   [junit4]   2> 21763 T61 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21764 T115 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21764 T115 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21765 T25 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21765 T25 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21765 T61 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21766 T61 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21757 T42 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\testOverseerCol_shard2_replica1
   [junit4]   2> 21767 T42 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21757 T75 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
   [junit4]   2> 21769 T60 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
   [junit4]   2> 21771 T61 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\testOverseerCol_shard1_replica1\'
   [junit4]   2> 21771 T42 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21772 T42 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21771 T98 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391664710072\testOverseerCol_shard1_replica2\'
   [junit4]   2> 21774 T60 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\testOverseerCol_shard4_replica2
   [junit4]   2> 21775 T60 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21769 T115 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391664711975\testOverseerCol_shard3_replica1\'
   [junit4]   2> 21780 T60 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21780 T60 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21771 T25 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391664698067\testOverseerCol_shard4_replica1\'
   [junit4]   2> 21770 T86 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\testOverseerCol_shard3_replica2
   [junit4]   2> 21782 T86 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21770 T75 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\testOverseerCol_shard2_replica2
   [junit4]   2> 21788 T75 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 21787 T86 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21789 T86 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21781 T42 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391664701969\testOverseerCol_shard2_replica1\'
   [junit4]   2> 21809 T60 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391664704113\testOverseerCol_shard4_replica2\'
   [junit4]   2> 21809 T75 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 21814 T75 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 21816 T86 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391664708196\testOverseerCol_shard3_replica2\'
   [junit4]   2> 21821 T75 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391664706196\testOverseerCol_shard2_replica2\'
   [junit4]   2> 22097 T86 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22103 T98 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22165 T60 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22172 T115 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22207 T42 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22207 T75 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22424 T25 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22454 T61 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 22623 T98 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22624 T25 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22645 T115 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22661 T42 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22664 T86 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22682 T75 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22692 T60 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22705 T61 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 22718 T115 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22719 T75 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22719 T25 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22719 T60 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22719 T98 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22719 T86 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22718 T42 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22720 T61 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 22814 T60 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
   [junit4]   2> 22825 T115 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
   [junit4]   2> 22835 T42 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
   [junit4]   2> 22841 T25 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
   [junit4]   2> 22844 T86 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
   [junit4]   2> 22850 T75 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
   [junit4]   2> 22857 T98 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
   [junit4]   2> 22858 T61 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
   [junit4]   2> 23307 T42 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23350 T86 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23369 T98 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableIntField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23384 T75 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23384 T98 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23391 T60 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23392 T42 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23393 T86 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23409 T115 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableLongField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23426 T60 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23429 T98 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23430 T86 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23433 T115 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23455 T75 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23478 T42 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableFloatField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 23487 T98 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.SortableDoubleField]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 26308 T115 oass.OpenExchangeRatesOrgProvider.init Initialized wi

[...truncated too long message...]

ount=0;path=.\org.apache.solr.TestDistributedSearch-1391667112636/shard0/data\index;done=false>>]
   [junit4]   2> 2428912 T8412 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1391667112636/shard0/data\index
   [junit4]   2> 2428914 T8412 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/po_z,null}
   [junit4]   2> 2428979 T8412 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=14083776
   [junit4]   2> 2428979 T8412 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@145ea65
   [junit4]   2> 2429003 T8412 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=36,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=8898,transaction_logs_total_number=3}
   [junit4]   2> 2429003 T8412 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2429003 T8412 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2429003 T8412 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2429007 T8412 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2429007 T8412 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2429007 T8412 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\index [CachedDir<<refCount=0;path=.\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\index;done=false>>]
   [junit4]   2> 2429007 T8412 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\index
   [junit4]   2> 2429007 T8412 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\ [CachedDir<<refCount=0;path=.\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\;done=false>>]
   [junit4]   2> 2429007 T8412 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.TestDistributedSearch-1391667112636/shard1/data\
   [junit4]   2> 2429012 T8412 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/po_z,null}
   [junit4]   2> 2429205 T8412 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDistributedSearch -Dtests.method=testDistribSearch -Dtests.seed=305C701DE741FC23 -Dtests.slow=true -Dtests.locale=fi -Dtests.timezone=US/Pacific -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 11.0s | TestDistributedSearch.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Expected the partialResults header to be null
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([305C701DE741FC23:B1BAFE05901E9C1F]:0)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.validateControlData(TestDistributedSearch.java:525)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:445)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.doTest(TestDistributedSearch.java:379)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:873)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 2429219 T8412 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=fi, timezone=US/Pacific
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=2,free=104983824,total=352321536
   [junit4]   2> NOTE: All tests run in this JVM: [OverseerRolesTest, TestSweetSpotSimilarityFactory, TestValueSourceCache, TestDocBasedVersionConstraints, DistribCursorPagingTest, TimeZoneUtilsTest, RequiredFieldsTest, TestDocumentBuilder, BadCopyFieldTest, PathHierarchyTokenizerFactoryTest, UniqFieldsUpdateProcessorFactoryTest, HdfsCollectionsAPIDistributedZkTest, TestSolrCoreProperties, ShardSplitTest, SimplePostToolTest, CoreAdminCreateDiscoverTest, TestModifyConfFiles, TestQuerySenderNoQuery, MultiTermTest, SolrPluginUtilsTest, SliceStateTest, DebugComponentTest, HdfsUnloadDistributedZkTest, BlockCacheTest, UpdateRequestProcessorFactoryTest, TestUniqueKeyFieldResource, NotRequiredUniqueKeyTest, TermsComponentTest, PrimUtilsTest, TestManagedSchema, SpellCheckComponentTest, TestRecoveryHdfs, TestFaceting, ConvertedLegacyTest, TestTrie, AnalysisErrorHandlingTest, CircularListTest, SuggesterTSTTest, DOMUtilTest, TestCodecSupport, TestInfoStreamLogging, TriLevelCompositeIdRoutingTest, DistributedQueryComponentCustomSortTest, TestStressReorder, HdfsBasicDistributedZk2Test, TestLazyCores, ScriptEngineTest, PolyFieldTest, TestFiltering, TestStressVersions, TestMergePolicyConfig, FieldAnalysisRequestHandlerTest, TestLFUCache, HighlighterTest, ResponseLogComponentTest, TestUpdate, TestSort, StatelessScriptUpdateProcessorFactoryTest, TestReloadAndDeleteDocs, TestCharFilters, TestManagedSchemaFieldResource, HdfsRecoveryZkTest, ChaosMonkeyNothingIsSafeTest, TestCloudManagedSchemaAddField, TestNoOpRegenerator, StressHdfsTest, TestSystemIdResolver, MoreLikeThisHandlerTest, TestBinaryField, OutputWriterTest, TestCoreDiscovery, DateFieldTest, AutoCommitTest, SOLR749Test, TestStressLucene, TestDynamicFieldResource, CursorMarkTest, InfoHandlerTest, ConnectionManagerTest, BasicFunctionalityTest, TestFieldTypeCollectionResource, TestCursorMarkWithoutUniqueKey, QueryParsingTest, CoreAdminHandlerTest, CurrencyFieldOpenExchangeTest, SolrCoreTest, SchemaVersionSpecificBehaviorTest, TestXIncludeConfig, PreAnalyzedFieldTest, DisMaxRequestHandlerTest, SolrInfoMBeanTest, ExpressionTest, UnloadDistributedZkTest, ZkControllerTest, TestCopyFieldCollectionResource, TestFastWriter, TestConfig, TestCSVLoader, ZkSolrClientTest, TestSolrIndexConfig, TestComponentsName, TestUtils, TestOverriddenPrefixQueryForCustomFieldType, MBeansHandlerTest, XsltUpdateRequestHandlerTest, SolrCmdDistributorTest, ParsingFieldUpdateProcessorsTest, TestIndexSearcher, TestFreeTextSuggestions, DeleteShardTest, TestSolrQueryParser, AnalysisAfterCoreReloadTest, SimpleFacetsTest, TestSchemaResource, UUIDFieldTest, AbstractAnalyticsFacetTest, ModifyConfFileTest, ResourceLoaderTest, AbstractAnalyticsStatsTest, TestPseudoReturnFields, TestDocSet, TestSurroundQueryParser, SearchHandlerTest, MinimalSchemaTest, TestJmxIntegration, CopyFieldTest, DirectUpdateHandlerTest, TestSolr4Spatial, CoreContainerCoreInitFailuresTest, TestBM25SimilarityFactory, TestRecovery, TestAddFieldRealTimeGet, TestElisionMultitermQuery, XmlUpdateRequestHandlerTest, TestCollationFieldDocValues, TestFieldResource, TestFuzzyAnalyzedSuggestions, NoFacetTest, TestFieldCollectionResource, BinaryUpdateRequestHandlerTest, TestMultiCoreConfBootstrap, SoftAutoCommitTest, TestSolrXMLSerializer, OpenExchangeRatesOrgProviderTest, TestSchemaVersionResource, AlternateDirectoryTest, OverseerTest, IndexSchemaRuntimeFieldTest, HardAutoCommitTest, TestReplicationHandler, DocValuesMultiTest, TestCSVResponseWriter, DistributedDebugComponentTest, TestSolrDeletionPolicy1, ExternalFileFieldSortTest, TestSolrQueryParserDefaultOperatorResource, SpatialFilterTest, HdfsDirectoryTest, BasicDistributedZk2Test, TestDefaultSearchFieldResource, TestDefaultSimilarityFactory, TestNonNRTOpen, TestSuggestSpellingConverter, DocumentAnalysisRequestHandlerTest, FieldMutatingUpdateProcessorTest, TestFoldingMultitermQuery, FunctionTest, SuggestComponentTest, LukeRequestHandlerTest, FieldFacetExtrasTest, QueryFacetTest, SolrXmlInZkTest, JsonLoaderTest, TestRandomDVFaceting, SolrCoreCheckLockOnStartupTest, TestSchemaNameResource, TestPostingsSolrHighlighter, TestSolrXmlPersistor, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, ZkCLITest, ShardRoutingCustomTest, SliceStateUpdateTest, TestDistributedSearch]
   [junit4] Completed in 11.00s, 1 test, 1 failure <<< FAILURES!

[...truncated 511 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 368 suites, 1595 tests, 1 error, 1 failure, 40 ignored (12 assumptions)

Total time: 80 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0-fcs-b128) - Build # 3751 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3751/
Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=3141, name=Overseer-91205893613092880-127.0.0.1:63683_-n_0000000027, state=RUNNABLE, group=Overseer collection creation process.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3141, name=Overseer-91205893613092880-127.0.0.1:63683_-n_0000000027, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([13400B85779243C1]:0)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
	... 1 more




Build Log:
[...truncated 10042 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> 620222 T2961 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 620225 T2961 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerRolesTest-1391691491885
   [junit4]   2> 620228 T2961 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 620229 T2962 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 620339 T2961 oasc.ZkTestServer.run start zk server on port:63619
   [junit4]   2> 620342 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 620349 T2968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2592c7 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620352 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 620352 T2961 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 620365 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 620369 T2970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1ceab name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620370 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 620370 T2961 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 620376 T2961 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 620380 T2961 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 620384 T2961 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 620389 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 620389 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 620397 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 620398 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 620403 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 620403 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 620408 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 620409 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 620414 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 620414 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 620418 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 620419 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 620423 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 620424 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 620428 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 620429 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 620433 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 620433 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 620437 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 620439 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 620443 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 620443 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 621069 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 621090 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63626
   [junit4]   2> 621091 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 621091 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621091 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107
   [junit4]   2> 621092 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\'
   [junit4]   2> 621120 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\solr.xml
   [junit4]   2> 621134 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 621135 T2961 oasc.CoreContainer.<init> New CoreContainer 28455491
   [junit4]   2> 621135 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\]
   [junit4]   2> 621136 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 621136 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 621144 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 621144 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 621145 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 621145 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 621145 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 621146 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621153 T2981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c2a1a name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621153 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621158 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621163 T2983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1acc4ae name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621163 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621167 T2961 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 621177 T2961 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 621183 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 621186 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63626_
   [junit4]   2> 621188 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63626_
   [junit4]   2> 621194 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 621197 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 621204 T2961 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63626_
   [junit4]   2> 621204 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 621208 T2961 oasc.Overseer.start Overseer (id=91205893613092867-127.0.0.1:63626_-n_0000000000) starting
   [junit4]   2> 621213 T2961 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 621220 T2985 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 621220 T2961 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 621222 T2985 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 621225 T2961 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 621227 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 621233 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107
   [junit4]   2> 621233 T2984 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 621567 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\conf\
   [junit4]   2> 621583 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 621584 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 621585 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 621588 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621591 T2988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1385cc0 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621591 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621593 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 621598 T2961 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 622159 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 622160 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 622164 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63638
   [junit4]   2> 622164 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\'
   [junit4]   2> 622192 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\solr.xml
   [junit4]   2> 622203 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 622203 T2961 oasc.CoreContainer.<init> New CoreContainer 710860
   [junit4]   2> 622203 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\]
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 622207 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 622207 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 622210 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 622210 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 622210 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 622210 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 622210 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 622214 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 622229 T2999 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@268df6 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 622230 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 622234 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 622238 T3001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@164af2a name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 622238 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 622244 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 623232 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63638_
   [junit4]   2> 623234 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63638_
   [junit4]   2> 623241 T2983 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623241 T3001 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623242 T2988 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623249 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257
   [junit4]   2> 623598 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\conf\
   [junit4]   2> 623614 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 623616 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 623616 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 624245 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 624246 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 624250 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63647
   [junit4]   2> 624251 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\'
   [junit4]   2> 624282 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\solr.xml
   [junit4]   2> 624291 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 624291 T2961 oasc.CoreContainer.<init> New CoreContainer 15713049
   [junit4]   2> 624291 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\]
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 624299 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 624300 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 624300 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 624300 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 624301 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 624303 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 624313 T3013 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13fc96c name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 624314 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 624320 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 624323 T3015 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@145d589 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 624324 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 624330 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 625318 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63647_
   [junit4]   2> 625320 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63647_
   [junit4]   2> 625326 T3001 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T2983 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T2988 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T3015 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625333 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274
   [junit4]   2> 625639 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\conf\
   [junit4]   2> 625654 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 625656 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 625656 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 626138 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 626138 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 626143 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63656
   [junit4]   2> 626144 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\'
   [junit4]   2> 626172 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\solr.xml
   [junit4]   2> 626182 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 626182 T2961 oasc.CoreContainer.<init> New CoreContainer 4231990
   [junit4]   2> 626182 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\]
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 626188 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 626188 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 626188 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 626188 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 626188 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 626192 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 626203 T3027 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e1dc name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 626204 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 626208 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 626210 T3029 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a76cf2 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 626210 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 626216 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 627204 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63656_
   [junit4]   2> 627206 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63656_
   [junit4]   2> 627214 T2988 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627215 T2983 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627215 T3001 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627216 T3015 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627217 T3029 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627224 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314
   [junit4]   2> 627486 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\conf\
   [junit4]   2> 627498 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 627499 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 627500 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 628013 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 628014 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 628018 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63665
   [junit4]   2> 628019 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\'
   [junit4]   2> 628499 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\solr.xml
   [junit4]   2> 628517 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 628520 T2961 oasc.CoreContainer.<init> New CoreContainer 24057912
   [junit4]   2> 628520 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\]
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 628525 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 628528 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 628528 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 628528 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 628528 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 628531 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 628546 T3041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14543ea name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628546 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 628550 T2963 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1440746ea3b000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 628552 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 628555 T3043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9dcc7 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628556 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 628562 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 629553 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63665_
   [junit4]   2> 629557 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63665_
   [junit4]   2> 629564 T2988 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629565 T3029 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629565 T3015 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629566 T3043 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629567 T2983 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629568 T3001 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629575 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158
   [junit4]   2> 629941 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\conf\
   [junit4]   2> 629960 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 629961 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 629961 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 630483 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 630483 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 630487 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63674
   [junit4]   2> 630488 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\'
   [junit4]   2> 630533 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\solr.xml
   [junit4]   2> 630545 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 630546 T2961 oasc.CoreContainer.<init> New CoreContainer 8781389
   [junit4]   2> 630546 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\]
   [junit4]   2> 630547 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 630550 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 630556 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 630557 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 630557 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 630558 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 630558 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 630559 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 630569 T3055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60dd6f name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630570 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 630576 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 630580 T3057 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cd77b name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630581 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 630586 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 631505 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63674_
   [junit4]   2> 631507 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63674_
   [junit4]   2> 631512 T3015 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631512 T3029 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631513 T3001 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631513 T2988 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T3057 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T2983 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T3043 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631521 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620
   [junit4]   2> 631780 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\conf\
   [junit4]   2> 631795 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 631796 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 631796 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 632383 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 632384 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 632388 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63683
   [junit4]   2> 632389 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 632389 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 632389 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454
   [junit4]   2> 632391 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\'
   [junit4]   2> 632428 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\solr.xml
   [junit4]   2> 632437 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 632437 T2961 oasc.CoreContainer.<init> New CoreContainer 3310175
   [junit4]   2> 632437 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\]
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 632440 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 632440 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 632444 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 632444 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 632445 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 632445 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 632445 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 632447 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 632456 T3069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1827a0 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 632457 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 632463 T2963 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1440746ea3b000f, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 632465 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 632469 T3071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b33865 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 632469 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 632475 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633366 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63683_
   [junit4]   2> 633373 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63683_
   [junit4]   2> 633381 T3071 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T2988 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T3015 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T3043 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T2983 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3001 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3029 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3057 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633391 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454
   [junit4]   2> 633642 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\conf\
   [junit4]   2> 633654 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 633655 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 633655 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 633657 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 633660 T3074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@96af7 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 633661 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 633663 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633668 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 633672 T3076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b13393 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 633672 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 633673 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633679 T3006 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=testOverseerCol&action=CREATE&numShards=4&wt=javabin&version=2
   [junit4]   2> 633681 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633683 T2985 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 633684 T2985 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 633686 T2985 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 633686 T2985 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol 
   [junit4]   2> 633686 T2985 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
   [junit4]   2> 633693 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633696 T2984 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 633697 T2984 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
   [junit4]   2> 633697 T2984 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 633702 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633703 T2988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633705 T3076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633705 T3057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3029 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T2983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633707 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633708 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633782 T2985 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
   [junit4]   2> 633782 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:63674_
   [junit4]   2> 633783 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:63656_
   [junit4]   2> 633784 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:63626_
   [junit4]   2> 633785 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:63683_
   [junit4]   2> 633786 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:63638_
   [junit4]   2> 633788 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:63647_
   [junit4]   2> 633790 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:63665_
   [junit4]   2> 633792 T2978 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
   [junit4]   2> 633793 T3052 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
   [junit4]   2> 633795 T3024 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
   [junit4]   2> 633795 T2993 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
   [junit4]   2> 633795 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:63674_
   [junit4]   2> 633792 T3063 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
   [junit4]   2> 633797 T2978 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633798 T2993 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633798 T3052 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633799 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633798 T3024 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633801 T3036 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
   [junit4]   2> 633801 T3063 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633801 T3007 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
   [junit4]   2> 633803 T3048 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
   [junit4]   2> 633805 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633805 T3036 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633806 T3007 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633806 T2984 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 633807 T3048 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633807 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63626",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63626_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633812 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63674",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63674_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633816 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633817 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63638",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63638_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633821 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633821 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63656",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63656_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633825 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633826 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63683",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63683_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633829 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633832 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63665",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63665_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633835 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633836 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63647",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63647_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633840 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633840 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63674",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63674_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633845 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633938 T2988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633940 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633940 T3076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T2983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3029 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 634683 T2978 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
   [junit4]   2> 634684 T2993 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
   [junit4]   2> 634686 T3052 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
   [junit4]   2> 634688 T2978 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\testOverseerCol_shard2_replica1
   [junit4]   2> 634688 T2993 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\testOverseerCol_shard3_replica1
   [junit4]   2> 634690 T3024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
   [junit4]   2> 634689 T2978 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634690 T3063 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
   [junit4]   2> 634692 T3007 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
   [junit4]   2> 634693 T3024 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\testOverseerCol_shard1_replica2
   [junit4]   2> 634693 T3024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634695 T3036 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
   [junit4]   2> 634696 T3048 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
   [junit4]   2> 634690 T2993 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634699 T2993 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634699 T2993 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634699 T3024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634701 T3024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634699 T2978 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634701 T2978 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634703 T2993 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\testOverseerCol_shard3_replica1\'
   [junit4]   2> 634704 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\testOverseerCol_shard2_replica1\'
   [junit4]   2> 634704 T3024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\testOverseerCol_shard1_replica2\'
   [junit4]   2> 634707 T3052 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1
   [junit4]   2> 634707 T3052 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634709 T3052 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634709 T3052 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634711 T3036 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\testOverseerCol_shard4_replica1
   [junit4]   2> 634711 T3036 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634711 T3048 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2
   [junit4]   2> 634711 T3048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634711 T3063 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\testOverseerCol_shard2_replica2
   [junit4]   2> 634723 T3063 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634716 T3007 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\testOverseerCol_shard3_replica2
   [junit4]   2> 634723 T3007 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634724 T3036 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634724 T3036 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634727 T3048 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634727 T3048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634729 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\'
   [junit4]   2> 634729 T3063 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634730 T3063 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634730 T3007 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634730 T3007 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634734 T3036 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\testOverseerCol_shard4_replica1\'
   [junit4]   2> 634744 T3048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\'
   [junit4]   2> 634753 T3063 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\testOverseerCol_shard2_replica2\'
   [junit4]   2> 634758 T3007 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\testOverseerCol_shard3_replica2\'
   [junit4]   2> 634778 T2993 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634781 T3024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634799 T3036 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634802 T2993 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634805 T3036 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634807 T3024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634814 T3052 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634820 T3052 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634827 T2978 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634834 T2978 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634842 T3048 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634852 T3048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634859 T3063 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634865 T3063 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634871 T3007 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634889 T3007 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634894 T2993 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 634897 T2993 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
   [junit4]   2> 634980 T2993 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 634985 T2993 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 634987 T2993 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 634988 T3036 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 634994 T3036 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
   [junit4]   2> 635064 T3052 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635071 T3052 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
   [junit4]   2> 635146 T3052 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635148 T3052 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635150 T3052 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635153 T3024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635157 T3024 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
   [junit4]   2> 635253 T2978 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635256 T3036 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635256 T2978 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
   [junit4]   2> 635259 T3036 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635260 T3036 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635262 T3048 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635267 T3048 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
   [junit4]   2> 635356 T3024 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635358 T3024 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635360 T3024 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635379 T3048 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635390 T3048 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635391 T3048 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635398 T3063 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635402 T3063 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
   [junit4]   2> 635421 T2978 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635425 T2978 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635429 T2978 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635430 T3007 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635439 T3007 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
   [junit4]   2> 635497 T3063 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635499 T3063 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635501 T3063 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635544 T3007 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635547 T3007 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635548 T3007 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635592 T3052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635597 T3036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635608 T3052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635617 T3036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635620 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635621 T3048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635625 T2993 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635629 T3052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635637 T3036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635640 T2978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635643 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635647 T3048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635651 T2993 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635653 T3063 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635654 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635666 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635666 T3052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635672 T3036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635673 T3036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635673 T3036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635679 T3048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635682 T3024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635686 T2978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635691 T2993 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635695 T3063 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635698 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635698 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635698 T3052 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 635700 T3052 oasc.SolrCore.<init> [testOverseerCol_shard1_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\
   [junit4]   2> 635700 T3052 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@502954
   [junit4]   2> 635704 T3052 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\
   [junit4]   2> 635704 T3052 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index/
   [junit4]   2> 635704 T3052 oasc.SolrCore.initIndex WARN [testOverseerCol_shard1_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 635706 T3052 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index
   [junit4]   2> 635706 T3052 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 635708 T3052 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@e37616 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b18a8b),segFN=segments_1,generation=1}
   [junit4]   2> 635708 T3052 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 635713 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 635715 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 635715 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 635717 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 635717 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 635717 T3052 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 635718 T3052 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 635718 T3052 oasc.RequestHandlers.initHandlersFromConfig created /g

[...truncated too long message...]

92)
   [junit4]    > 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
   [junit4]    > 	... 1 more
   [junit4]   2> 641784 T3029 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 642758 T2961 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 641696 T3015 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 641617 T3001 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 642753 T3057 oasc.SolrCore.closeSearcher [testOverseerCol_shard4_replica2] Closing main searcher on request.
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.closeCacheValue looking to close ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\ [CachedDir<<refCount=0;path=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\;done=false>>]
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.close Closing directory: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\
   [junit4]   2> 642761 T3057 oasc.CachingDirectoryFactory.closeCacheValue looking to close ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index [CachedDir<<refCount=0;path=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index;done=false>>]
   [junit4]   2> 642761 T3057 oasc.CachingDirectoryFactory.close Closing directory: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index
   [junit4]   2> 642761 T3057 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leaders/shard4
   [junit4]   2> 642761 T3057 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 642762 T3057 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard4/election/91205893613092878-core_node8-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 642762 T3057 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=428), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=428)), sim=DefaultSimilarity, locale=ar_JO, timezone=Asia/Ho_Chi_Minh
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=5,free=77021656,total=300154880
   [junit4]   2> NOTE: All tests run in this JVM: [LeaderElectionIntegrationTest, SimpleFacetsTest, TestReloadAndDeleteDocs, TestPseudoReturnFields, TestBinaryResponseWriter, StressHdfsTest, TestRandomDVFaceting, BasicDistributedZk2Test, UniqFieldsUpdateProcessorFactoryTest, AbstractAnalyticsFacetTest, TestAddFieldRealTimeGet, ShowFileRequestHandlerTest, TestIBSimilarityFactory, TestFieldResource, TestSearchPerf, TestDistributedMissingSort, NoFacetTest, AssignTest, FieldMutatingUpdateProcessorTest, TestAnalyzedSuggestions, TestAtomicUpdateErrorCases, ClusterStateUpdateTest, TestCollationField, ClusterStateTest, TestBM25SimilarityFactory, HdfsSyncSliceTest, TestReversedWildcardFilterFactory, TestShardHandlerFactory, SampleTest, WordBreakSolrSpellCheckerTest, TestStressRecovery, HighlighterTest, TestDocSet, AlternateDirectoryTest, FullSolrCloudDistribCmdsTest, URLClassifyProcessorTest, QueryEqualityTest, HdfsCollectionsAPIDistributedZkTest, TestSystemIdResolver, SuggesterTSTTest, SystemInfoHandlerTest, XsltUpdateRequestHandlerTest, DistributedTermsComponentTest, EnumFieldTest, MBeansHandlerTest, AbstractAnalyticsStatsTest, SpellPossibilityIteratorTest, MinimalSchemaTest, TestDistributedSearch, TestUniqueKeyFieldResource, ChaosMonkeySafeLeaderTest, TestZkChroot, TestSurroundQueryParser, TriLevelCompositeIdRoutingTest, TestFunctionQuery, TestDFRSimilarityFactory, TestQuerySenderNoQuery, DirectSolrSpellCheckerTest, TestSolrQueryParserDefaultOperatorResource, IndexSchemaTest, OverseerRolesTest]
   [junit4] Completed in 22.58s, 1 test, 1 error <<< FAILURES!

[...truncated 946 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 368 suites, 1595 tests, 1 error, 40 ignored (12 assumptions)

Total time: 70 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure