You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/06 14:31:34 UTC

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0-fcs-b128) - Build # 3751 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3751/
Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=3141, name=Overseer-91205893613092880-127.0.0.1:63683_-n_0000000027, state=RUNNABLE, group=Overseer collection creation process.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3141, name=Overseer-91205893613092880-127.0.0.1:63683_-n_0000000027, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([13400B85779243C1]:0)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
	... 1 more




Build Log:
[...truncated 10042 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> 620222 T2961 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 620225 T2961 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerRolesTest-1391691491885
   [junit4]   2> 620228 T2961 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 620229 T2962 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 620339 T2961 oasc.ZkTestServer.run start zk server on port:63619
   [junit4]   2> 620342 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 620349 T2968 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2592c7 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620352 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 620352 T2961 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 620365 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 620369 T2970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1ceab name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 620370 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 620370 T2961 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 620376 T2961 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 620380 T2961 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 620384 T2961 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 620389 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 620389 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 620397 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 620398 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 620403 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 620403 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 620408 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 620409 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 620414 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 620414 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 620418 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 620419 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 620423 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 620424 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 620428 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 620429 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 620433 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 620433 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 620437 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 620439 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 620443 T2961 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 620443 T2961 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 621069 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 621090 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63626
   [junit4]   2> 621091 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 621091 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 621091 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107
   [junit4]   2> 621092 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\'
   [junit4]   2> 621120 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\solr.xml
   [junit4]   2> 621134 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 621135 T2961 oasc.CoreContainer.<init> New CoreContainer 28455491
   [junit4]   2> 621135 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\]
   [junit4]   2> 621136 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 621136 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 621137 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 621138 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 621144 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 621144 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 621145 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 621145 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 621145 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 621146 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621153 T2981 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c2a1a name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621153 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621158 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621163 T2983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1acc4ae name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621163 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621167 T2961 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 621177 T2961 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 621183 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 621186 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63626_
   [junit4]   2> 621188 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63626_
   [junit4]   2> 621194 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 621197 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 621204 T2961 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:63626_
   [junit4]   2> 621204 T2961 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 621208 T2961 oasc.Overseer.start Overseer (id=91205893613092867-127.0.0.1:63626_-n_0000000000) starting
   [junit4]   2> 621213 T2961 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 621220 T2985 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 621220 T2961 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 621222 T2985 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 621225 T2961 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 621227 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 621233 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107
   [junit4]   2> 621233 T2984 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 621567 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\conf\
   [junit4]   2> 621583 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 621584 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 621585 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 621588 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 621591 T2988 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1385cc0 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 621591 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 621593 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 621598 T2961 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 622159 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 622160 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 622164 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63638
   [junit4]   2> 622164 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257
   [junit4]   2> 622164 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\'
   [junit4]   2> 622192 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\solr.xml
   [junit4]   2> 622203 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 622203 T2961 oasc.CoreContainer.<init> New CoreContainer 710860
   [junit4]   2> 622203 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\]
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 622205 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 622207 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 622207 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 622210 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 622210 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 622210 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 622210 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 622210 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 622214 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 622229 T2999 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@268df6 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 622230 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 622234 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 622238 T3001 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@164af2a name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 622238 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 622244 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 623232 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63638_
   [junit4]   2> 623234 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63638_
   [junit4]   2> 623241 T2983 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623241 T3001 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623242 T2988 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 623249 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257
   [junit4]   2> 623598 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\conf\
   [junit4]   2> 623614 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 623616 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 623616 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 624245 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 624246 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 624250 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63647
   [junit4]   2> 624251 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274
   [junit4]   2> 624251 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\'
   [junit4]   2> 624282 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\solr.xml
   [junit4]   2> 624291 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 624291 T2961 oasc.CoreContainer.<init> New CoreContainer 15713049
   [junit4]   2> 624291 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\]
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 624293 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 624299 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 624300 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 624300 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 624300 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 624301 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 624303 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 624313 T3013 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13fc96c name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 624314 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 624320 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 624323 T3015 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@145d589 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 624324 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 624330 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 625318 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63647_
   [junit4]   2> 625320 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63647_
   [junit4]   2> 625326 T3001 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T2983 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T2988 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625327 T3015 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 625333 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274
   [junit4]   2> 625639 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\conf\
   [junit4]   2> 625654 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 625656 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 625656 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 626138 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 626138 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 626143 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63656
   [junit4]   2> 626144 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314
   [junit4]   2> 626144 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\'
   [junit4]   2> 626172 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\solr.xml
   [junit4]   2> 626182 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 626182 T2961 oasc.CoreContainer.<init> New CoreContainer 4231990
   [junit4]   2> 626182 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\]
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 626184 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 626188 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 626188 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 626188 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 626188 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 626188 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 626192 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 626203 T3027 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e1dc name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 626204 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 626208 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 626210 T3029 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a76cf2 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 626210 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 626216 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 627204 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63656_
   [junit4]   2> 627206 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63656_
   [junit4]   2> 627214 T2988 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627215 T2983 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627215 T3001 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627216 T3015 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627217 T3029 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 627224 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314
   [junit4]   2> 627486 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\conf\
   [junit4]   2> 627498 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 627499 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 627500 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 628013 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 628014 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 628018 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63665
   [junit4]   2> 628019 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158
   [junit4]   2> 628019 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\'
   [junit4]   2> 628499 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\solr.xml
   [junit4]   2> 628517 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 628520 T2961 oasc.CoreContainer.<init> New CoreContainer 24057912
   [junit4]   2> 628520 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\]
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 628521 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 628525 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 628528 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 628528 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 628528 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 628528 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 628531 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 628546 T3041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14543ea name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628546 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 628550 T2963 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1440746ea3b000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 628552 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 628555 T3043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9dcc7 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 628556 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 628562 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 629553 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63665_
   [junit4]   2> 629557 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63665_
   [junit4]   2> 629564 T2988 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629565 T3029 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629565 T3015 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629566 T3043 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629567 T2983 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629568 T3001 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 629575 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158
   [junit4]   2> 629941 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\conf\
   [junit4]   2> 629960 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 629961 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 629961 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 630483 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 630483 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 630487 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63674
   [junit4]   2> 630488 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620
   [junit4]   2> 630488 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\'
   [junit4]   2> 630533 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\solr.xml
   [junit4]   2> 630545 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 630546 T2961 oasc.CoreContainer.<init> New CoreContainer 8781389
   [junit4]   2> 630546 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\]
   [junit4]   2> 630547 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 630548 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 630549 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 630550 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 630556 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 630557 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 630557 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 630558 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 630558 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 630559 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 630569 T3055 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@60dd6f name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630570 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 630576 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 630580 T3057 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3cd77b name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 630581 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 630586 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 631505 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63674_
   [junit4]   2> 631507 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63674_
   [junit4]   2> 631512 T3015 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631512 T3029 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631513 T3001 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631513 T2988 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T3057 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T2983 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631514 T3043 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 631521 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620
   [junit4]   2> 631780 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\conf\
   [junit4]   2> 631795 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 631796 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 631796 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 632383 T2961 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 632384 T2961 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 632388 T2961 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:63683
   [junit4]   2> 632389 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 632389 T2961 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 632389 T2961 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454
   [junit4]   2> 632391 T2961 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\'
   [junit4]   2> 632428 T2961 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\solr.xml
   [junit4]   2> 632437 T2961 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 632437 T2961 oasc.CoreContainer.<init> New CoreContainer 3310175
   [junit4]   2> 632437 T2961 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\]
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 632439 T2961 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 632440 T2961 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 632440 T2961 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 632444 T2961 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 632444 T2961 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 632445 T2961 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 632445 T2961 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:63619/solr
   [junit4]   2> 632445 T2961 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 632447 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 632456 T3069 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1827a0 name:ZooKeeperConnection Watcher:127.0.0.1:63619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 632457 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 632463 T2963 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1440746ea3b000f, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 632465 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 632469 T3071 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b33865 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 632469 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 632475 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633366 T2961 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63683_
   [junit4]   2> 633373 T2961 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:63683_
   [junit4]   2> 633381 T3071 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T2988 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T3015 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T3043 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633382 T2983 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3001 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3029 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633383 T3057 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 633391 T2961 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454
   [junit4]   2> 633642 T2961 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\conf\
   [junit4]   2> 633654 T2961 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 633655 T2961 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 633655 T2961 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 633657 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 633660 T3074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@96af7 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 633661 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 633663 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633668 T2961 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 633672 T3076 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b13393 name:ZooKeeperConnection Watcher:127.0.0.1:63619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 633672 T2961 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 633673 T2961 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 633679 T3006 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=testOverseerCol&action=CREATE&numShards=4&wt=javabin&version=2
   [junit4]   2> 633681 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633683 T2985 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 633684 T2985 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 633686 T2985 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 633686 T2985 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol 
   [junit4]   2> 633686 T2985 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
   [junit4]   2> 633693 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633696 T2984 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 633697 T2984 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
   [junit4]   2> 633697 T2984 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 633702 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633703 T2988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633705 T3076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633705 T3057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3029 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T2983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633707 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633706 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633708 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633782 T2985 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
   [junit4]   2> 633782 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:63674_
   [junit4]   2> 633783 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:63656_
   [junit4]   2> 633784 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:63626_
   [junit4]   2> 633785 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:63683_
   [junit4]   2> 633786 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:63638_
   [junit4]   2> 633788 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:63647_
   [junit4]   2> 633790 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:63665_
   [junit4]   2> 633792 T2978 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
   [junit4]   2> 633793 T3052 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
   [junit4]   2> 633795 T3024 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
   [junit4]   2> 633795 T2993 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
   [junit4]   2> 633795 T2985 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:63674_
   [junit4]   2> 633792 T3063 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
   [junit4]   2> 633797 T2978 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633798 T2993 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633798 T3052 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633799 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633798 T3024 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633801 T3036 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
   [junit4]   2> 633801 T3063 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633801 T3007 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
   [junit4]   2> 633803 T3048 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
   [junit4]   2> 633805 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633805 T3036 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633806 T3007 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633806 T2984 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 633807 T3048 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 633807 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63626",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63626_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633812 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63674",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63674_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633816 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633817 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63638",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63638_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633821 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633821 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63656",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63656_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633825 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633826 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63683",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63683_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633829 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633832 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63665",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63665_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633835 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633836 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63647",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63647_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633840 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633840 T2984 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:63674",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:63674_",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 633845 T2983 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 633938 T2988 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633940 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633940 T3076 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633941 T3071 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T2983 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3001 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3057 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 633942 T3029 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 634683 T2978 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
   [junit4]   2> 634684 T2993 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
   [junit4]   2> 634686 T3052 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
   [junit4]   2> 634688 T2978 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\testOverseerCol_shard2_replica1
   [junit4]   2> 634688 T2993 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\testOverseerCol_shard3_replica1
   [junit4]   2> 634690 T3024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
   [junit4]   2> 634689 T2978 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634690 T3063 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
   [junit4]   2> 634692 T3007 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
   [junit4]   2> 634693 T3024 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\testOverseerCol_shard1_replica2
   [junit4]   2> 634693 T3024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634695 T3036 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
   [junit4]   2> 634696 T3048 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
   [junit4]   2> 634690 T2993 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634699 T2993 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634699 T2993 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634699 T3024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634701 T3024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634699 T2978 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634701 T2978 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634703 T2993 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391691493257\testOverseerCol_shard3_replica1\'
   [junit4]   2> 634704 T2978 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391691492107\testOverseerCol_shard2_replica1\'
   [junit4]   2> 634704 T3024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391691497314\testOverseerCol_shard1_replica2\'
   [junit4]   2> 634707 T3052 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1
   [junit4]   2> 634707 T3052 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634709 T3052 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634709 T3052 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634711 T3036 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\testOverseerCol_shard4_replica1
   [junit4]   2> 634711 T3036 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634711 T3048 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2
   [junit4]   2> 634711 T3048 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634711 T3063 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\testOverseerCol_shard2_replica2
   [junit4]   2> 634723 T3063 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634716 T3007 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\testOverseerCol_shard3_replica2
   [junit4]   2> 634723 T3007 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 634724 T3036 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634724 T3036 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634727 T3048 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634727 T3048 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634729 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\'
   [junit4]   2> 634729 T3063 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634730 T3063 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634730 T3007 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 634730 T3007 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 634734 T3036 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391691499158\testOverseerCol_shard4_replica1\'
   [junit4]   2> 634744 T3048 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\'
   [junit4]   2> 634753 T3063 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391691503454\testOverseerCol_shard2_replica2\'
   [junit4]   2> 634758 T3007 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391691495274\testOverseerCol_shard3_replica2\'
   [junit4]   2> 634778 T2993 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634781 T3024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634799 T3036 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634802 T2993 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634805 T3036 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634807 T3024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634814 T3052 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634820 T3052 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634827 T2978 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634834 T2978 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634842 T3048 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634852 T3048 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634859 T3063 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634865 T3063 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634871 T3007 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 634889 T3007 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 634894 T2993 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 634897 T2993 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
   [junit4]   2> 634980 T2993 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 634985 T2993 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 634987 T2993 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 634988 T3036 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 634994 T3036 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
   [junit4]   2> 635064 T3052 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635071 T3052 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
   [junit4]   2> 635146 T3052 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635148 T3052 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635150 T3052 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635153 T3024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635157 T3024 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
   [junit4]   2> 635253 T2978 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635256 T3036 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635256 T2978 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
   [junit4]   2> 635259 T3036 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635260 T3036 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635262 T3048 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635267 T3048 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
   [junit4]   2> 635356 T3024 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635358 T3024 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635360 T3024 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635379 T3048 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635390 T3048 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635391 T3048 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635398 T3063 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635402 T3063 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
   [junit4]   2> 635421 T2978 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635425 T2978 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635429 T2978 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635430 T3007 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 635439 T3007 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
   [junit4]   2> 635497 T3063 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635499 T3063 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635501 T3063 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635544 T3007 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 635547 T3007 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 635548 T3007 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 635592 T3052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635597 T3036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635608 T3052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635617 T3036 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635620 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635621 T3048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635625 T2993 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635629 T3052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635637 T3036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635640 T2978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635643 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635647 T3048 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635651 T2993 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635653 T3063 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635654 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635666 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635666 T3052 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635672 T3036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635673 T3036 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635673 T3036 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635679 T3048 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635682 T3024 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635686 T2978 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635691 T2993 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 635695 T3063 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 635698 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 635698 T3052 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 635698 T3052 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 635700 T3052 oasc.SolrCore.<init> [testOverseerCol_shard1_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\
   [junit4]   2> 635700 T3052 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@502954
   [junit4]   2> 635704 T3052 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\
   [junit4]   2> 635704 T3052 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index/
   [junit4]   2> 635704 T3052 oasc.SolrCore.initIndex WARN [testOverseerCol_shard1_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 635706 T3052 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard1_replica1\data\index
   [junit4]   2> 635706 T3052 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 635708 T3052 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@e37616 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b18a8b),segFN=segments_1,generation=1}
   [junit4]   2> 635708 T3052 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 635713 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 635715 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 635715 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 635716 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 635717 T3052 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 635717 T3052 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 635717 T3052 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 635718 T3052 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 635718 T3052 oasc.RequestHandlers.initHandlersFromConfig created /g

[...truncated too long message...]

92)
   [junit4]    > 	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
   [junit4]    > 	... 1 more
   [junit4]   2> 641784 T3029 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 642758 T2961 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 641696 T3015 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 641617 T3001 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 642753 T3057 oasc.SolrCore.closeSearcher [testOverseerCol_shard4_replica2] Closing main searcher on request.
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.closeCacheValue looking to close ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\ [CachedDir<<refCount=0;path=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\;done=false>>]
   [junit4]   2> 642760 T3057 oasc.CachingDirectoryFactory.close Closing directory: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\
   [junit4]   2> 642761 T3057 oasc.CachingDirectoryFactory.closeCacheValue looking to close ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index [CachedDir<<refCount=0;path=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index;done=false>>]
   [junit4]   2> 642761 T3057 oasc.CachingDirectoryFactory.close Closing directory: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391691501620\testOverseerCol_shard4_replica2\data\index
   [junit4]   2> 642761 T3057 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leaders/shard4
   [junit4]   2> 642761 T3057 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 642762 T3057 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard4/election/91205893613092878-core_node8-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 642762 T3057 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=428), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=428)), sim=DefaultSimilarity, locale=ar_JO, timezone=Asia/Ho_Chi_Minh
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=5,free=77021656,total=300154880
   [junit4]   2> NOTE: All tests run in this JVM: [LeaderElectionIntegrationTest, SimpleFacetsTest, TestReloadAndDeleteDocs, TestPseudoReturnFields, TestBinaryResponseWriter, StressHdfsTest, TestRandomDVFaceting, BasicDistributedZk2Test, UniqFieldsUpdateProcessorFactoryTest, AbstractAnalyticsFacetTest, TestAddFieldRealTimeGet, ShowFileRequestHandlerTest, TestIBSimilarityFactory, TestFieldResource, TestSearchPerf, TestDistributedMissingSort, NoFacetTest, AssignTest, FieldMutatingUpdateProcessorTest, TestAnalyzedSuggestions, TestAtomicUpdateErrorCases, ClusterStateUpdateTest, TestCollationField, ClusterStateTest, TestBM25SimilarityFactory, HdfsSyncSliceTest, TestReversedWildcardFilterFactory, TestShardHandlerFactory, SampleTest, WordBreakSolrSpellCheckerTest, TestStressRecovery, HighlighterTest, TestDocSet, AlternateDirectoryTest, FullSolrCloudDistribCmdsTest, URLClassifyProcessorTest, QueryEqualityTest, HdfsCollectionsAPIDistributedZkTest, TestSystemIdResolver, SuggesterTSTTest, SystemInfoHandlerTest, XsltUpdateRequestHandlerTest, DistributedTermsComponentTest, EnumFieldTest, MBeansHandlerTest, AbstractAnalyticsStatsTest, SpellPossibilityIteratorTest, MinimalSchemaTest, TestDistributedSearch, TestUniqueKeyFieldResource, ChaosMonkeySafeLeaderTest, TestZkChroot, TestSurroundQueryParser, TriLevelCompositeIdRoutingTest, TestFunctionQuery, TestDFRSimilarityFactory, TestQuerySenderNoQuery, DirectSolrSpellCheckerTest, TestSolrQueryParserDefaultOperatorResource, IndexSchemaTest, OverseerRolesTest]
   [junit4] Completed in 22.58s, 1 test, 1 error <<< FAILURES!

[...truncated 946 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 368 suites, 1595 tests, 1 error, 40 ignored (12 assumptions)

Total time: 70 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b128 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure