You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/08/02 17:44:03 UTC

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_65) - Build # 4225 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4225/
Java: 32bit/jdk1.7.0_65 -server -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([84E68F1F4902F7E1]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([84E68F1F4902F7E1]:0)




Build Log:
[...truncated 11205 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\init-core-data-001
   [junit4]   2> 2538648 T6719 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 2538648 T6719 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2538654 T6719 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 2538657 T6719 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2538660 T6720 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2538749 T6719 oasc.ZkTestServer.run start zk server on port:53339
   [junit4]   2> 2538750 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2538756 T6726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b7bd1d name:ZooKeeperConnection Watcher:127.0.0.1:53339 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2538756 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2538756 T6719 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2538762 T6721 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14796d6c87b0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2538764 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2538767 T6728 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@180a49a name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2538767 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2538767 T6719 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2538772 T6719 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2538776 T6719 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2538780 T6719 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2538784 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2538784 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2538792 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 2538793 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2538797 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2538797 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2538802 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2538804 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2538808 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2538808 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2538814 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2538814 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2538820 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2538820 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2538827 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2538827 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2538833 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2538833 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2538840 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2538840 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2538846 T6719 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2538847 T6719 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2538853 T6721 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14796d6c87b0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2538855 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2538858 T6730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@166911c name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2538858 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2538861 T6721 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14796d6c87b0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2540943 T6719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2540953 T6719 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2540960 T6719 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53349
   [junit4]   2> 2540963 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2540963 T6719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2540963 T6719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002
   [junit4]   2> 2540966 T6719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002\'
   [junit4]   2> 2541000 T6719 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002\solr.xml
   [junit4]   2> 2541064 T6719 oasc.CoreContainer.<init> New CoreContainer 24705763
   [junit4]   2> 2541064 T6719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002\]
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2541067 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2541069 T6719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2541069 T6719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2541074 T6719 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2541077 T6719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2541078 T6719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2541079 T6719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2541079 T6719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53339/solr
   [junit4]   2> 2541079 T6719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2541082 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2541084 T6741 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1682d2f name:ZooKeeperConnection Watcher:127.0.0.1:53339 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2541086 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2541089 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2541091 T6743 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a8ea75 name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2541092 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2541095 T6719 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2541102 T6719 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2541109 T6719 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2541115 T6719 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2541122 T6719 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2541129 T6719 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2541133 T6719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53349_
   [junit4]   2> 2541135 T6719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53349_
   [junit4]   2> 2541140 T6719 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2541145 T6719 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2541153 T6719 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53349_
   [junit4]   2> 2541153 T6719 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2541157 T6719 oasc.Overseer.start Overseer (id=92208166615056388-127.0.0.1:53349_-n_0000000000) starting
   [junit4]   2> 2541162 T6719 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2541181 T6745 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2541182 T6719 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2541186 T6719 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2541190 T6719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2541195 T6744 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2541249 T6746 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 2541249 T6746 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2541251 T6746 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2541252 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2541255 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2541255 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53349",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53349_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2541255 T6744 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 2541255 T6744 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2541259 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2541260 T6747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2542137 T6746 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2542137 T6746 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2542139 T6746 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2542139 T6746 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2542140 T6746 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2542140 T6746 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002\collection1\'
   [junit4]   2> 2542144 T6746 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 2542146 T6746 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 2542148 T6746 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 2542216 T6746 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 2542264 T6746 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2542268 T6746 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2542278 T6746 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2542696 T6746 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2542698 T6746 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2542701 T6746 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2542707 T6746 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2542746 T6746 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2542747 T6746 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2542747 T6746 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/control/data\
   [junit4]   2> 2542748 T6746 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@139afc
   [junit4]   2> 2542748 T6746 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\control\data
   [junit4]   2> 2542749 T6746 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/control/data\index/
   [junit4]   2> 2542751 T6746 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2542751 T6746 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\control\data\index
   [junit4]   2> 2542752 T6746 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=44.1259765625, floorSegmentMB=1.4833984375, forceMergeDeletesPctAllowed=10.013499255844403, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2542759 T6746 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2542759 T6746 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2542763 T6746 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2542763 T6746 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2542765 T6746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2542765 T6746 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2542765 T6746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2542766 T6746 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2542766 T6746 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2542767 T6746 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2542767 T6746 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2542767 T6746 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2542767 T6746 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2542767 T6746 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2542768 T6746 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2542768 T6746 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2542769 T6746 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2542769 T6746 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2542770 T6746 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2542781 T6746 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2542787 T6746 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2542787 T6746 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2542787 T6746 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2542789 T6746 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2542789 T6746 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2542790 T6746 oass.SolrIndexSearcher.<init> Opening Searcher@1eb9c97[collection1] main
   [junit4]   2> 2542790 T6746 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2542792 T6746 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2542792 T6746 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2542793 T6746 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2542793 T6746 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2542793 T6746 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2542794 T6746 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2542794 T6746 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2542795 T6746 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 2542799 T6746 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2542799 T6746 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2542799 T6746 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2542802 T6748 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1eb9c97[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 2542803 T6746 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2542806 T6751 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:53349 collection:control_collection shard:shard1
   [junit4]   2> 2542806 T6719 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2542807 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2542808 T6751 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2542821 T6751 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2542823 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2542825 T6753 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@95886e name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2542825 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2542826 T6751 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2542826 T6751 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1444 name=collection1 org.apache.solr.core.SolrCore@628bbc url=https://127.0.0.1:53349/collection1 node=127.0.0.1:53349_ C1444_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:53349, core=collection1, node_name=127.0.0.1:53349_}
   [junit4]   2> 2542827 T6751 C1444 P53349 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:53349/collection1/
   [junit4]   2> 2542827 T6751 C1444 P53349 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2542827 T6751 C1444 P53349 oasc.SyncStrategy.syncToMe https://127.0.0.1:53349/collection1/ has no replicas
   [junit4]   2> 2542827 T6751 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:53349/collection1/ shard1
   [junit4]   2> 2542828 T6751 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2542826 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542829 T6719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2542831 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2542835 T6719 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2542844 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542844 T6747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2542844 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2542856 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2542860 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542952 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2542952 T6747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2542987 T6751 oasc.ZkController.register We are https://127.0.0.1:53349/collection1/ and leader is https://127.0.0.1:53349/collection1/
   [junit4]   2> 2542987 T6751 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:53349
   [junit4]   2> 2542987 T6751 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2542987 T6751 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 2542987 T6751 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2542990 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542991 T6756 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542991 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2542991 T6751 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2542993 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2542995 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53349",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53349_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2542998 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2543091 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2543092 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2544865 T6719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 2544867 T6719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2544874 T6719 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2544878 T6719 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53361
   [junit4]   2> 2544883 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2544883 T6719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2544884 T6719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003
   [junit4]   2> 2544885 T6719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003\'
   [junit4]   2> 2544934 T6719 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003\solr.xml
   [junit4]   2> 2545020 T6719 oasc.CoreContainer.<init> New CoreContainer 32147818
   [junit4]   2> 2545021 T6719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003\]
   [junit4]   2> 2545022 T6719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2545023 T6719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2545024 T6719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2545025 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2545025 T6719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2545025 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2545025 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2545025 T6719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2545026 T6719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2545030 T6719 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2545034 T6719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2545035 T6719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2545035 T6719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2545036 T6719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53339/solr
   [junit4]   2> 2545036 T6719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2545038 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2545041 T6767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e700d4 name:ZooKeeperConnection Watcher:127.0.0.1:53339 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2545042 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2545045 T6721 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14796d6c87b0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2545046 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2545048 T6769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1aac0cc name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2545049 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2545060 T6719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2545862 T6719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53361_
   [junit4]   2> 2545862 T6719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53361_
   [junit4]   2> 2545882 T6771 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2545882 T6771 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2545883 T6756 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2545883 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2545883 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2545883 T6771 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2545886 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2545888 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53361",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53361_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2545888 T6744 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 2545888 T6744 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 2545893 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2545893 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2545895 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2545895 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2546682 T6771 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2546682 T6771 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2546684 T6771 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2546684 T6771 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2546685 T6771 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2546686 T6771 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003\collection1\'
   [junit4]   2> 2546689 T6771 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 2546692 T6771 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 2546694 T6771 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 2546758 T6771 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 2546814 T6771 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2546817 T6771 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2546827 T6771 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2547213 T6771 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2547217 T6771 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2547219 T6771 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2547224 T6771 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2547262 T6771 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2547263 T6771 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2547263 T6771 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/jetty1\
   [junit4]   2> 2547263 T6771 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@139afc
   [junit4]   2> 2547264 T6771 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty1
   [junit4]   2> 2547265 T6771 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/jetty1\index/
   [junit4]   2> 2547267 T6771 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 2547268 T6771 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty1\index
   [junit4]   2> 2547268 T6771 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=44.1259765625, floorSegmentMB=1.4833984375, forceMergeDeletesPctAllowed=10.013499255844403, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2547296 T6771 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2547297 T6771 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2547301 T6771 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2547302 T6771 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2547302 T6771 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2547302 T6771 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2547303 T6771 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2547303 T6771 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2547303 T6771 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2547303 T6771 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2547303 T6771 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2547305 T6771 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2547306 T6771 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2547306 T6771 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2547306 T6771 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2547306 T6771 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2547306 T6771 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2547307 T6771 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2547308 T6771 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2547317 T6771 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2547321 T6771 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2547322 T6771 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2547323 T6771 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2547324 T6771 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2547324 T6771 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2547325 T6771 oass.SolrIndexSearcher.<init> Opening Searcher@1aaca34[collection1] main
   [junit4]   2> 2547325 T6771 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2547327 T6771 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2547328 T6771 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2547329 T6771 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2547330 T6771 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2547330 T6771 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2547332 T6771 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2547332 T6771 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2547332 T6771 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 2547332 T6771 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2547336 T6772 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1aaca34[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 2547339 T6771 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2547341 T6775 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:53361 collection:collection1 shard:shard2
   [junit4]   2> 2547342 T6719 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2547342 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2547350 T6775 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2547359 T6775 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 2547363 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547363 T6775 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2547363 T6775 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1445 name=collection1 org.apache.solr.core.SolrCore@1953199 url=https://127.0.0.1:53361/collection1 node=127.0.0.1:53361_ C1445_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:53361, core=collection1, node_name=127.0.0.1:53361_}
   [junit4]   2> 2547363 T6775 C1445 P53361 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:53361/collection1/
   [junit4]   2> 2547364 T6775 C1445 P53361 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2547364 T6775 C1445 P53361 oasc.SyncStrategy.syncToMe https://127.0.0.1:53361/collection1/ has no replicas
   [junit4]   2> 2547364 T6775 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:53361/collection1/ shard2
   [junit4]   2> 2547365 T6775 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 2547367 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2547378 T6747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547378 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547379 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547380 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547388 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2547392 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547475 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547475 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547476 T6747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547508 T6775 oasc.ZkController.register We are https://127.0.0.1:53361/collection1/ and leader is https://127.0.0.1:53361/collection1/
   [junit4]   2> 2547509 T6775 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:53361
   [junit4]   2> 2547509 T6775 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2547509 T6775 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2547509 T6775 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2547511 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547512 T6756 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547512 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547513 T6775 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2547515 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2547517 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53361",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53361_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 2547521 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2547604 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547605 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2547605 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2549310 T6719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 2549311 T6719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2549322 T6719 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2549325 T6719 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53370
   [junit4]   2> 2549331 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2549331 T6719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2549331 T6719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004
   [junit4]   2> 2549331 T6719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004\'
   [junit4]   2> 2549381 T6719 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004\solr.xml
   [junit4]   2> 2549473 T6719 oasc.CoreContainer.<init> New CoreContainer 9897071
   [junit4]   2> 2549475 T6719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004\]
   [junit4]   2> 2549476 T6719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2549477 T6719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2549478 T6719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2549478 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2549479 T6719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2549479 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2549479 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2549479 T6719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2549479 T6719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2549483 T6719 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2549487 T6719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2549487 T6719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2549487 T6719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2549489 T6719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53339/solr
   [junit4]   2> 2549489 T6719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2549492 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2549494 T6786 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b0e61 name:ZooKeeperConnection Watcher:127.0.0.1:53339 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2549495 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2549499 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2549501 T6788 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f61790 name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2549502 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2549512 T6719 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2550318 T6719 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53370_
   [junit4]   2> 2550319 T6719 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53370_
   [junit4]   2> 2550338 T6790 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2550338 T6790 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2550340 T6790 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2550340 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2550340 T6756 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2550340 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2550343 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2550345 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53370",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53370_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 2550345 T6744 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 2550345 T6744 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2550349 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2550350 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2550350 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2550351 T6789 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2550351 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551137 T6790 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2551137 T6790 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2551140 T6790 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2551140 T6790 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2551141 T6790 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2551141 T6790 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004\collection1\'
   [junit4]   2> 2551145 T6790 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 2551146 T6790 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 2551148 T6790 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 2551200 T6790 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 2551241 T6790 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2551242 T6790 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2551251 T6790 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2551548 T6790 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2551550 T6790 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2551552 T6790 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2551556 T6790 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2551583 T6790 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2551583 T6790 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2551583 T6790 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/jetty2\
   [junit4]   2> 2551584 T6790 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@139afc
   [junit4]   2> 2551585 T6790 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty2
   [junit4]   2> 2551585 T6790 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001/jetty2\index/
   [junit4]   2> 2551586 T6790 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 2551587 T6790 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty2\index
   [junit4]   2> 2551587 T6790 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=44.1259765625, floorSegmentMB=1.4833984375, forceMergeDeletesPctAllowed=10.013499255844403, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2551592 T6790 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2551592 T6790 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2551595 T6790 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2551595 T6790 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2551596 T6790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2551596 T6790 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2551596 T6790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2551597 T6790 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2551597 T6790 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2551597 T6790 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2551597 T6790 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2551597 T6790 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2551598 T6790 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2551598 T6790 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2551598 T6790 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2551599 T6790 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2551599 T6790 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2551599 T6790 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2551600 T6790 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2551608 T6790 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2551611 T6790 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2551611 T6790 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2551612 T6790 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=22, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2551613 T6790 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2551613 T6790 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2551613 T6790 oass.SolrIndexSearcher.<init> Opening Searcher@7ac885[collection1] main
   [junit4]   2> 2551614 T6790 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2551616 T6790 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2551616 T6790 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2551616 T6790 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2551616 T6790 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2551617 T6790 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2551618 T6790 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2551618 T6790 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2551618 T6790 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 2551618 T6790 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2551622 T6791 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7ac885[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 2551626 T6790 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2551627 T6794 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:53370 collection:collection1 shard:shard1
   [junit4]   2> 2551628 T6719 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2551628 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2551630 T6794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 2551637 T6794 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2551640 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551641 T6794 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2551641 T6794 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1446 name=collection1 org.apache.solr.core.SolrCore@a289fa url=https://127.0.0.1:53370/collection1 node=127.0.0.1:53370_ C1446_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:53370, core=collection1, node_name=127.0.0.1:53370_}
   [junit4]   2> 2551641 T6794 C1446 P53370 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:53370/collection1/
   [junit4]   2> 2551641 T6794 C1446 P53370 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2551641 T6794 C1446 P53370 oasc.SyncStrategy.syncToMe https://127.0.0.1:53370/collection1/ has no replicas
   [junit4]   2> 2551641 T6794 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:53370/collection1/ shard1
   [junit4]   2> 2551642 T6794 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 2551645 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2551651 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551653 T6789 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551653 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551654 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551655 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551662 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2551665 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551740 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551740 T6789 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551740 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551742 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551768 T6794 oasc.ZkController.register We are https://127.0.0.1:53370/collection1/ and leader is https://127.0.0.1:53370/collection1/
   [junit4]   2> 2551768 T6794 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:53370
   [junit4]   2> 2551768 T6794 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2551768 T6794 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2551768 T6794 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2551770 T6756 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551771 T6747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551771 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551772 T6794 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2551775 T6744 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 2551775 T6744 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:53370",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53370_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 2551777 T6755 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2551854 T6789 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551854 T6755 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551855 T6770 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2551855 T6754 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2553341 T6719 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 2553341 T6719 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2553348 T6719 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2553351 T6719 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:53379
   [junit4]   2> 2553353 T6719 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2553353 T6719 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2553353 T6719 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-005
   [junit4]   2> 2553353 T6719 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-005\'
   [junit4]   2> 2553379 T6719 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-005\solr.xml
   [junit4]   2> 2553425 T6719 oasc.CoreContainer.<init> New CoreContainer 14463720
   [junit4]   2> 2553425 T6719 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ChaosMonkeySafeLeaderTest-84E68F1F4902F7E1-001\tempDir-005\]
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2553427 T6719 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2553429 T6719 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2553432 T6719 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2553432 T6719 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2553432 T6719 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2553432 T6719 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53339/solr
   [junit4]   2> 2553435 T6719 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2553436 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2553437 T6805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b674bd name:ZooKeeperConnection Watcher:127.0.0.1:53339 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2553437 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2553439 T6721 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14796d6c87b000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2553442 T6719 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2553444 T6807 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d4e144 name:ZooKeeperConnection Watcher:127.0.0.1:53339/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2553444 T6719 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4] 

[...truncated too long message...]

h: null state: Disconnected type None
   [junit4]   2> 9828152 T7952 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828152 T8123 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828152 T8405 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828152 T7921 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828151 T8149 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828151 T7692 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828151 T7470 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T8231 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T7840 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T7206 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T7696 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T7796 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828150 T7854 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7624 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7614 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7528 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7374 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7298 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7760 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T8269 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7502 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7390 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7258 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7198 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7238 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7260 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> 9828149 T7272 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: null state: Disconnected type None
   [junit4]   2> NOTE: test params are: codec=Lucene46, sim=DefaultSimilarity, locale=es_CL, timezone=America/Belem
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_65 (32-bit)/cpus=2,threads=1737,free=265876632,total=485490688
   [junit4]   2> NOTE: All tests run in this JVM: [ZkNodePropsTest, BadCopyFieldTest, TestSimpleQParserPlugin, QueryEqualityTest, TestStressLucene, DirectSolrSpellCheckerTest, TestBlendedInfixSuggestions, HdfsWriteToMultipleCollectionsTest, TestWordDelimiterFilterFactory, TestSystemIdResolver, TestIndexingPerformance, TestWriterPerf, TestClassNameShortening, DisMaxRequestHandlerTest, TestReloadAndDeleteDocs, DistribCursorPagingTest, TestFileDictionaryLookup, PolyFieldTest, TestJoin, TestHighlightDedupGrouping, CoreAdminRequestStatusTest, TestElisionMultitermQuery, TestHighFrequencyDictionaryFactory, TestRealTimeGet, RankQueryTest, TestDynamicFieldCollectionResource, FieldFacetTest, TestFiltering, ResourceLoaderTest, ShowFileRequestHandlerTest, SchemaVersionSpecificBehaviorTest, InfoHandlerTest, TestDFRSimilarityFactory, TestReversedWildcardFilterFactory, MergeStrategyTest, TestCloudInspectUtil, AddSchemaFieldsUpdateProcessorFactoryTest, AsyncMigrateRouteKeyTest, SolrIndexConfigTest, AnalysisAfterCoreReloadTest, TestSchemaSimilarityResource, TestLeaderElectionZkExpiry, CollectionsAPIDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, RegexBoostProcessorTest, TestChildDocTransformer, LoggingHandlerTest, TestBinaryResponseWriter, TermsComponentTest, DocumentAnalysisRequestHandlerTest, SolrCmdDistributorTest, CursorPagingTest, PathHierarchyTokenizerFactoryTest, TestCollationField, ScriptEngineTest, TestConfigSets, TestSolrDeletionPolicy2, ConvertedLegacyTest, TestLMJelinekMercerSimilarityFactory, TestReload, TestExtendedDismaxParser, OpenCloseCoreStressTest, DocExpirationUpdateProcessorFactoryTest, CurrencyFieldXmlFileTest, ClusterStateTest, ParsingFieldUpdateProcessorsTest, DistributedDebugComponentTest, TestFastLRUCache, PrimitiveFieldTypeTest, EchoParamsTest, SpellCheckCollatorTest, TestModifyConfFiles, DeleteInactiveReplicaTest, AbstractAnalyticsStatsTest, XsltUpdateRequestHandlerTest, TestRecovery, TestLazyCores, SimplePostToolTest, IndexSchemaRuntimeFieldTest, ExpressionTest, FieldAnalysisRequestHandlerTest, UpdateParamsTest, AtomicUpdatesTest, TestStressVersions, TestRangeQuery, TestZkChroot, SampleTest, PeerSyncTest, ReplicationFactorTest, TestMiniSolrCloudCluster, SuggesterTSTTest, TestPHPSerializedResponseWriter, TestManagedStopFilterFactory, TestReplicationHandlerBackup, FieldMutatingUpdateProcessorTest, TestFoldingMultitermQuery, TestMaxScoreQueryParser, QueryParsingTest, NotRequiredUniqueKeyTest, CoreMergeIndexesAdminHandlerTest, TestImplicitCoreProperties, TestQueryTypes, NumericFieldsTest, CurrencyFieldOpenExchangeTest, BadIndexSchemaTest, TestLMDirichletSimilarityFactory, TestIntervalFaceting, TestOrdValues, AbstractAnalyticsFacetTest, AlternateDirectoryTest, TestStressUserVersions, ResponseHeaderTest, BasicDistributedZkTest, TestGroupingSearch, SolrXmlInZkTest, FullSolrCloudDistribCmdsTest, QueryResultKeyTest, JSONWriterTest, RecoveryZkTest, RollingRestartTest, PrimUtilsTest, TestReRankQParserPlugin, TestSolrXmlPersistence, DirectUpdateHandlerTest, TestCoreDiscovery, TestNoOpRegenerator, TestDistributedGrouping, TestDocBasedVersionConstraints, TestSolrQueryParser, DebugComponentTest, SortByFunctionTest, TestQueryUtils, TestSolrIndexConfig, ReturnFieldsTest, TestFieldResource, SolrTestCaseJ4Test, LukeRequestHandlerTest, RangeFacetTest, AutoCommitTest, CSVRequestHandlerTest, TestFieldSortValues, TestRestManager, HdfsRecoveryZkTest, ConnectionManagerTest, ShardRoutingTest, TimeZoneUtilsTest, SolrIndexSplitterTest, CoreAdminHandlerTest, ZkCLITest, TestDistribDocBasedVersion, DirectUpdateHandlerOptimizeTest, TestStressRecovery, TestAnalyzeInfixSuggestions, SyncSliceTest, TestExceedMaxTermLength, TestRTGBase, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=84E68F1F4902F7E1 -Dtests.slow=true -Dtests.locale=es_CL -Dtests.timezone=America/Belem -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([84E68F1F4902F7E1]:0)
   [junit4] Completed in 7373.70s, 1 test, 2 errors <<< FAILURES!

[...truncated 789 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1298: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:922: There were test failures: 422 suites, 1754 tests, 1 suite-level error, 1 error, 989 ignored (17 assumptions)

Total time: 234 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.7.0_65 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0_20-ea-b23) - Build # 4227 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4227/
Java: 32bit/jdk1.8.0_20-ea-b23 -client -XX:+UseG1GC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch

Error Message:
commitWithin did not work on node: http://127.0.0.1:58942/collection1 expected:<68> but was:<67>

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:58942/collection1 expected:<68> but was:<67>
	at __randomizedtesting.SeedInfo.seed([4BE8DDAB2D9629DC:CA0E53B35AC949E0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:346)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11352 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\init-core-data-001
   [junit4]   2> 3557668 T9963 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 3557672 T9963 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 3557674 T9963 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 3557675 T9964 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 3557775 T9963 oasc.ZkTestServer.run start zk server on port:58923
   [junit4]   2> 3557781 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3557807 T9970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@128eebf name:ZooKeeperConnection Watcher:127.0.0.1:58923 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3557807 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3557808 T9963 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 3557820 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3557822 T9972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ded574 name:ZooKeeperConnection Watcher:127.0.0.1:58923/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3557823 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3557823 T9963 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 3557828 T9963 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 3557833 T9963 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 3557837 T9963 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 3557841 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 3557841 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 3557850 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 3557850 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 3557859 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3557859 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 3557866 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 3557866 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 3557873 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 3557873 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 3557880 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 3557880 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 3557886 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 3557886 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 3557893 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3557893 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 3557900 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3557901 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 3557907 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 3557907 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 3557914 T9963 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 3557914 T9963 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 3560139 T9963 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3560152 T9963 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58930
   [junit4]   2> 3560153 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3560153 T9963 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3560153 T9963 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002
   [junit4]   2> 3560155 T9963 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002\'
   [junit4]   2> 3560196 T9963 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002\solr.xml
   [junit4]   2> 3560214 T9963 oasc.CoreContainer.<init> New CoreContainer 33241113
   [junit4]   2> 3560214 T9963 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002\]
   [junit4]   2> 3560215 T9963 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3560216 T9963 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3560216 T9963 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3560217 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3560217 T9963 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3560218 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3560218 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3560219 T9963 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3560219 T9963 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3560220 T9963 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3560220 T9963 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3560221 T9963 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3560221 T9963 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3560222 T9963 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58923/solr
   [junit4]   2> 3560222 T9963 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3560225 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3560227 T9983 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1807d34 name:ZooKeeperConnection Watcher:127.0.0.1:58923 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3560228 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3560233 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3560235 T9985 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ce31f name:ZooKeeperConnection Watcher:127.0.0.1:58923/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3560236 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3560238 T9963 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 3560242 T9963 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 3560248 T9963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 3560253 T9963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 3560258 T9963 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 3560265 T9963 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 3560269 T9963 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58930_
   [junit4]   2> 3560270 T9963 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58930_
   [junit4]   2> 3560276 T9963 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 3560280 T9963 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 3560288 T9963 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:58930_
   [junit4]   2> 3560289 T9963 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 3560293 T9963 oasc.Overseer.start Overseer (id=92214621062823939-127.0.0.1:58930_-n_0000000000) starting
   [junit4]   2> 3560298 T9963 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 3560318 T9987 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 3560320 T9963 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 3560325 T9963 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 3560329 T9963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3560335 T9986 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 3560341 T9988 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 3560341 T9988 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3560343 T9988 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3560343 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3560348 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3560349 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58930",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58930_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3560349 T9986 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 3560350 T9986 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 3560355 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3560357 T9989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3561343 T9988 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3561343 T9988 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 3561346 T9988 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3561346 T9988 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3561352 T9988 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3561352 T9988 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002\collection1\'
   [junit4]   2> 3561356 T9988 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 3561358 T9988 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 3561363 T9988 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 3561418 T9988 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 3561430 T9988 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3561434 T9988 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3561446 T9988 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3561589 T9988 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3561600 T9988 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3561602 T9988 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3561637 T9988 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3561643 T9988 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3561650 T9988 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3561652 T9988 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3561652 T9988 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3561652 T9988 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3561655 T9988 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3561655 T9988 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3561655 T9988 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 3561657 T9988 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3561657 T9988 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/control/data\
   [junit4]   2> 3561657 T9988 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11bd809
   [junit4]   2> 3561659 T9988 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/control/data\
   [junit4]   2> 3561659 T9988 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/control/data\index/
   [junit4]   2> 3561659 T9988 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 3561661 T9988 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/control/data\index
   [junit4]   2> 3561661 T9988 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=70.8564453125, floorSegmentMB=1.9111328125, forceMergeDeletesPctAllowed=25.574418519562695, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7923889691313434
   [junit4]   2> 3561662 T9988 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2c039e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dfb259),segFN=segments_1,generation=1}
   [junit4]   2> 3561662 T9988 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3561668 T9988 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3561669 T9988 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3561669 T9988 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3561670 T9988 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3561670 T9988 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3561670 T9988 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3561672 T9988 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3561672 T9988 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3561672 T9988 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3561673 T9988 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3561673 T9988 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3561674 T9988 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3561674 T9988 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3561675 T9988 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3561676 T9988 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3561676 T9988 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3561676 T9988 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3561678 T9988 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3561678 T9988 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3561679 T9988 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3561679 T9988 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3561680 T9988 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 3561687 T9988 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3561688 T9988 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3561689 T9988 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3561691 T9988 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3561693 T9988 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3561699 T9988 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3561699 T9988 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3561700 T9988 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=32.0625, floorSegmentMB=0.84765625, forceMergeDeletesPctAllowed=25.184613821340218, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 3561701 T9988 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2c039e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@dfb259),segFN=segments_1,generation=1}
   [junit4]   2> 3561701 T9988 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3561701 T9988 oass.SolrIndexSearcher.<init> Opening Searcher@1c46f20[collection1] main
   [junit4]   2> 3561702 T9988 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 3561705 T9988 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3561705 T9988 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3561706 T9988 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3561706 T9988 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3561706 T9988 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3561708 T9988 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3561709 T9988 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3561710 T9988 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 3561713 T9988 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3561713 T9988 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3561713 T9988 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3561725 T9990 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c46f20[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 3561725 T9988 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3561728 T9993 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58930 collection:control_collection shard:shard1
   [junit4]   2> 3561729 T9963 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 3561730 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3561731 T9993 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 3561733 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3561736 T9995 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b50909 name:ZooKeeperConnection Watcher:127.0.0.1:58923/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3561737 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3561739 T9963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3561744 T9963 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 3561744 T9993 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 3561747 T9993 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3561747 T9993 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2191 name=collection1 org.apache.solr.core.SolrCore@1368922 url=http://127.0.0.1:58930/collection1 node=127.0.0.1:58930_ C2191_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:58930, core=collection1, node_name=127.0.0.1:58930_}
   [junit4]   2> 3561747 T9993 C2191 P58930 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58930/collection1/
   [junit4]   2> 3561747 T9993 C2191 P58930 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3561747 T9993 C2191 P58930 oasc.SyncStrategy.syncToMe http://127.0.0.1:58930/collection1/ has no replicas
   [junit4]   2> 3561747 T9993 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58930/collection1/ shard1
   [junit4]   2> 3561750 T9993 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 3561751 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561755 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3561764 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561766 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561773 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561875 T9989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3561876 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3561922 T9993 oasc.ZkController.register We are http://127.0.0.1:58930/collection1/ and leader is http://127.0.0.1:58930/collection1/
   [junit4]   2> 3561922 T9993 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58930
   [junit4]   2> 3561922 T9993 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3561922 T9993 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 3561922 T9993 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3561929 T9993 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3561930 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561930 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561932 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3561933 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3561934 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58930",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58930_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 3561939 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3562042 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3562043 T9989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 3563945 T9963 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 3563946 T9963 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3563952 T9963 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58942
   [junit4]   2> 3563952 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3563959 T9963 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3563963 T9963 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003
   [junit4]   2> 3563964 T9963 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003\'
   [junit4]   2> 3564018 T9963 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003\solr.xml
   [junit4]   2> 3564035 T9963 oasc.CoreContainer.<init> New CoreContainer 25216454
   [junit4]   2> 3564036 T9963 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003\]
   [junit4]   2> 3564037 T9963 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3564037 T9963 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3564038 T9963 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3564038 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3564038 T9963 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3564038 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3564038 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3564041 T9963 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3564042 T9963 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3564042 T9963 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3564043 T9963 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3564043 T9963 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3564043 T9963 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3564044 T9963 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58923/solr
   [junit4]   2> 3564044 T9963 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3564046 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3564049 T10008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f369df name:ZooKeeperConnection Watcher:127.0.0.1:58923 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3564051 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3564057 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3564061 T10010 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f5c4a name:ZooKeeperConnection Watcher:127.0.0.1:58923/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3564061 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3564075 T9963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3565096 T9963 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58942_
   [junit4]   2> 3565100 T9963 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58942_
   [junit4]   2> 3565127 T10012 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 3565127 T10012 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3565129 T10012 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3565129 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3565130 T10013 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3565130 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3565133 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3565135 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58942",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58942_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3565135 T9986 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 3565135 T9986 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 3565141 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3565142 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3565142 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3565143 T9997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566130 T10012 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3566130 T10012 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 3566133 T10012 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3566133 T10012 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3566138 T10012 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3566138 T10012 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003\collection1\'
   [junit4]   2> 3566142 T10012 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 3566142 T10012 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 3566145 T10012 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 3566196 T10012 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 3566208 T10012 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3566212 T10012 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3566217 T10012 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3566348 T10012 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3566356 T10012 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3566356 T10012 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3566380 T10012 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3566385 T10012 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3566391 T10012 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3566393 T10012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3566395 T10012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3566395 T10012 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3566398 T10012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3566398 T10012 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3566398 T10012 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 3566398 T10012 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3566400 T10012 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty1\
   [junit4]   2> 3566400 T10012 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11bd809
   [junit4]   2> 3566401 T10012 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty1\
   [junit4]   2> 3566401 T10012 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty1\index/
   [junit4]   2> 3566401 T10012 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 3566402 T10012 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty1\index
   [junit4]   2> 3566403 T10012 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=70.8564453125, floorSegmentMB=1.9111328125, forceMergeDeletesPctAllowed=25.574418519562695, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7923889691313434
   [junit4]   2> 3566404 T10012 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@f175d0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1905dce),segFN=segments_1,generation=1}
   [junit4]   2> 3566404 T10012 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3566412 T10012 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3566413 T10012 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3566417 T10012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3566417 T10012 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3566417 T10012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3566418 T10012 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3566419 T10012 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3566420 T10012 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3566420 T10012 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3566421 T10012 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3566424 T10012 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3566425 T10012 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3566426 T10012 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3566428 T10012 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3566429 T10012 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3566429 T10012 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3566429 T10012 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3566432 T10012 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3566432 T10012 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3566434 T10012 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3566435 T10012 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3566436 T10012 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 3566443 T10012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3566445 T10012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3566446 T10012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3566449 T10012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3566451 T10012 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3566456 T10012 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3566456 T10012 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3566457 T10012 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=32.0625, floorSegmentMB=0.84765625, forceMergeDeletesPctAllowed=25.184613821340218, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 3566458 T10012 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@f175d0 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1905dce),segFN=segments_1,generation=1}
   [junit4]   2> 3566458 T10012 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3566459 T10012 oass.SolrIndexSearcher.<init> Opening Searcher@44ed52[collection1] main
   [junit4]   2> 3566459 T10012 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3566462 T10012 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3566463 T10012 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3566463 T10012 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3566463 T10012 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3566464 T10012 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3566466 T10012 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3566467 T10012 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3566467 T10012 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 3566467 T10012 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3566477 T10014 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@44ed52[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 3566486 T10012 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3566488 T10017 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58942 collection:collection1 shard:shard2
   [junit4]   2> 3566489 T9963 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 3566489 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3566493 T10017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 3566505 T10017 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 3566507 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566508 T10017 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3566509 T10017 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2192 name=collection1 org.apache.solr.core.SolrCore@12c1fe6 url=http://127.0.0.1:58942/collection1 node=127.0.0.1:58942_ C2192_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:58942, core=collection1, node_name=127.0.0.1:58942_}
   [junit4]   2> 3566509 T10017 C2192 P58942 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58942/collection1/
   [junit4]   2> 3566509 T10017 C2192 P58942 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3566509 T10017 C2192 P58942 oasc.SyncStrategy.syncToMe http://127.0.0.1:58942/collection1/ has no replicas
   [junit4]   2> 3566509 T10017 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58942/collection1/ shard2
   [junit4]   2> 3566510 T10017 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 3566515 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3566523 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566526 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566533 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566638 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566639 T9997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566639 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566683 T10017 oasc.ZkController.register We are http://127.0.0.1:58942/collection1/ and leader is http://127.0.0.1:58942/collection1/
   [junit4]   2> 3566683 T10017 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58942
   [junit4]   2> 3566683 T10017 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3566683 T10017 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 3566683 T10017 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3566686 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566686 T10013 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566687 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566689 T10017 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3566691 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3566692 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58942",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58942_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 3566697 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3566798 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566799 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3566801 T9989 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 3568820 T9963 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 3568821 T9963 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 3568827 T9963 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58951
   [junit4]   2> 3568830 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 3568830 T9963 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3568830 T9963 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004
   [junit4]   2> 3568830 T9963 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004\'
   [junit4]   2> 3568874 T9963 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004\solr.xml
   [junit4]   2> 3568890 T9963 oasc.CoreContainer.<init> New CoreContainer 2129435
   [junit4]   2> 3568890 T9963 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004\]
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3568893 T9963 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3568896 T9963 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3568896 T9963 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 3568896 T9963 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3568898 T9963 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3568898 T9963 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 3568899 T9963 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58923/solr
   [junit4]   2> 3568899 T9963 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 3568901 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3568904 T10028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16cfb name:ZooKeeperConnection Watcher:127.0.0.1:58923 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3568905 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3568910 T9963 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 3568912 T10030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@18b2e1b name:ZooKeeperConnection Watcher:127.0.0.1:58923/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 3568912 T9963 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 3568924 T9963 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 3569931 T9963 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58951_
   [junit4]   2> 3569935 T9963 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58951_
   [junit4]   2> 3569962 T10032 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 3569962 T10032 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3569963 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3569964 T10032 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 3569964 T10013 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3569964 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3569969 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3569970 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58951",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58951_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 3569971 T9986 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 3569971 T9986 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 3569976 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3569977 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3569977 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3569978 T10031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3569978 T9997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3570964 T10032 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 3570964 T10032 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 3570965 T10032 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 3570965 T10032 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3570972 T10032 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3570973 T10032 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004\collection1\'
   [junit4]   2> 3570977 T10032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 3570977 T10032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 3570979 T10032 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 3571028 T10032 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 3571064 T10032 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 3571068 T10032 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 3571077 T10032 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3571207 T10032 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 3571228 T10032 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3571231 T10032 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3571255 T10032 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3571260 T10032 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 3571265 T10032 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3571267 T10032 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3571268 T10032 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3571268 T10032 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 3571271 T10032 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 3571271 T10032 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 3571271 T10032 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 3571271 T10032 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3571273 T10032 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty2\
   [junit4]   2> 3571273 T10032 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@11bd809
   [junit4]   2> 3571275 T10032 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty2\
   [junit4]   2> 3571275 T10032 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty2\index/
   [junit4]   2> 3571275 T10032 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 3571276 T10032 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001\tempDir-001/jetty2\index
   [junit4]   2> 3571276 T10032 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=9, maxMergeAtOnceExplicit=9, maxMergedSegmentMB=70.8564453125, floorSegmentMB=1.9111328125, forceMergeDeletesPctAllowed=25.574418519562695, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7923889691313434
   [junit4]   2> 3571278 T10032 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@10ff6d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4d63c3),segFN=segments_1,generation=1}
   [junit4]   2> 3571278 T10032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3571285 T10032 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 3571285 T10032 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 3571286 T10032 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 3571286 T10032 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3571286 T10032 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 3571287 T10032 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 3571287 T10032 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3571292 T10032 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 3571292 T10032 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3571293 T10032 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3571294 T10032 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3571295 T10032 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3571296 T10032 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3571297 T10032 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3571298 T10032 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 3571299 T10032 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 3571300 T10032 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 3571302 T10032 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 3571302 T10032 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 3571304 T10032 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 3571306 T10032 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 3571308 T10032 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 3571317 T10032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3571319 T10032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3571320 T10032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3571322 T10032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3571325 T10032 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 3571330 T10032 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3571330 T10032 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3571333 T10032 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=21, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=32.0625, floorSegmentMB=0.84765625, forceMergeDeletesPctAllowed=25.184613821340218, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 3571334 T10032 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@10ff6d1 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@4d63c3),segFN=segments_1,generation=1}
   [junit4]   2> 3571334 T10032 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3571336 T10032 oass.SolrIndexSearcher.<init> Opening Searcher@1013293[collection1] main
   [junit4]   2> 3571336 T10032 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 3571339 T10032 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 3571339 T10032 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 3571341 T10032 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 3571341 T10032 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 3571341 T10032 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3571345 T10032 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 3571345 T10032 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 3571345 T10032 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 3571345 T10032 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 3571355 T10033 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1013293[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 3571363 T10032 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3571365 T10036 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58951 collection:collection1 shard:shard1
   [junit4]   2> 3571366 T9963 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 3571367 T9963 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 3571369 T10036 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 3571381 T10036 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 3571385 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571387 T10036 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 3571389 T10036 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2193 name=collection1 org.apache.solr.core.SolrCore@17bc203 url=http://127.0.0.1:58951/collection1 node=127.0.0.1:58951_ C2193_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:58951, core=collection1, node_name=127.0.0.1:58951_}
   [junit4]   2> 3571390 T10036 C2193 P58951 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58951/collection1/
   [junit4]   2> 3571390 T10036 C2193 P58951 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 3571390 T10036 C2193 P58951 oasc.SyncStrategy.syncToMe http://127.0.0.1:58951/collection1/ has no replicas
   [junit4]   2> 3571390 T10036 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58951/collection1/ shard1
   [junit4]   2> 3571391 T10036 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 3571394 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3571402 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571405 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571412 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571516 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571517 T9997 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571517 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571518 T10031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571559 T10036 oasc.ZkController.register We are http://127.0.0.1:58951/collection1/ and leader is http://127.0.0.1:58951/collection1/
   [junit4]   2> 3571559 T10036 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58951
   [junit4]   2> 3571559 T10036 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 3571560 T10036 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 3571560 T10036 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 3571563 T9989 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571563 T9997 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571564 T10013 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571564 T10036 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3571568 T9986 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 3571569 T9986 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58951",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:58951_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 3571573 T10013 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 3571676 T9996 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571676 T10011 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571677 T10031 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3571677 T10013 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 3573608 T9963 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 3573609 T9963 oejs.Server.doStart j

[...truncated too long message...]

ava.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 3622818 T10105 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@16b863 rejected from java.util.concurrent.ThreadPoolExecutor@a28c96[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 15]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 3622827 T10105 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@7dea63 rejected from java.util.concurrent.ThreadPoolExecutor@a28c96[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 15]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:201)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=4BE8DDAB2D9629DC -Dtests.slow=true -Dtests.locale=fr_CA -Dtests.timezone=Africa/Lubumbashi -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 65.2s | BasicDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:58942/collection1 expected:<68> but was:<67>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4BE8DDAB2D9629DC:CA0E53B35AC949E0]:0)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:346)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 3622847 T9963 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.BasicDistributedZkTest-4BE8DDAB2D9629DC-001
   [junit4]   2> 65188 T9962 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene46, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=fr_CA, timezone=Africa/Lubumbashi
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=2,threads=1,free=70113976,total=221249536
   [junit4]   2> NOTE: All tests run in this JVM: [TestPseudoReturnFields, UnloadDistributedZkTest, DateMathParserTest, TestModifyConfFiles, NumericFieldsTest, JSONWriterTest, DistributedExpandComponentTest, TestMissingGroups, SuggesterTest, TestUniqueKeyFieldResource, QueryElevationComponentTest, AnalyticsMergeStrategyTest, DefaultValueUpdateProcessorTest, TestReversedWildcardFilterFactory, RollingRestartTest, InfoHandlerTest, TestCoreContainer, TestQueryUtils, DocumentAnalysisRequestHandlerTest, HardAutoCommitTest, TestPerFieldSimilarity, TestStressReorder, TestNonDefinedSimilarityFactory, RemoteQueryErrorTest, HdfsLockFactoryTest, ShardRoutingTest, ExternalFileFieldSortTest, TestFunctionQuery, TestFieldResource, TestGroupingSearch, PrimitiveFieldTypeTest, TestFieldTypeCollectionResource, CoreAdminRequestStatusTest, FieldFacetExtrasTest, TestTolerantSearch, TestCSVResponseWriter, TestRangeQuery, TestShortCircuitedRequests, TestBadConfig, SearchHandlerTest, DocValuesTest, SolrTestCaseJ4Test, TestFieldTypeResource, TestQuerySenderNoQuery, CoreAdminCreateDiscoverTest, XsltUpdateRequestHandlerTest, RangeFacetTest, DirectSolrSpellCheckerTest, TestSolrDeletionPolicy2, TestRandomFaceting, FileBasedSpellCheckerTest, SliceStateTest, QueryEqualityTest, TestFieldSortValues, TestSchemaNameResource, BadIndexSchemaTest, AnalysisErrorHandlingTest, IndexBasedSpellCheckerTest, TestValueSourceCache, TestCloudInspectUtil, TestRandomMergePolicy, StatelessScriptUpdateProcessorFactoryTest, ResponseLogComponentTest, CoreContainerCoreInitFailuresTest, ResponseHeaderTest, BasicZkTest, TestShardHandlerFactory, CoreMergeIndexesAdminHandlerTest, SolrPluginUtilsTest, ResourceLoaderTest, LeaderElectionIntegrationTest, TestBinaryResponseWriter, TestXIncludeConfig, DistributedQueryComponentOptimizationTest, TestExpandComponent, ExpressionTest, DirectSolrConnectionTest, ShardRoutingCustomTest, TestFileDictionaryLookup, BlockCacheTest, AlternateDirectoryTest, IndexSchemaRuntimeFieldTest, TestQuerySenderListener, TestSolrCoreProperties, TestComplexPhraseQParserPlugin, TestLFUCache, BlockDirectoryTest, TestHashPartitioner, TestSort, PluginInfoTest, TestCSVLoader, DeleteReplicaTest, OverseerRolesTest, AddBlockUpdateTest, MinimalSchemaTest, EchoParamsTest, TestLeaderElectionZkExpiry, SynonymTokenizerTest, TestRecoveryHdfs, UUIDFieldTest, ShardSplitTest, TestMaxScoreQueryParser, TestSolrQueryParserDefaultOperatorResource, TestTrie, DistributedIntervalFacetingTest, TestDistributedMissingSort, DocExpirationUpdateProcessorFactoryTest, StatsComponentTest, LoggingHandlerTest, TestDistributedSearch, TriLevelCompositeIdRoutingTest, LegacyHTMLStripCharFilterTest, TestChildDocTransformer, ClusterStateUpdateTest, SimpleFacetsTest, TestSuggestSpellingConverter, TestCodecSupport, SolrRequestParserTest, TestArbitraryIndexDir, TestRemoteStreaming, TestSearcherReuse, TestRequestStatusCollectionAPI, OverseerStatusTest, TestRTGBase, BinaryUpdateRequestHandlerTest, AutoCommitTest, TestCollectionAPI, FastVectorHighlighterTest, QueryFacetTest, AbstractAnalyticsStatsTest, PreAnalyzedFieldTest, HttpPartitionTest, TestSystemIdResolver, TestJmxMonitoredMap, TestFiltering, TestDocBasedVersionConstraints, CollectionsAPIAsyncDistributedZkTest, TestNRTOpen, BadComponentTest, PreAnalyzedUpdateProcessorTest, HdfsWriteToMultipleCollectionsTest, FullSolrCloudDistribCmdsTest, SortByFunctionTest, NoCacheHeaderTest, SolrIndexConfigTest, SSLMigrationTest, ChaosMonkeySafeLeaderTest, TestSolrXmlPersistor, TestRandomDVFaceting, TestDistributedGrouping, FieldMutatingUpdateProcessorTest, TestReplicationHandler, TestWriterPerf, TestCopyFieldCollectionResource, TestDefaultSimilarityFactory, ZkSolrClientTest, TestZkChroot, PolyFieldTest, TestLuceneMatchVersion, DateFieldTest, TestDocumentBuilder, TestCollationField, OverseerTest, HdfsRecoveryZkTest, DistributedDebugComponentTest, TestConfig, TestBlendedInfixSuggestions, TestBinaryField, SpellCheckCollatorTest, OutputWriterTest, TestJoin, SolrCoreTest, StressHdfsTest, TestSchemaSimilarityResource, TestExtendedDismaxParser, DirectUpdateHandlerTest, TestInitQParser, DocValuesMissingTest, TestStandardQParsers, OpenExchangeRatesOrgProviderTest, TimeZoneUtilsTest, MBeansHandlerTest, DocValuesMultiTest, DistanceFunctionTest, TestSurroundQueryParser, ZkControllerTest, BasicDistributedZkTest]
   [junit4] Completed in 65.52s, 1 test, 1 failure <<< FAILURES!

[...truncated 746 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1298: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:922: There were test failures: 422 suites, 1756 tests, 1 failure, 44 ignored (23 assumptions)

Total time: 148 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20-ea-b23 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0_20-ea-b23) - Build # 4226 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4226/
Java: 64bit/jdk1.8.0_20-ea-b23 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.schema.TestCloudSchemaless.testDistribSearch

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:64978/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:64978/collection1
	at __randomizedtesting.SeedInfo.seed([1B8F8D519FD8E272:9A690349E887824E]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:561)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:68)
	at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:54)
	at org.apache.solr.schema.TestCloudSchemaless.doTest(TestCloudSchemaless.java:140)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
	at sun.reflect.GeneratedMethodAccessor49.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:150)
	at java.net.SocketInputStream.read(SocketInputStream.java:121)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:465)
	at sun.security.ssl.InputRecord.read(InputRecord.java:503)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:954)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:911)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:105)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:449)
	... 46 more




Build Log:
[...truncated 12007 lines...]
   [junit4] Suite: org.apache.solr.schema.TestCloudSchemaless
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\init-core-data-001
   [junit4]   2> 6383925 T18935 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 6383925 T18935 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 6383933 T18935 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 6383933 T18935 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 6383936 T18936 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 6384054 T18935 oasc.ZkTestServer.run start zk server on port:64956
   [junit4]   2> 6384056 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6384062 T18942 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3287ad50 name:ZooKeeperConnection Watcher:127.0.0.1:64956 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6384063 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6384063 T18935 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 6384071 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6384073 T18944 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47b135dc name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6384073 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6384073 T18935 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 6384079 T18935 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 6384083 T18935 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 6384087 T18935 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 6384091 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-schemaless.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 6384092 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 6384098 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema-add-schema-fields-update-processor.xml to /configs/conf1/schema.xml
   [junit4]   2> 6384099 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 6384103 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 6384104 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 6384108 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 6384108 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 6384113 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 6384114 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 6384117 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 6384119 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 6384123 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 6384124 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 6384128 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 6384129 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 6384133 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 6384135 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 6384139 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 6384140 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 6384145 T18935 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 6384146 T18935 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 6384152 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6384154 T18946 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5ea531fc name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6384154 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6386521 T18935 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 6386532 T18935 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 6386548 T18935 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64966
   [junit4]   2> 6386553 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 6386553 T18935 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6386553 T18935 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002
   [junit4]   2> 6386553 T18935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\'
   [junit4]   2> 6386609 T18935 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\solr.xml
   [junit4]   2> 6386626 T18935 oasc.CoreContainer.<init> New CoreContainer 25848112
   [junit4]   2> 6386626 T18935 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\]
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 6386628 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 6386630 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 6386630 T18935 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 6386630 T18935 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 6386635 T18935 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 6386639 T18935 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6386639 T18935 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6386639 T18935 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 6386639 T18935 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64956/solr
   [junit4]   2> 6386642 T18935 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 6386644 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6386646 T18957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c03b16e name:ZooKeeperConnection Watcher:127.0.0.1:64956 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6386647 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6386650 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6386652 T18959 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14c692d8 name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6386652 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6386654 T18935 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 6386660 T18935 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 6386666 T18935 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 6386671 T18935 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 6386676 T18935 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 6386683 T18935 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 6386685 T18935 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64966_
   [junit4]   2> 6386686 T18935 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64966_
   [junit4]   2> 6386691 T18935 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 6386693 T18935 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 6386700 T18935 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:64966_
   [junit4]   2> 6386700 T18935 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 6386703 T18935 oasc.Overseer.start Overseer (id=92211586716991492-127.0.0.1:64966_-n_0000000000) starting
   [junit4]   2> 6386708 T18935 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 6386724 T18961 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 6386725 T18935 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 6386728 T18935 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 6386731 T18935 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 6386735 T18960 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 6386742 T18962 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 6386742 T18962 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6386743 T18962 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 6386744 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6386747 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6386748 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64966",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64966_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 6386748 T18960 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 6386748 T18960 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 6386752 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6386753 T18963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 6387911 T18962 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 6387911 T18962 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 6387912 T18962 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 6387913 T18962 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 6387915 T18962 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6387916 T18962 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\'
   [junit4]   2> 6387919 T18962 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 6387920 T18962 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 6387921 T18962 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 6387968 T18962 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 6387977 T18962 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 6387980 T18962 oass.ManagedIndexSchemaFactory.create The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 6387981 T18962 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 6387985 T18962 oass.IndexSchema.readSchema [collection1] Schema name=add-schema-fields-update-processor
   [junit4]   2> 6387998 T18962 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 6387999 T18962 oass.ManagedIndexSchema.persistManagedSchemaToZooKeeper Created and persisted managed schema znode at /configs/conf1/managed-schema
   [junit4]   2> 6388002 T18962 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml.bak
   [junit4]   2> 6388008 T18962 oass.ManagedIndexSchemaFactory.zkUgradeToManagedSchema After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/conf1/schema.xml to /configs/conf1/schema.xml.bak
   [junit4]   2> 6388009 T18962 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 6388009 T18962 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 6388010 T18962 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\
   [junit4]   2> 6388010 T18962 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 6388011 T18962 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data
   [junit4]   2> 6388013 T18962 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\index/
   [junit4]   2> 6388014 T18962 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 6388014 T18962 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\index
   [junit4]   2> 6388015 T18962 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=507030941, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 6388023 T18962 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30a2b4e6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6388023 T18962 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6388025 T18962 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "add-unknown-fields-to-the-schema"
   [junit4]   2> 6388118 T18962 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 6388118 T18962 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6388119 T18962 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6388119 T18962 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6388119 T18962 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6388120 T18962 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 6388120 T18962 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 6388120 T18962 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 6388121 T18962 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6388121 T18962 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 6388121 T18962 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 6388121 T18962 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 6388130 T18962 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6388132 T18962 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6388134 T18962 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6388136 T18962 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6388137 T18962 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6388140 T18962 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 6388140 T18962 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 6388142 T18962 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 6388144 T18962 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-002\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@30a2b4e6; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6388144 T18962 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6388145 T18962 oass.SolrIndexSearcher.<init> Opening Searcher@1346a630[collection1] main
   [junit4]   2> 6388145 T18962 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 6388147 T18962 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6388147 T18962 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 6388148 T18962 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6388149 T18962 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 6388149 T18962 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6388151 T18962 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 6388151 T18962 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6388153 T18962 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 6388157 T18962 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 6388157 T18962 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6388157 T18962 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 6388159 T18962 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
   [junit4]   2> 6388161 T18962 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 6388161 T18964 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1346a630[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 6388163 T18967 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64966 collection:control_collection shard:shard1
   [junit4]   2> 6388163 T18935 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 6388164 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 6388165 T18967 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 6388176 T18967 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 6388180 T18967 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 6388180 T18967 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3561 name=collection1 org.apache.solr.core.SolrCore@61bc5fcf url=https://127.0.0.1:64966/collection1 node=127.0.0.1:64966_ C3561_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:64966, core=collection1, node_name=127.0.0.1:64966_}
   [junit4]   2> 6388180 T18967 C3561 P64966 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64966/collection1/
   [junit4]   2> 6388180 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388180 T18967 C3561 P64966 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 6388181 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6388181 T18967 C3561 P64966 oasc.SyncStrategy.syncToMe https://127.0.0.1:64966/collection1/ has no replicas
   [junit4]   2> 6388183 T18967 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64966/collection1/ shard1
   [junit4]   2> 6388183 T18967 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 6388185 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6388186 T18969 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@471fb995 name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6388186 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6388188 T18935 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 6388192 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388194 T18935 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 6388196 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388201 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388323 T18963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 6388324 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 6388375 T18967 oasc.ZkController.register We are https://127.0.0.1:64966/collection1/ and leader is https://127.0.0.1:64966/collection1/
   [junit4]   2> 6388375 T18967 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64966
   [junit4]   2> 6388375 T18967 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 6388375 T18967 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 6388375 T18967 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6388379 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388379 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388380 T18967 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6388382 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6388383 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64966",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64966_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 6388386 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388387 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6388507 T18971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 6388507 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 6390576 T18935 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 6390578 T18935 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 6390588 T18935 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 6390591 T18935 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64978
   [junit4]   2> 6390596 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 6390596 T18935 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6390596 T18935 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003
   [junit4]   2> 6390596 T18935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\'
   [junit4]   2> 6390648 T18935 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\solr.xml
   [junit4]   2> 6390691 T18935 oasc.CoreContainer.<init> New CoreContainer 949401593
   [junit4]   2> 6390691 T18935 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\]
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 6390692 T18935 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 6390694 T18935 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 6390699 T18935 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 6390703 T18935 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6390703 T18935 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6390703 T18935 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 6390703 T18935 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64956/solr
   [junit4]   2> 6390703 T18935 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 6390708 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6390711 T18982 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cf63bd8 name:ZooKeeperConnection Watcher:127.0.0.1:64956 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6390712 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6390716 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6390717 T18984 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b9d26ef name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6390717 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6390731 T18935 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 6392023 T18935 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64978_
   [junit4]   2> 6392024 T18935 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64978_
   [junit4]   2> 6392046 T18986 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 6392047 T18986 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6392048 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6392048 T18986 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 6392048 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6392049 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6392052 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6392054 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64978",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64978_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 6392054 T18960 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 6392054 T18960 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 6392058 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6392061 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6392061 T18987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6392061 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393333 T18986 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 6393333 T18986 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 6393334 T18986 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 6393335 T18986 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 6393337 T18986 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6393338 T18986 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\'
   [junit4]   2> 6393342 T18986 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 6393343 T18986 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 6393345 T18986 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 6393393 T18986 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 6393403 T18986 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 6393407 T18986 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
   [junit4]   2> 6393411 T18986 oass.IndexSchema.readSchema [collection1] Schema name=add-schema-fields-update-processor
   [junit4]   2> 6393423 T18986 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 6393424 T18986 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 6393424 T18986 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 6393427 T18986 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\
   [junit4]   2> 6393427 T18986 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 6393427 T18986 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data
   [junit4]   2> 6393428 T18986 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\index/
   [junit4]   2> 6393429 T18986 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 6393431 T18986 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\index
   [junit4]   2> 6393433 T18986 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=507030941, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 6393465 T18986 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5912b859; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6393465 T18986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6393468 T18986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "add-unknown-fields-to-the-schema"
   [junit4]   2> 6393471 T18986 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 6393471 T18986 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6393472 T18986 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6393472 T18986 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6393472 T18986 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6393472 T18986 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 6393475 T18986 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 6393483 T18986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6393487 T18986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6393488 T18986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6393490 T18986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6393492 T18986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6393496 T18986 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 6393496 T18986 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 6393498 T18986 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 6393498 T18986 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-003\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5912b859; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6393498 T18986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6393500 T18986 oass.SolrIndexSearcher.<init> Opening Searcher@1d0bfe4e[collection1] main
   [junit4]   2> 6393501 T18986 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 6393503 T18986 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6393505 T18986 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 6393506 T18986 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6393506 T18986 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 6393506 T18986 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6393508 T18986 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 6393510 T18986 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6393510 T18986 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 6393510 T18986 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 6393511 T18986 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
   [junit4]   2> 6393513 T18986 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 6393513 T18988 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d0bfe4e[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 6393515 T18991 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64978 collection:collection1 shard:shard2
   [junit4]   2> 6393516 T18935 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 6393517 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 6393520 T18991 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 6393537 T18991 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 6393542 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393544 T18991 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 6393544 T18991 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3562 name=collection1 org.apache.solr.core.SolrCore@3d918485 url=https://127.0.0.1:64978/collection1 node=127.0.0.1:64978_ C3562_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:64978, core=collection1, node_name=127.0.0.1:64978_}
   [junit4]   2> 6393544 T18991 C3562 P64978 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64978/collection1/
   [junit4]   2> 6393544 T18991 C3562 P64978 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 6393544 T18991 C3562 P64978 oasc.SyncStrategy.syncToMe https://127.0.0.1:64978/collection1/ has no replicas
   [junit4]   2> 6393544 T18991 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64978/collection1/ shard2
   [junit4]   2> 6393547 T18991 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 6393557 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6393574 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393577 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393590 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393725 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393727 T18987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393728 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393782 T18991 oasc.ZkController.register We are https://127.0.0.1:64978/collection1/ and leader is https://127.0.0.1:64978/collection1/
   [junit4]   2> 6393782 T18991 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64978
   [junit4]   2> 6393782 T18991 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 6393782 T18991 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 6393782 T18991 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6393787 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393788 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393788 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393789 T18991 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6393794 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6393797 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64978",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64978_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 6393805 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6393939 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393940 T18971 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6393940 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 6396391 T18935 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 6396391 T18935 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 6396403 T18935 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 6396407 T18935 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64987
   [junit4]   2> 6396413 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 6396414 T18935 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6396414 T18935 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004
   [junit4]   2> 6396414 T18935 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\'
   [junit4]   2> 6396471 T18935 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\solr.xml
   [junit4]   2> 6396487 T18935 oasc.CoreContainer.<init> New CoreContainer 1141964318
   [junit4]   2> 6396488 T18935 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\]
   [junit4]   2> 6396489 T18935 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 6396489 T18935 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 6396489 T18935 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 6396491 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 6396491 T18935 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 6396491 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 6396492 T18935 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 6396492 T18935 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 6396493 T18935 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 6396498 T18935 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 6396503 T18935 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 6396503 T18935 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 6396504 T18935 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 6396504 T18935 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64956/solr
   [junit4]   2> 6396504 T18935 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 6396509 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6396511 T19002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2fc2a09e name:ZooKeeperConnection Watcher:127.0.0.1:64956 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6396511 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6396513 T18937 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14799f316710008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 6396514 T18935 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 6396516 T19004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@382eaa1 name:ZooKeeperConnection Watcher:127.0.0.1:64956/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 6396517 T18935 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 6396531 T18935 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 6397824 T18935 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64987_
   [junit4]   2> 6397827 T18935 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64987_
   [junit4]   2> 6397851 T19006 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 6397852 T19006 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6397853 T19006 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 6397853 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6397853 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6397853 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6397858 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6397859 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64987",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64987_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 6397859 T18960 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=4
   [junit4]   2> 6397859 T18960 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 6397864 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6397866 T18963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6397867 T19005 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6397867 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6397867 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399138 T19006 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 6399138 T19006 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 6399139 T19006 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 6399139 T19006 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 6399142 T19006 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6399142 T19006 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\'
   [junit4]   2> 6399145 T19006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 6399147 T19006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 6399149 T19006 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 6399198 T19006 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 6399209 T19006 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 6399212 T19006 oass.IndexSchema.readSchema Reading Solr Schema from managed-schema
   [junit4]   2> 6399216 T19006 oass.IndexSchema.readSchema [collection1] Schema name=add-schema-fields-update-processor
   [junit4]   2> 6399229 T19006 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 6399231 T19006 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 6399231 T19006 oasc.SolrCore.initDirectoryFactory solr.NRTCachingDirectoryFactory
   [junit4]   2> 6399232 T19006 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\
   [junit4]   2> 6399233 T19006 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 6399233 T19006 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data
   [junit4]   2> 6399234 T19006 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\index/
   [junit4]   2> 6399236 T19006 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 6399236 T19006 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\index
   [junit4]   2> 6399238 T19006 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=507030941, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 6399247 T19006 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@874dbbb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6399248 T19006 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6399251 T19006 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "add-unknown-fields-to-the-schema"
   [junit4]   2> 6399253 T19006 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 6399253 T19006 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6399253 T19006 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6399254 T19006 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6399254 T19006 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6399254 T19006 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 6399256 T19006 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 6399256 T19006 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 6399256 T19006 oasc.RequestHandlers.initHandlersFromConfig WARN Multiple requestHandler registered to the same name: /update ignoring: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 6399257 T19006 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 6399257 T19006 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 6399257 T19006 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 6399267 T19006 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6399270 T19006 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6399271 T19006 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6399273 T19006 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6399276 T19006 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 6399278 T19006 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 6399280 T19006 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 6399281 T19006 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=10, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 6399282 T19006 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=NRTCachingDirectory(MMapDirectory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\temp\solr.schema.TestCloudSchemaless-1B8F8D519FD8E272-001\tempDir-004\collection1\data\index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@874dbbb; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1}
   [junit4]   2> 6399283 T19006 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 6399283 T19006 oass.SolrIndexSearcher.<init> Opening Searcher@602bb0e1[collection1] main
   [junit4]   2> 6399283 T19006 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 6399286 T19006 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 6399286 T19006 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 6399287 T19006 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 6399288 T19006 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 6399288 T19006 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6399291 T19006 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 6399291 T19006 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 6399291 T19006 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 6399291 T19006 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 6399292 T19006 oass.ZkIndexSchemaReader.createSchemaWatcher Creating ZooKeeper watch for the managed schema at /configs/conf1/managed-schema ...
   [junit4]   2> 6399295 T19006 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 6399295 T19007 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@602bb0e1[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 6399297 T19010 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:64987 collection:collection1 shard:shard3
   [junit4]   2> 6399297 T18935 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 6399297 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 6399298 T19010 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 6399317 T19010 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 6399321 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399322 T19010 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 6399322 T19010 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3563 name=collection1 org.apache.solr.core.SolrCore@183d3610 url=https://127.0.0.1:64987/collection1 node=127.0.0.1:64987_ C3563_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:64987, core=collection1, node_name=127.0.0.1:64987_}
   [junit4]   2> 6399322 T19010 C3563 P64987 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:64987/collection1/
   [junit4]   2> 6399322 T19010 C3563 P64987 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 6399322 T19010 C3563 P64987 oasc.SyncStrategy.syncToMe https://127.0.0.1:64987/collection1/ has no replicas
   [junit4]   2> 6399322 T19010 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:64987/collection1/ shard3
   [junit4]   2> 6399323 T19010 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 6399329 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6399337 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399347 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399483 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399484 T19005 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399484 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399485 T18963 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399543 T19010 oasc.ZkController.register We are https://127.0.0.1:64987/collection1/ and leader is https://127.0.0.1:64987/collection1/
   [junit4]   2> 6399543 T19010 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:64987
   [junit4]   2> 6399543 T19010 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 6399543 T19010 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 6399543 T19010 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 6399547 T18963 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399547 T18971 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399548 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399548 T19010 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6399553 T18960 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 6399554 T18960 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:64987",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64987_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 6399558 T18987 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 6399692 T19005 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399692 T18987 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399694 T18985 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6399694 T18970 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 6401869 T18935 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 6401870 T18935 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 6401880 T18935 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 6401884 T18935 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64996
   [junit4]   2> 6401889 T18935 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 6401889 T18935 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 6401889 T18935 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.schema.TestCloudSche

[...truncated too long message...]

VectorHighlighterTest, ZkControllerTest, LoggingHandlerTest, SchemaVersionSpecificBehaviorTest, DirectSolrConnectionTest, JSONWriterTest, TestMultiCoreConfBootstrap, HighlighterMaxOffsetTest, CurrencyFieldOpenExchangeTest, TestSolrQueryParser, TestSolrQueryParserDefaultOperatorResource, TestFieldTypeCollectionResource, PathHierarchyTokenizerFactoryTest, TestCopyFieldCollectionResource, TestSort, TestWordDelimiterFilterFactory, TestDynamicFieldCollectionResource, TestSolrIndexConfig, ChaosMonkeySafeLeaderTest, HdfsBasicDistributedZkTest, FullSolrCloudDistribCmdsTest, IndexSchemaRuntimeFieldTest, AnalyticsQueryTest, AnalysisAfterCoreReloadTest, TestFreeTextSuggestions, OverseerTest, TestHashPartitioner, TestConfigSets, TestDistributedMissingSort, CachingDirectoryFactoryTest, AliasIntegrationTest, TestCloudManagedSchemaConcurrent, TestManagedSchemaFieldResource, TestDocSet, TestBM25SimilarityFactory, SpellCheckComponentTest, DistribCursorPagingTest, TestStressRecovery, TestSolrXMLSerializer, BinaryUpdateRequestHandlerTest, PolyFieldTest, CSVRequestHandlerTest, TestManagedResourceStorage, TestSweetSpotSimilarityFactory, HighlighterConfigTest, BJQParserTest, HdfsChaosMonkeySafeLeaderTest, TestSolr4Spatial2, TestFastOutputStream, PreAnalyzedUpdateProcessorTest, LeaderElectionTest, TestSolrQueryParserResource, TestUpdate, CacheHeaderTest, TestCollationFieldDocValues, HdfsSyncSliceTest, TestJmxMonitoredMap, UniqFieldsUpdateProcessorFactoryTest, QueryElevationComponentTest, URLClassifyProcessorTest, QueryFacetTest, TestCustomSort, TestCodecSupport, TestFieldCollectionResource, AssignTest, RequiredFieldsTest, SpellCheckCollatorTest, SpatialFilterTest, MergeStrategyTest, DefaultValueUpdateProcessorTest, TestSurroundQueryParser, StatsComponentTest, BadCopyFieldTest, TestRandomFaceting, StandardRequestHandlerTest, OverseerRolesTest, DisMaxRequestHandlerTest, DistributedQueryComponentCustomSortTest, TestSolrCoreProperties, UnloadDistributedZkTest, SolrXmlInZkTest, SyncSliceTest, TestExceedMaxTermLength, PeerSyncTest, CollectionsAPIDistributedZkTest, TestStressLucene, TestBlendedInfixSuggestions, ExternalFileFieldSortTest, TestLRUCache, AbstractAnalyticsStatsTest, TestOrdValues, TestCoreContainer, TestRTGBase, SynonymTokenizerTest, DocumentAnalysisRequestHandlerTest, FieldFacetExtrasTest, TestNoOpRegenerator, TestPerFieldSimilarity, NumericFieldsTest, CustomCollectionTest, TestRecovery, TestExtendedDismaxParser, OpenCloseCoreStressTest, TestSchemaVersionResource, TestRemoteStreaming, PrimUtilsTest, TestUtils, TestDocBasedVersionConstraints, TestNRTOpen, TestImplicitCoreProperties, TestBinaryResponseWriter, HdfsWriteToMultipleCollectionsTest, TestReplicationHandlerBackup, ConvertedLegacyTest, ShowFileRequestHandlerTest, TestReloadAndDeleteDocs, DebugComponentTest, TestIntervalFaceting, TestSolrDeletionPolicy1, XsltUpdateRequestHandlerTest, DocValuesMultiTest, EchoParamsTest, TestQuerySenderListener, HttpPartitionTest, DistributedSpellCheckComponentTest, TestZkChroot, HdfsRecoveryZkTest, TestRestManager, BadIndexSchemaTest, TestCursorMarkWithoutUniqueKey, DistanceFunctionTest, TestFaceting, TestFieldSortValues, CursorPagingTest, TestFastWriter, TestPHPSerializedResponseWriter, CoreAdminRequestStatusTest, ResourceLoaderTest, TestOverriddenPrefixQueryForCustomFieldType, TestMaxScoreQueryParser, NoFacetTest, SolrIndexConfigTest, MultiThreadedOCPTest, HdfsLockFactoryTest, SimplePostToolTest, DeleteShardTest, TestArbitraryIndexDir, SliceStateTest, RangeFacetTest, TestOmitPositions, TestJmxIntegration, SampleTest, TestSolrXmlPersistor, TestElisionMultitermQuery, ConnectionManagerTest, OverseerCollectionProcessorTest, TestCSVLoader, CoreAdminHandlerTest, FieldFacetTest, DeleteReplicaTest, TestExpandComponent, ScriptEngineTest, TestClassNameShortening, BasicZkTest, TestFuzzyAnalyzedSuggestions, TestFieldTypeResource, TimeZoneUtilsTest, FieldAnalysisRequestHandlerTest, TestMissingGroups, TestStandardQParsers, LegacyHTMLStripCharFilterTest, TestBadConfig, ClusterStateUpdateTest, TestDistributedGrouping, TestSuggestSpellingConverter, TestCloudInspectUtil, ResponseLogComponentTest, TestLazyCores, JsonLoaderTest, SpellPossibilityIteratorTest, SolrIndexSplitterTest, UUIDUpdateProcessorFallbackTest, DistributedExpandComponentTest, TestSimpleQParserPlugin, TestLeaderElectionZkExpiry, BasicDistributedZkTest, BasicDistributedZk2Test, LeaderElectionIntegrationTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, SimpleFacetsTest, TestSolr4Spatial, SolrCoreTest, TestGroupingSearch, SolrCmdDistributorTest, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, TestIndexSearcher, SoftAutoCommitTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, TestCoreDiscovery, SignatureUpdateProcessorFactoryTest, SuggesterFSTTest, SolrRequestParserTest, TestFoldingMultitermQuery, DocValuesTest, SuggesterTSTTest, SuggesterTest, TestTrie, SuggesterWFSTTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, QueryEqualityTest, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, SolrInfoMBeanTest, IndexBasedSpellCheckerTest, LukeRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestQueryTypes, PrimitiveFieldTypeTest, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, SolrPluginUtilsTest, IndexSchemaTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, MBeansHandlerTest, QueryParsingTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, PingRequestHandlerTest, TestComponentsName, SearchHandlerTest, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, CopyFieldTest, BadComponentTest, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestBinaryField, TestSearchPerf, MinimalSchemaTest, TestConfig, OutputWriterTest, TestPostingsSolrHighlighter, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, TestCharFilters, TestXIncludeConfig, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, TestSystemIdResolver, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedIntervalFacetingTest, SolrTestCaseJ4Test, TestHighlightDedupGrouping, TestTolerantSearch, ExpressionTest, AbstractAnalyticsFacetTest, FunctionTest, AsyncMigrateRouteKeyTest, CollectionsAPIAsyncDistributedZkTest, DeleteInactiveReplicaTest, DistribDocExpirationUpdateProcessorTest, MigrateRouteKeyTest, OverseerStatusTest, RemoteQueryErrorTest, ReplicationFactorTest, RollingRestartTest, SSLMigrationTest, ShardSplitTest, TestCollectionAPI, TestMiniSolrCloudCluster, TestModifyConfFiles, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, TriLevelCompositeIdRoutingTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, HdfsUnloadDistributedZkTest, StressHdfsTest, QueryResultKeyTest, TestNonNRTOpen, TestShardHandlerFactory, TestSolrXml, TestSolrXmlPersistence, CoreAdminCreateDiscoverTest, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, DistributedDebugComponentTest, DistributedQueryComponentOptimizationTest, DistributedSuggestComponentTest, SuggestComponentTest, TestChildDocTransformer, TestManagedResource, TestDefaultSearchFieldResource, TestDynamicFieldResource, TestFieldResource, TestSchemaNameResource, TestSchemaResource, TestSchemaSimilarityResource, TestSerializedLuceneMatchVersion, TestUniqueKeyFieldResource, TestManagedStopFilterFactory, TestManagedSynonymFilterFactory, ChangedSchemaMergeTest, DateRangeFieldTest, EnumFieldTest, ModifyConfFileTest, TestCloudManagedSchema, TestCloudSchemaless]
   [junit4] Completed in 334.26s, 1 test, 1 error <<< FAILURES!

[...truncated 78 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1298: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:922: There were test failures: 422 suites, 1756 tests, 1 error, 44 ignored (23 assumptions)

Total time: 146 minutes 27 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_20-ea-b23 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any