You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/31 19:14:21 UTC

[JENKINS] Lucene-Solr-5.x-Windows (64bit/jdk1.7.0_67) - Build # 4418 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4418/
Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)

2 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([2B9B1E78EE652535]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([2B9B1E78EE652535]:0)




Build Log:
[...truncated 9640 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\init-core-data-001
   [junit4]   2> 2836257 T9718 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 2836257 T9718 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2836264 T9718 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 2836265 T9718 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2836266 T9719 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2836366 T9718 oasc.ZkTestServer.run start zk server on port:55845
   [junit4]   2> 2836366 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2836368 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2836375 T9726 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c8aba09 name:ZooKeeperConnection Watcher:127.0.0.1:55845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2836375 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2836375 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2836375 T9718 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2836380 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2836382 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2836387 T9729 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fd8ef5a name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2836388 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2836388 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2836388 T9718 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2836391 T9718 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2836398 T9718 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2836403 T9718 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2836411 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2836411 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2836419 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 2836419 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2836424 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2836424 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2836430 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2836430 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2836434 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2836434 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2836439 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2836439 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2836445 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2836445 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2836450 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2836450 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2836454 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2836454 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2836460 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2836460 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2836464 T9718 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2836464 T9718 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2836471 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2836473 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2836475 T9732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2769849d name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2836475 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2836476 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2838087 T9718 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2838101 T9718 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2838128 T9718 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55855
   [junit4]   2> 2838131 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@73813fac
   [junit4]   2> 2838132 T9718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2838132 T9718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002
   [junit4]   2> 2838132 T9718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002\'
   [junit4]   2> 2838170 T9718 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002\solr.xml
   [junit4]   2> 2838245 T9718 oasc.CoreContainer.<init> New CoreContainer 278457573
   [junit4]   2> 2838245 T9718 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002\]
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2838247 T9718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2838252 T9718 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2838253 T9718 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2838253 T9718 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2838255 T9718 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2838255 T9718 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55845/solr
   [junit4]   2> 2838255 T9718 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2838255 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2838258 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2838261 T9744 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12516fac name:ZooKeeperConnection Watcher:127.0.0.1:55845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2838261 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2838261 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2838265 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2838269 T9747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4676d6b5 name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2838270 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2838272 T9718 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2838276 T9718 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2838281 T9718 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2838284 T9718 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2838288 T9718 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2838293 T9718 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2838294 T9718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55855_
   [junit4]   2> 2838295 T9718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55855_
   [junit4]   2> 2838298 T9718 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2838301 T9718 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2838304 T9718 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2838306 T9718 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55855_
   [junit4]   2> 2838306 T9718 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2838310 T9718 oasc.Overseer.start Overseer (id=93063865252315140-127.0.0.1:55855_-n_0000000000) starting
   [junit4]   2> 2838313 T9718 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2838325 T9718 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2838326 T9749 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2838328 T9718 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2838333 T9718 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2838336 T9718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2838342 T9748 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2838348 T9751 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 2838348 T9751 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2838349 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2838349 T9751 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2838356 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55855_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55855",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "roles":null} current state version: 0
   [junit4]   2> 2838358 T9748 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55855_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55855",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 2838358 T9748 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 2838358 T9748 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2838361 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2839350 T9751 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2839350 T9751 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2839352 T9751 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2839353 T9751 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2839358 T9751 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2839358 T9751 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002\collection1\'
   [junit4]   2> 2839358 T9751 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 2839362 T9751 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 2839362 T9751 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 2839389 T9751 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 2839394 T9751 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 2839430 T9751 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 2839489 T9751 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2839492 T9751 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 2839511 T9751 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2839870 T9751 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2839874 T9751 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2839876 T9751 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2839881 T9751 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2839917 T9751 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2839918 T9751 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2839918 T9751 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/control/data\
   [junit4]   2> 2839918 T9751 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e9283b0
   [junit4]   2> 2839920 T9751 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\control\data
   [junit4]   2> 2839921 T9751 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/control/data\index/
   [junit4]   2> 2839921 T9751 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2839923 T9751 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\control\data\index
   [junit4]   2> 2839924 T9751 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2839929 T9751 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2839929 T9751 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2839933 T9751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2839933 T9751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2839934 T9751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2839934 T9751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2839934 T9751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2839934 T9751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2839935 T9751 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2839935 T9751 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2839935 T9751 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2839936 T9751 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2839936 T9751 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2839937 T9751 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2839937 T9751 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2839937 T9751 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 2839938 T9751 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 2839938 T9751 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 2839939 T9751 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 2839939 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 2839942 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 2839943 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 2839943 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 2839944 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 2839944 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 2839944 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 2839945 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 2839945 T9751 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2839946 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2839946 T9751 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2839953 T9751 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2839955 T9751 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2839955 T9751 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2839958 T9751 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2839961 T9751 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2839963 T9751 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2839963 T9751 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2839964 T9751 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=24.4306640625, floorSegmentMB=0.21875, forceMergeDeletesPctAllowed=0.47857625443956664, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4520004182376298
   [junit4]   2> 2839964 T9751 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 2839964 T9751 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2839965 T9751 oass.SolrIndexSearcher.<init> Opening Searcher@5acc14f9[collection1] main
   [junit4]   2> 2839965 T9751 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2839967 T9751 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2839967 T9751 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2839968 T9751 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2839968 T9751 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2839968 T9751 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2839970 T9751 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2839970 T9751 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2839970 T9751 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2839970 T9751 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 2839972 T9751 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2839972 T9752 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5acc14f9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2839973 T9755 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55855 collection:control_collection shard:shard1
   [junit4]   2> 2839974 T9718 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2839974 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2839975 T9755 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2839985 T9755 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2839988 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2839988 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2839989 T9755 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2839989 T9755 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C11767 name=collection1 org.apache.solr.core.SolrCore@4af71ab2 url=https://127.0.0.1:55855/collection1 node=127.0.0.1:55855_ C11767_STATE=coll:control_collection core:collection1 props:{core=collection1, node_name=127.0.0.1:55855_, base_url=https://127.0.0.1:55855, state=down}
   [junit4]   2> 2839990 T9755 C11767 P55855 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55855/collection1/
   [junit4]   2> 2839990 T9755 C11767 P55855 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2839991 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2839991 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 2839991 T9755 C11767 P55855 oasc.SyncStrategy.syncToMe https://127.0.0.1:55855/collection1/ has no replicas
   [junit4]   2> 2839992 T9755 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55855/collection1/ shard1
   [junit4]   2> 2839993 T9755 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2839994 T9758 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28d4e0c6 name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2839994 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2839995 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2839995 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2839997 T9718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2840003 T9718 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2840004 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55855",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 2840007 T9759 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2840009 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2840056 T9755 oasc.ZkController.register We are https://127.0.0.1:55855/collection1/ and leader is https://127.0.0.1:55855/collection1/
   [junit4]   2> 2840056 T9755 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55855
   [junit4]   2> 2840056 T9755 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2840056 T9755 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 2840056 T9755 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2840058 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2840062 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "node_name":"127.0.0.1:55855_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55855",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "roles":null} current state version: 3
   [junit4]   2> 2840063 T9748 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "node_name":"127.0.0.1:55855_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55855",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 2840168 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2840168 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2841594 T9718 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 2841595 T9718 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2841604 T9718 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2841606 T9718 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55867
   [junit4]   2> 2841611 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@73813fac
   [junit4]   2> 2841611 T9718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2841611 T9718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003
   [junit4]   2> 2841612 T9718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003\'
   [junit4]   2> 2841641 T9718 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003\solr.xml
   [junit4]   2> 2841723 T9718 oasc.CoreContainer.<init> New CoreContainer 861156030
   [junit4]   2> 2841723 T9718 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003\]
   [junit4]   2> 2841725 T9718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2841725 T9718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2841725 T9718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2841725 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2841726 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 2841726 T9718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2841726 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2841727 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2841727 T9718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2841727 T9718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2841731 T9718 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2841733 T9718 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2841734 T9718 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2841734 T9718 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2841734 T9718 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55845/solr
   [junit4]   2> 2841735 T9718 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2841735 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2841737 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2841741 T9771 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@323551f3 name:ZooKeeperConnection Watcher:127.0.0.1:55845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2841741 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2841741 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2841745 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2841748 T9774 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@197436ac name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2841749 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2841763 T9718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2842771 T9718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55867_
   [junit4]   2> 2842772 T9718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55867_
   [junit4]   2> 2842780 T9718 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2842790 T9775 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2842790 T9775 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2842792 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2842792 T9775 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2842793 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55867_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55867",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null} current state version: 4
   [junit4]   2> 2842794 T9748 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55867_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55867",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 2842794 T9748 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 2842794 T9748 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 2842798 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2842798 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2842799 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2843793 T9775 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2843793 T9775 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2843794 T9775 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2843795 T9775 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2843798 T9775 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2843798 T9775 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003\collection1\'
   [junit4]   2> 2843801 T9775 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 2843801 T9775 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 2843801 T9775 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 2843831 T9775 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 2843836 T9775 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 2843871 T9775 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 2843934 T9775 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2843936 T9775 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 2843954 T9775 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2844290 T9775 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2844293 T9775 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2844294 T9775 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2844309 T9775 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2844345 T9775 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2844345 T9775 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2844346 T9775 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/jetty1\
   [junit4]   2> 2844346 T9775 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e9283b0
   [junit4]   2> 2844348 T9775 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty1
   [junit4]   2> 2844349 T9775 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/jetty1\index/
   [junit4]   2> 2844350 T9775 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 2844351 T9775 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty1\index
   [junit4]   2> 2844352 T9775 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2844356 T9775 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2844356 T9775 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2844362 T9775 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2844362 T9775 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2844362 T9775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2844363 T9775 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2844363 T9775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2844363 T9775 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2844364 T9775 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2844364 T9775 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2844364 T9775 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2844365 T9775 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2844365 T9775 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2844366 T9775 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2844366 T9775 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2844367 T9775 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 2844367 T9775 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 2844370 T9775 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 2844371 T9775 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 2844371 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 2844373 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 2844373 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 2844375 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 2844375 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 2844376 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 2844376 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 2844377 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 2844378 T9775 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2844378 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2844378 T9775 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2844387 T9775 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2844389 T9775 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2844391 T9775 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2844393 T9775 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2844395 T9775 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2844397 T9775 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2844397 T9775 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2844399 T9775 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=24.4306640625, floorSegmentMB=0.21875, forceMergeDeletesPctAllowed=0.47857625443956664, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4520004182376298
   [junit4]   2> 2844400 T9775 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 2844400 T9775 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2844401 T9775 oass.SolrIndexSearcher.<init> Opening Searcher@4deacaee[collection1] main
   [junit4]   2> 2844401 T9775 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2844403 T9775 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2844403 T9775 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2844404 T9775 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2844404 T9775 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2844404 T9775 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2844406 T9775 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2844406 T9775 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2844406 T9775 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2844406 T9775 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 2844407 T9776 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4deacaee[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2844408 T9775 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2844409 T9779 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55867 collection:collection1 shard:shard2
   [junit4]   2> 2844410 T9718 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2844410 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2844411 T9779 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2844420 T9779 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 2844423 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2844425 T9779 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2844425 T9779 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C11768 name=collection1 org.apache.solr.core.SolrCore@134bbbf1 url=https://127.0.0.1:55867/collection1 node=127.0.0.1:55867_ C11768_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55867_, base_url=https://127.0.0.1:55867, state=down}
   [junit4]   2> 2844425 T9779 C11768 P55867 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55867/collection1/
   [junit4]   2> 2844425 T9779 C11768 P55867 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2844425 T9779 C11768 P55867 oasc.SyncStrategy.syncToMe https://127.0.0.1:55867/collection1/ has no replicas
   [junit4]   2> 2844425 T9779 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55867/collection1/ shard2
   [junit4]   2> 2844426 T9779 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 2844428 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 5
   [junit4]   2> 2844432 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844433 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844433 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844456 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55867",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 6
   [junit4]   2> 2844459 T9759 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2844461 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844463 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844504 T9779 oasc.ZkController.register We are https://127.0.0.1:55867/collection1/ and leader is https://127.0.0.1:55867/collection1/
   [junit4]   2> 2844504 T9779 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55867
   [junit4]   2> 2844504 T9779 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2844504 T9779 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2844504 T9779 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2844507 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2844509 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "node_name":"127.0.0.1:55867_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55867",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null} current state version: 7
   [junit4]   2> 2844512 T9748 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "node_name":"127.0.0.1:55867_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55867",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 2844619 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844619 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2844620 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2846119 T9718 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 2846119 T9718 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2846132 T9718 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 2846134 T9718 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55876
   [junit4]   2> 2846140 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@73813fac
   [junit4]   2> 2846141 T9718 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2846141 T9718 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004
   [junit4]   2> 2846142 T9718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004\'
   [junit4]   2> 2846186 T9718 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004\solr.xml
   [junit4]   2> 2846255 T9718 oasc.CoreContainer.<init> New CoreContainer 1348720087
   [junit4]   2> 2846255 T9718 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004\]
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2846257 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2846259 T9718 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2846259 T9718 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2846259 T9718 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2846262 T9718 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2846266 T9718 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2846266 T9718 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2846266 T9718 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2846266 T9718 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55845/solr
   [junit4]   2> 2846266 T9718 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2846266 T9718 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2846269 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2846272 T9791 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c1cca2 name:ZooKeeperConnection Watcher:127.0.0.1:55845 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2846273 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2846273 T9718 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2846276 T9720 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14aa117a5ca0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 2846278 T9718 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2846280 T9794 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3b53572c name:ZooKeeperConnection Watcher:127.0.0.1:55845/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2846280 T9718 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2846292 T9718 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2847298 T9718 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55876_
   [junit4]   2> 2847300 T9718 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55876_
   [junit4]   2> 2847316 T9718 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2847329 T9795 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2847329 T9795 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2847331 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2847331 T9795 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2847333 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55876_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55876",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null} current state version: 8
   [junit4]   2> 2847335 T9748 oasco.ReplicaMutator.updateState Update state numShards=3 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55876_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55876",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 2847335 T9748 oasco.ReplicaMutator.updateState Collection already exists with numShards=3
   [junit4]   2> 2847335 T9748 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2847337 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2847337 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2847337 T9794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2847338 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2848331 T9795 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2848331 T9795 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2848335 T9795 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2848336 T9795 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2848338 T9795 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2848338 T9795 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004\collection1\'
   [junit4]   2> 2848341 T9795 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 2848341 T9795 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 2848341 T9795 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 2848368 T9795 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 2848396 T9795 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 2848438 T9795 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 2848497 T9795 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2848500 T9795 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 2848518 T9795 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2848880 T9795 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2848884 T9795 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2848886 T9795 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2848893 T9795 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2848928 T9795 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2848928 T9795 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 2848929 T9795 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/jetty2\
   [junit4]   2> 2848929 T9795 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e9283b0
   [junit4]   2> 2848931 T9795 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty2
   [junit4]   2> 2848932 T9795 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001/jetty2\index/
   [junit4]   2> 2848932 T9795 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 2848933 T9795 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty2\index
   [junit4]   2> 2848933 T9795 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2848967 T9795 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2848967 T9795 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2848971 T9795 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2848971 T9795 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2848972 T9795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2848972 T9795 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2848972 T9795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2848972 T9795 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2848973 T9795 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2848973 T9795 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2848973 T9795 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2848974 T9795 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2848974 T9795 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2848975 T9795 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2848975 T9795 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2848976 T9795 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 2848976 T9795 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 2848980 T9795 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 2848980 T9795 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 2848981 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 2848982 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 2848982 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 2848983 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 2848983 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 2848984 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 2848984 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 2848985 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 2848985 T9795 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2848986 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2848986 T9795 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2848994 T9795 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2848997 T9795 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2848997 T9795 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2848999 T9795 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2849002 T9795 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 2849003 T9795 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2849003 T9795 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2849005 T9795 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=24.4306640625, floorSegmentMB=0.21875, forceMergeDeletesPctAllowed=0.47857625443956664, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4520004182376298
   [junit4]   2> 2849005 T9795 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-2B9B1E78EE652535-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 2849005 T9795 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2849006 T9795 oass.SolrIndexSearcher.<init> Opening Searcher@2ceb26cd[collection1] main
   [junit4]   2> 2849006 T9795 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2849009 T9795 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2849009 T9795 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2849010 T9795 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2849010 T9795 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2849010 T9795 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2849011 T9795 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2849011 T9795 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2849011 T9795 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2849011 T9795 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 2849013 T9796 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ceb26cd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2849014 T9795 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2849015 T9799 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55876 collection:collection1 shard:shard1
   [junit4]   2> 2849016 T9718 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 2849017 T9718 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2849019 T9799 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 2849032 T9799 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2849036 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2849037 T9799 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2849037 T9799 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C11769 name=collection1 org.apache.solr.core.SolrCore@2cc80172 url=https://127.0.0.1:55876/collection1 node=127.0.0.1:55876_ C11769_STATE=coll:collection1 core:collection1 props:{core=collection1, node_name=127.0.0.1:55876_, base_url=https://127.0.0.1:55876, state=down}
   [junit4]   2> 2849037 T9799 C11769 P55876 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55876/collection1/
   [junit4]   2> 2849039 T9799 C11769 P55876 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2849039 T9799 C11769 P55876 oasc.SyncStrategy.syncToMe https://127.0.0.1:55876/collection1/ has no replicas
   [junit4]   2> 2849039 T9799 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55876/collection1/ shard1
   [junit4]   2> 2849039 T9799 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 2849042 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"} current state version: 9
   [junit4]   2> 2849047 T9794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849048 T9747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849048 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849049 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849070 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55876",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 10
   [junit4]   2> 2849075 T9759 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2849078 T9794 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849079 T9774 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849080 T9758 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2849120 T9799 oasc.ZkController.register We are https://127.0.0.1:55876/collection1/ and leader is https://127.0.0.1:55876/collection1/
   [junit4]   2> 2849120 T9799 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55876
   [junit4]   2> 2849120 T9799 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2849120 T9799 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2849120 T9799 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2849123 T9747 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 2849127 T9748 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "node_name":"127.0.0.1:55876_",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55876",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "roles":null} current state version: 11
   [junit4]   2> 284

[...truncated too long message...]

adPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	  33) Thread[id=9821, name=qtp24115505-9821 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	  34) Thread[id=9777, name=Thread-3185, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.lang.Object.wait(Object.java:503)
   [junit4]   2> 	        at org.apache.solr.core.CloserThread.run(CoreContainer.java:929)
   [junit4]   2> 	  35) Thread[id=9800, name=HashSessionScavenger-247, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> 	  36) Thread[id=9816, name=searcherExecutor-4394-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	  37) Thread[id=9762, name=qtp355021204-9762 Acceptor0 SslSelectChannelConnector@127.0.0.1:55867, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:956)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50), sim=DefaultSimilarity, locale=pt_PT, timezone=Pacific/Kwajalein
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_67 (64-bit)/cpus=2,threads=62,free=168109128,total=273870848
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsWriteToMultipleCollectionsTest, DeleteReplicaTest, TestModifyConfFiles, UpdateRequestProcessorFactoryTest, ShardRoutingTest, UUIDUpdateProcessorFallbackTest, DocValuesTest, CSVRequestHandlerTest, CloudMLTQParserTest, TestRecovery, DistributedExpandComponentTest, TestReplicationHandlerBackup, FileBasedSpellCheckerTest, OpenCloseCoreStressTest, TestTolerantSearch, TestAddFieldRealTimeGet, TestCollectionAPI, TestUniqueKeyFieldResource, TestClassNameShortening, SolrCoreTest, DocExpirationUpdateProcessorFactoryTest, TestSolrConfigHandlerCloud, OverseerStatusTest, TestNonDefinedSimilarityFactory, TestAnalyzeInfixSuggestions, DateMathParserTest, MBeansHandlerTest, TestFileDictionaryLookup, TestCSVLoader, ZkSolrClientTest, OverseerTest, HdfsUnloadDistributedZkTest, TestJoin, SuggesterTSTTest, TestMaxScoreQueryParser, SolrTestCaseJ4Test, ClusterStateTest, JSONWriterTest, TestIntervalFaceting, HardAutoCommitTest, TestSort, TestCoreDiscovery, TestManagedSchemaFieldTypeResource, DirectUpdateHandlerTest, SolrCmdDistributorTest, HighlighterMaxOffsetTest, InfoHandlerTest, TestImplicitCoreProperties, PeerSyncTest, CloudExitableDirectoryReaderTest, TestDynamicFieldResource, TestExactStatsCache, TestDocumentBuilder, DirectSolrConnectionTest, PreAnalyzedUpdateProcessorTest, DateFieldTest, DistributedFacetPivotSmallAdvancedTest, TestWordDelimiterFilterFactory, XmlUpdateRequestHandlerTest, StandardRequestHandlerTest, HttpPartitionTest, ResponseHeaderTest, SyncSliceTest, TestChildDocTransformer, TestDefaultStatsCache, TestUtils, ShardRoutingCustomTest, DocValuesMultiTest, TestRTGBase, NumericFieldsTest, DistributedTermsComponentTest, AutoCommitTest, TestExceedMaxTermLength, TestHashPartitioner, TestSolrQueryParserResource, TestManagedSchemaDynamicFieldResource, TestCoreContainer, TestFreeTextSuggestions, FieldAnalysisRequestHandlerTest, CopyFieldTest, DeleteShardTest, ResponseLogComponentTest, IndexSchemaTest, TestDistributedSearch, StressHdfsTest, ZkStateWriterTest, TestRandomMergePolicy, TestConfigReload, TestSchemaSimilarityResource, TestPostingsSolrHighlighter, PathHierarchyTokenizerFactoryTest, ExternalCollectionsTest, TestManagedSchema, TestFaceting, TestComponentsName, CurrencyFieldOpenExchangeTest, TriLevelCompositeIdRoutingTest, CacheHeaderTest, PrimitiveFieldTypeTest, TestInfoStreamLogging, TestSolrIndexConfig, MergeStrategyTest, TestBlendedInfixSuggestions, SolrRequestParserTest, TestSuggestSpellingConverter, MinimalSchemaTest, FileUtilsTest, SearchHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestSolr4Spatial, TestConfigOverlay, TestSchemaVersionResource, TermVectorComponentTest, TestManagedSynonymFilterFactory, HdfsBasicDistributedZk2Test, HdfsRecoveryZkTest, TestQueryTypes, TestOmitPositions, URLClassifyProcessorTest, TestSolrCoreProperties, TestDynamicFieldCollectionResource, BadComponentTest, TestWriterPerf, TestCloudManagedSchemaConcurrent, TestZkChroot, ShardSplitTest, TestRestManager, TestCloudSchemaless, CoreAdminCreateDiscoverTest, TestMissingGroups, BasicDistributedZkTest, TestReplicaProperties, DistributedDebugComponentTest, TestReplicationHandler, ConvertedLegacyTest, StatsComponentTest, TestJmxMonitoredMap, SampleTest, TestCloudManagedSchema, TestSearchPerf, TestQuerySenderNoQuery, AnalysisErrorHandlingTest, MultiTermTest, ParsingFieldUpdateProcessorsTest, OverriddenZkACLAndCredentialsProvidersTest, PreAnalyzedFieldTest, ModifyConfFileTest, TestReload, TestIndexingPerformance, LegacyHTMLStripCharFilterTest, TestSortingResponseWriter, TestCSVResponseWriter, TestReloadAndDeleteDocs, OutOfBoxZkACLAndCredentialsProvidersTest, DirectSolrSpellCheckerTest, ZkCLITest, TestXIncludeConfig, TestFunctionQuery, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=2B9B1E78EE652535 -Dtests.slow=true -Dtests.locale=pt_PT -Dtests.timezone=Pacific/Kwajalein -Dtests.asserts=true -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([2B9B1E78EE652535]:0)
   [junit4] Completed in 7312.83s, 1 test, 2 errors <<< FAILURES!

[...truncated 893 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:529: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:477: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:190: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:508: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1363: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:970: There were test failures: 458 suites, 1859 tests, 1 suite-level error, 1 error, 1199 ignored (25 assumptions)

Total time: 211 minutes 1 second
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Windows (64bit/jdk1.8.0_40-ea-b09) - Build # 4422 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4422/
Java: 64bit/jdk1.8.0_40-ea-b09 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: false)

1 tests failed.
FAILED:  org.apache.solr.handler.TestSolrConfigHandlerCloud.testDistribSearch

Error Message:
Could not get expected value  null for path [response, params, y, c] full output {   "responseHeader":{     "status":0,     "QTime":0},   "response":{     "znodeVersion":1,     "params":{       "x":{         "a":"A val",         "b":"B val",         "":{"v":0}},       "y":{         "c":"CY val",         "b":"BY val",         "":{"v":0}}}}}

Stack Trace:
java.lang.AssertionError: Could not get expected value  null for path [response, params, y, c] full output {
  "responseHeader":{
    "status":0,
    "QTime":0},
  "response":{
    "znodeVersion":1,
    "params":{
      "x":{
        "a":"A val",
        "b":"B val",
        "":{"v":0}},
      "y":{
        "c":"CY val",
        "b":"BY val",
        "":{"v":0}}}}}
	at __randomizedtesting.SeedInfo.seed([BD2E848BFAE7E95E:3CC80A938DB88962]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.core.TestSolrConfigHandler.testForResponseElement(TestSolrConfigHandler.java:231)
	at org.apache.solr.handler.TestSolrConfigHandlerCloud.testReqParams(TestSolrConfigHandlerCloud.java:262)
	at org.apache.solr.handler.TestSolrConfigHandlerCloud.doTest(TestSolrConfigHandlerCloud.java:61)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
	at sun.reflect.GeneratedMethodAccessor99.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 20334 lines...]
   [junit4] Suite: org.apache.solr.handler.TestSolrConfigHandlerCloud
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\init-core-data-001
   [junit4]   2> 4357367 T19397 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 4357367 T19397 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 4357370 T19397 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 4357371 T19397 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4357372 T19398 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 4357482 T19397 oasc.ZkTestServer.run start zk server on port:58851
   [junit4]   2> 4357482 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4357486 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4357492 T19405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22a55118 name:ZooKeeperConnection Watcher:127.0.0.1:58851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4357494 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4357494 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4357494 T19397 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 4357499 T19399 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14aa73522ef0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 4357499 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4357504 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4357509 T19408 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f4c2130 name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4357510 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4357510 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4357510 T19397 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 4357515 T19397 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 4357519 T19397 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 4357525 T19397 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 4357531 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 4357532 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4357539 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 4357541 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 4357550 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4357552 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4357559 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 4357559 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4357565 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 4357568 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4357575 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 4357575 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 4357581 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4357581 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4357586 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4357586 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4357590 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4357590 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4357596 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4357596 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4357601 T19397 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 4357601 T19397 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4359498 T19397 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4359501 T19397 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58858
   [junit4]   2> 4359502 T19397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@c387f44
   [junit4]   2> 4359502 T19397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4359502 T19397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002
   [junit4]   2> 4359502 T19397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002\'
   [junit4]   2> 4359551 T19397 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002\solr.xml
   [junit4]   2> 4359567 T19397 oasc.CoreContainer.<init> New CoreContainer 1114784911
   [junit4]   2> 4359567 T19397 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002\]
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4359569 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4359572 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4359572 T19397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4359572 T19397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4359572 T19397 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4359572 T19397 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4359572 T19397 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4359572 T19397 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4359572 T19397 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58851/solr
   [junit4]   2> 4359572 T19397 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 4359572 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4359575 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4359579 T19420 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc02cd7 name:ZooKeeperConnection Watcher:127.0.0.1:58851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4359579 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4359579 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4359584 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4359586 T19423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c53343f name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4359586 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4359588 T19397 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 4359594 T19397 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 4359598 T19397 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 4359603 T19397 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 4359609 T19397 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 4359614 T19397 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 4359617 T19397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58858_
   [junit4]   2> 4359618 T19397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58858_
   [junit4]   2> 4359623 T19397 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 4359626 T19397 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 4359630 T19397 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 4359634 T19397 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:58858_
   [junit4]   2> 4359634 T19397 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 4359639 T19397 oasc.Overseer.start Overseer (id=93070588975710211-127.0.0.1:58858_-n_0000000000) starting
   [junit4]   2> 4359643 T19397 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 4359658 T19397 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4359659 T19397 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 4359661 T19425 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 4359664 T19397 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 4359668 T19397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 4359676 T19424 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 4359685 T19427 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 4359686 T19427 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 4359686 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4359687 T19427 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 4359690 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58858",
   [junit4]   2> 	  "node_name":"127.0.0.1:58858_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 4359691 T19424 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58858",
   [junit4]   2> 	  "node_name":"127.0.0.1:58858_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 4359691 T19424 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 4359691 T19424 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 4359697 T19423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4360787 T19427 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4360787 T19427 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 4360788 T19427 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 4360788 T19427 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 4360790 T19427 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4360791 T19427 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002\collection1\'
   [junit4]   2> 4360796 T19427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 4360798 T19427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 4360799 T19427 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 4360827 T19427 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 4360831 T19427 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 4360844 T19427 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 4360850 T19427 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 4360864 T19427 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4360868 T19427 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 4360872 T19427 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4361060 T19427 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4361068 T19427 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4361071 T19427 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4361089 T19427 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4361092 T19427 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4361096 T19427 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4361097 T19427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4361099 T19427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4361099 T19427 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4361100 T19427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4361100 T19427 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4361101 T19427 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 4361101 T19427 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4361101 T19427 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/control/data\
   [junit4]   2> 4361102 T19427 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d126415
   [junit4]   2> 4361102 T19427 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/control/data\
   [junit4]   2> 4361102 T19427 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/control/data\index/
   [junit4]   2> 4361102 T19427 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 4361103 T19427 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/control/data\index
   [junit4]   2> 4361103 T19427 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 4361104 T19427 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2ddf6326 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18f8be82),segFN=segments_1,generation=1}
   [junit4]   2> 4361104 T19427 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4361106 T19427 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4361107 T19427 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4361107 T19427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4361107 T19427 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4361107 T19427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4361107 T19427 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4361108 T19427 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4361108 T19427 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4361108 T19427 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4361109 T19427 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4361109 T19427 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4361109 T19427 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4361110 T19427 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4361110 T19427 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 4361111 T19427 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 4361111 T19427 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 4361111 T19427 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 4361113 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 4361114 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 4361114 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 4361114 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 4361115 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 4361115 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 4361116 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 4361117 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 4361117 T19427 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4361117 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 4361118 T19427 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 4361125 T19427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4361128 T19427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4361130 T19427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4361131 T19427 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4361132 T19427 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4361136 T19427 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4361137 T19427 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4361137 T19427 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=28.3447265625, floorSegmentMB=1.21875, forceMergeDeletesPctAllowed=8.667530589480917, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 4361137 T19427 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2ddf6326 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@18f8be82),segFN=segments_1,generation=1}
   [junit4]   2> 4361138 T19427 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4361138 T19427 oass.SolrIndexSearcher.<init> Opening Searcher@43881744[collection1] main
   [junit4]   2> 4361138 T19427 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 4361140 T19427 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4361140 T19427 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4361142 T19427 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4361142 T19427 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4361142 T19427 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4361143 T19427 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4361143 T19427 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4361143 T19427 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4361143 T19427 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 4361145 T19427 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 4361145 T19428 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43881744[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4361146 T19431 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58858 collection:control_collection shard:shard1
   [junit4]   2> 4361147 T19397 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 4361147 T19397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 4361147 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4361148 T19431 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 4361149 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4361154 T19434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31331722 name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4361155 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4361155 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4361159 T19397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 4361162 T19431 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 4361164 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4361165 T19431 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 4361165 T19431 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7282 name=collection1 org.apache.solr.core.SolrCore@3dc82b14 url=http://127.0.0.1:58858/collection1 node=127.0.0.1:58858_ C7282_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:58858, node_name=127.0.0.1:58858_, state=down}
   [junit4]   2> 4361165 T19431 C7282 P58858 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58858/collection1/
   [junit4]   2> 4361166 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 4361166 T19431 C7282 P58858 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 4361166 T19431 C7282 P58858 oasc.SyncStrategy.syncToMe http://127.0.0.1:58858/collection1/ has no replicas
   [junit4]   2> 4361167 T19431 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58858/collection1/ shard1
   [junit4]   2> 4361167 T19431 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 4361168 T19397 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 4361168 T19397 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 4361168 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4361172 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4361174 T19437 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@17fa9538 name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4361174 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4361174 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4361177 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4361180 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 2, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58858",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 4361184 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":2} current state version: 1
   [junit4]   2> 4361184 T19424 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 4361192 T19423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4361193 T19434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4361229 T19438 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4361230 T19424 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 4361232 T19434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4361242 T19431 oasc.ZkController.register We are http://127.0.0.1:58858/collection1/ and leader is http://127.0.0.1:58858/collection1/
   [junit4]   2> 4361242 T19431 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58858
   [junit4]   2> 4361242 T19431 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 4361242 T19431 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 4361242 T19431 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 4361245 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4361249 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58858",
   [junit4]   2> 	  "node_name":"127.0.0.1:58858_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 4361251 T19424 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58858",
   [junit4]   2> 	  "node_name":"127.0.0.1:58858_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 4361369 T19423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4361369 T19434 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 4362855 T19397 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 4362855 T19397 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4362859 T19397 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58873
   [junit4]   2> 4362860 T19397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@c387f44
   [junit4]   2> 4362860 T19397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4362860 T19397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003
   [junit4]   2> 4362860 T19397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003\'
   [junit4]   2> 4362892 T19397 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003\solr.xml
   [junit4]   2> 4362907 T19397 oasc.CoreContainer.<init> New CoreContainer 55632324
   [junit4]   2> 4362907 T19397 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003\]
   [junit4]   2> 4362909 T19397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4362910 T19397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4362913 T19397 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4362913 T19397 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4362913 T19397 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4362913 T19397 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4362913 T19397 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58851/solr
   [junit4]   2> 4362913 T19397 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 4362913 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4362916 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4362919 T19450 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73ee9237 name:ZooKeeperConnection Watcher:127.0.0.1:58851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4362919 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4362920 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4362923 T19399 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14aa73522ef0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 4362924 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4362926 T19453 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73e675e6 name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4362927 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4362936 T19397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 4364046 T19397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58873_
   [junit4]   2> 4364047 T19397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58873_
   [junit4]   2> 4364056 T19397 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 4364068 T19454 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 4364068 T19454 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 4364071 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4364073 T19454 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 4364073 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58873",
   [junit4]   2> 	  "node_name":"127.0.0.1:58873_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 4364073 T19454 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 4364074 T19424 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58873",
   [junit4]   2> 	  "node_name":"127.0.0.1:58873_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 4364074 T19454 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 4364075 T19424 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 4364075 T19424 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 4364078 T19424 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 4364078 T19454 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 4364079 T19454 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 4364079 T19453 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4364081 T19453 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 4365179 T19454 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4365179 T19454 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 4365180 T19454 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 4365180 T19454 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 4365183 T19454 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4365184 T19454 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003\collection1\'
   [junit4]   2> 4365184 T19454 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 4365187 T19454 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 4365187 T19454 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 4365212 T19454 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 4365216 T19454 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 4365227 T19454 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 4365230 T19454 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 4365268 T19454 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4365270 T19454 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 4365274 T19454 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4365416 T19454 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4365424 T19454 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4365425 T19454 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4365443 T19454 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4365447 T19454 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4365451 T19454 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4365453 T19454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4365453 T19454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4365453 T19454 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4365455 T19454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4365455 T19454 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4365457 T19454 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 4365457 T19454 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4365458 T19454 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty1\
   [junit4]   2> 4365458 T19454 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d126415
   [junit4]   2> 4365458 T19454 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty1\
   [junit4]   2> 4365459 T19454 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty1\index/
   [junit4]   2> 4365459 T19454 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 4365459 T19454 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty1\index
   [junit4]   2> 4365459 T19454 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 4365460 T19454 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@51c875b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28d335ec),segFN=segments_1,generation=1}
   [junit4]   2> 4365460 T19454 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4365464 T19454 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4365464 T19454 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4365465 T19454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4365465 T19454 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4365465 T19454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4365465 T19454 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4365466 T19454 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4365466 T19454 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4365466 T19454 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4365467 T19454 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4365467 T19454 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4365467 T19454 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4365468 T19454 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4365468 T19454 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 4365469 T19454 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 4365469 T19454 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 4365471 T19454 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 4365471 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 4365472 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 4365473 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 4365473 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 4365474 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 4365474 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 4365475 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 4365475 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 4365475 T19454 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 4365477 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 4365477 T19454 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 4365483 T19454 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4365484 T19454 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4365486 T19454 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4365488 T19454 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 4365488 T19454 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 4365491 T19454 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 4365491 T19454 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 4365492 T19454 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=45, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=28.3447265625, floorSegmentMB=1.21875, forceMergeDeletesPctAllowed=8.667530589480917, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 4365492 T19454 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@51c875b2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@28d335ec),segFN=segments_1,generation=1}
   [junit4]   2> 4365492 T19454 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4365492 T19454 oass.SolrIndexSearcher.<init> Opening Searcher@d13c580[collection1] main
   [junit4]   2> 4365492 T19454 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 4365495 T19454 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4365495 T19454 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 4365496 T19454 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 4365496 T19454 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 4365496 T19454 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4365497 T19454 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 4365497 T19454 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 4365497 T19454 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 4365497 T19454 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 4365500 T19455 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@d13c580[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 4365500 T19454 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 4365502 T19458 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:58873 collection:collection1 shard:shard2
   [junit4]   2> 4365504 T19397 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 4365504 T19397 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 4365532 T19458 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 4365696 T19458 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 4365727 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4365728 T19458 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 4365728 T19458 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C7283 name=collection1 org.apache.solr.core.SolrCore@54acbcbc url=http://127.0.0.1:58873/collection1 node=127.0.0.1:58873_ C7283_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:58873, node_name=127.0.0.1:58873_, state=down}
   [junit4]   2> 4365728 T19458 C7283 P58873 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:58873/collection1/
   [junit4]   2> 4365728 T19458 C7283 P58873 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 4365728 T19458 C7283 P58873 oasc.SyncStrategy.syncToMe http://127.0.0.1:58873/collection1/ has no replicas
   [junit4]   2> 4365729 T19458 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:58873/collection1/ shard2
   [junit4]   2> 4365729 T19458 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 4365735 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 4365738 T19424 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 4365741 T19453 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4365743 T19453 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 4365752 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58873",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 4365754 T19424 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 4365755 T19453 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4365757 T19453 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 4365762 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4365807 T19458 oasc.ZkController.register We are http://127.0.0.1:58873/collection1/ and leader is http://127.0.0.1:58873/collection1/
   [junit4]   2> 4365807 T19458 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58873
   [junit4]   2> 4365807 T19458 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 4365807 T19458 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 4365807 T19458 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 4365810 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4365813 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58873",
   [junit4]   2> 	  "node_name":"127.0.0.1:58873_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 4365815 T19424 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58873",
   [junit4]   2> 	  "node_name":"127.0.0.1:58873_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 4365819 T19424 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 4365821 T19453 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4365824 T19458 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 4365826 T19453 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 4367274 T19397 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 4367274 T19397 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 4367277 T19397 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58882
   [junit4]   2> 4367279 T19397 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@c387f44
   [junit4]   2> 4367279 T19397 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4367281 T19397 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004
   [junit4]   2> 4367281 T19397 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004\'
   [junit4]   2> 4367319 T19397 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004\solr.xml
   [junit4]   2> 4367333 T19397 oasc.CoreContainer.<init> New CoreContainer 1249549347
   [junit4]   2> 4367334 T19397 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004\]
   [junit4]   2> 4367334 T19397 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 4367335 T19397 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 4367335 T19397 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 4367335 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 4367335 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 4367336 T19397 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 4367336 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 4367336 T19397 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 4367336 T19397 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 4367337 T19397 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 4367337 T19397 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 4367337 T19397 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4367339 T19397 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4367339 T19397 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 4367339 T19397 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:58851/solr
   [junit4]   2> 4367340 T19397 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 4367341 T19397 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 4367342 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4367345 T19470 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68c0dd75 name:ZooKeeperConnection Watcher:127.0.0.1:58851 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4367345 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4367345 T19397 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 4367347 T19399 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14aa73522ef0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 4367348 T19397 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 4367351 T19473 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@659ac5f1 name:ZooKeeperConnection Watcher:127.0.0.1:58851/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4367353 T19397 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 4367364 T19397 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 4368406 T19397 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58882_
   [junit4]   2> 4368410 T19397 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58882_
   [junit4]   2> 4368424 T19397 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 4368436 T19474 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 4368436 T19474 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 4368438 T19423 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 4368439 T19474 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 4368440 T19474 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 4368440 T19424 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58882",
   [junit4]   2> 	  "node_name":"127.0.0.1:58882_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 4368441 T19474 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 4368441 T19424 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58882",
   [junit4]   2> 	  "node_name":"127.0.0.1:58882_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 4368442 T19424 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 4368442 T19424 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 4368443 T19474 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 4368443 T19474 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 4368444 T19424 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 4368445 T19473 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4368445 T19453 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 4368446 T19473 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 4368446 T19453 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 4369444 T19474 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4369445 T19474 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 4369448 T19474 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 4369448 T19474 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 4369451 T19474 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 4369452 T19474 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004\collection1\'
   [junit4]   2> 4369458 T19474 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 4369460 T19474 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 4369464 T19474 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 4369517 T19474 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 4369522 T19474 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 4369535 T19474 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 4369541 T19474 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 4369554 T19474 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4369558 T19474 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 4369564 T19474 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 4369694 T19474 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4369702 T19474 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 4369702 T19474 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 4369718 T19474 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4369721 T19474 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 4369725 T19474 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4369726 T19474 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4369726 T19474 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4369727 T19474 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4369728 T19474 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 4369729 T19474 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 4369729 T19474 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 4369729 T19474 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 4369729 T19474 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty2\
   [junit4]   2> 4369730 T19474 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6d126415
   [junit4]   2> 4369730 T19474 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty2\
   [junit4]   2> 4369730 T19474 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty2\index/
   [junit4]   2> 4369731 T19474 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 4369731 T19474 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.handler.TestSolrConfigHandlerCloud-BD2E848BFAE7E95E-001\tempDir-001/jetty2\index
   [junit4]   2> 4369731 T19474 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=24, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 4369732 T19474 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@591c6a50 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8e10c37),segFN=segments_1,generation=1}
   [junit4]   2> 4369732 T19474 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 4369735 T19474 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4369736 T19474 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4369736 T19474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4369736 T19474 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4369736 T19474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4369736 T19474 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4369737 T19474 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4369737 T19474 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4369737 T19474 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4369738 T19474 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4369738 T19474 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4369739 T19474 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4369739 T19474 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 4369739 T19474 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 4369740 T19474 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 4369740 T19474 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 4369741 T19474 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 4369741 T19474 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 4369742 T19474 oasc.Requ

[...truncated too long message...]

topFilterFactory, AssignTest, ResponseHeaderTest, OverseerTest, ModifyConfFileTest, TestRemoteStreaming, TestReplicaProperties, AutoCommitTest, TestComponentsName, TestCharFilters, TestOrdValues, TestLMDirichletSimilarityFactory, CloudMLTQParserTest, TestSolrQueryParserResource, TestRawResponseWriter, TestPHPSerializedResponseWriter, TestSearchPerf, TestBulkSchemaConcurrent, TestReplicationHandlerBackup, OpenExchangeRatesOrgProviderTest, TestLRUCache, SignatureUpdateProcessorFactoryTest, TestArbitraryIndexDir, TestSolrConfigHandlerConcurrent, TestAnalyzedSuggestions, TestReplicationHandler, TestDynamicFieldCollectionResource, TestSolrXmlPersistence, TestOverriddenPrefixQueryForCustomFieldType, TestHighlightDedupGrouping, TestSolrXmlPersistor, TestCopyFieldCollectionResource, TestLuceneMatchVersion, SolrPluginUtilsTest, TestRandomDVFaceting, TestCloudManagedSchema, TestOmitPositions, XmlUpdateRequestHandlerTest, TestInitQParser, ScriptEngineTest, LeaderElectionIntegrationTest, AsyncMigrateRouteKeyTest, TestSchemaSimilarityResource, TestSchemaVersionResource, TestStressRecovery, TestInfoStreamLogging, BlockDirectoryTest, TestDistributedSearch, DistributedFacetPivotWhiteBoxTest, TestStressLucene, DocumentAnalysisRequestHandlerTest, TestExtendedDismaxParser, MinimalSchemaTest, TestStressVersions, PrimitiveFieldTypeTest, CursorMarkTest, CoreAdminCreateDiscoverTest, SolrRequestParserTest, FastVectorHighlighterTest, TestHashPartitioner, TestManagedSchemaFieldTypeResource, TestBinaryField, TestTolerantSearch, TermVectorComponentTest, MigrateRouteKeyTest, DocExpirationUpdateProcessorFactoryTest, AnalyticsMergeStrategyTest, CustomCollectionTest, TestIBSimilarityFactory, TestXIncludeConfig, TestZkChroot, DirectUpdateHandlerTest, CollectionsAPIAsyncDistributedZkTest, SuggesterTest, FileUtilsTest, HdfsUnloadDistributedZkTest, DistributedExpandComponentTest, NotRequiredUniqueKeyTest, TestDistributedGrouping, InfoHandlerTest, TestLFUCache, TestConfigSets, QueryParsingTest, TestSolr4Spatial, OverseerCollectionProcessorTest, SimpleMLTQParserTest, TestPseudoReturnFields, UUIDUpdateProcessorFallbackTest, DeleteInactiveReplicaTest, RollingRestartTest, TestSolrDeletionPolicy1, DeleteReplicaTest, QueryElevationComponentTest, AddBlockUpdateTest, SuggesterFSTTest, TestPivotHelperCode, TestDefaultStatsCache, SyncSliceTest, EchoParamsTest, TestModifyConfFiles, RequestHandlersTest, TestUniqueKeyFieldResource, HighlighterMaxOffsetTest, DocValuesMultiTest, OutOfBoxZkACLAndCredentialsProvidersTest, EnumFieldTest, HardAutoCommitTest, TestExpandComponent, TestLazyCores, ReplicationFactorTest, IndexSchemaRuntimeFieldTest, SortByFunctionTest, TestManagedSynonymFilterFactory, TestFieldResource, PreAnalyzedUpdateProcessorTest, ShowFileRequestHandlerTest, CacheHeaderTest, TestSchemaManager, HdfsDirectoryTest, TestMaxScoreQueryParser, ExternalFileFieldSortTest, TestPartialUpdateDeduplication, QueryEqualityTest, TestAtomicUpdateErrorCases, HdfsBasicDistributedZkTest, BadComponentTest, TestSolrCoreProperties, TestRestManager, TestSolrQueryParser, TestWriterPerf, TestAnalyzeInfixSuggestions, CopyFieldTest, CoreMergeIndexesAdminHandlerTest, BadCopyFieldTest, VMParamsZkACLAndCredentialsProvidersTest, DistributedDebugComponentTest, SolrIndexSplitterTest, TestDocBasedVersionConstraints, SuggesterTSTTest, TestSearcherReuse, TestExactStatsCache, TestNonDefinedSimilarityFactory, ExternalCollectionsTest, TestRecovery, DistributedSuggestComponentTest, CoreContainerCoreInitFailuresTest, TestCoreContainer, SolrCoreTest, TestCollationField, TestDocSet, WordBreakSolrSpellCheckerTest, DistributedQueryComponentCustomSortTest, LeaderInitiatedRecoveryOnCommitTest, CurrencyFieldXmlFileTest, TestFunctionQuery, TestSystemIdResolver, DistributedFacetPivotLargeTest, BasicDistributedZk2Test, TestChildDocTransformer, ZkStateWriterTest, TestDistribDocBasedVersion, ZkNodePropsTest, TestBlobHandler, DocValuesMissingTest, SimpleFacetsTest, BJQParserTest, TestFastWriter, LeaderFailoverAfterPartitionTest, HttpPartitionTest, SpellingQueryConverterTest, ChaosMonkeyNothingIsSafeTest, ClusterStateTest, DocValuesTest, TestCSVResponseWriter, TestNoOpRegenerator, TestManagedSchemaDynamicFieldResource, MultiTermTest, TestSweetSpotSimilarityFactory, TestFreeTextSuggestions, TestCSVLoader, TestUpdate, HdfsChaosMonkeySafeLeaderTest, TestTrie, TestLMJelinekMercerSimilarityFactory, OpenCloseCoreStressTest, RAMDirectoryFactoryTest, ShardSplitTest, QueryResultKeyTest, TestCloudManagedSchemaConcurrent, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, ZkCLITest, ShardRoutingCustomTest, TestFaceting, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, ZkControllerTest, TestRealTimeGet, TestStressReorder, TestJoin, TestReload, DistributedTermsComponentTest, TestRangeQuery, StatsComponentTest, SpellCheckComponentTest, TestGroupingSearch, SolrCmdDistributorTest, PeerSyncTest, TestSort, TestFiltering, BasicFunctionalityTest, TestBadConfig, TestIndexSearcher, HighlighterTest, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SpellCheckCollatorTest, TestFoldingMultitermQuery, SpatialFilterTest, SuggesterWFSTTest, PolyFieldTest, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, DistanceFunctionTest, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TermsComponentTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, IndexSchemaTest, TestJmxIntegration, ReturnFieldsTest, JSONWriterTest, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, PingRequestHandlerTest, CSVRequestHandlerTest, SearchHandlerTest, TestBinaryResponseWriter, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, SolrIndexConfigTest, TestMergePolicyConfig, SampleTest, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestPostingsSolrHighlighter, DirectSolrConnectionTest, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCodecSupport, SynonymTokenizerTest, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestBM25SimilarityFactory, TestDefaultSimilarityFactory, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TimeZoneUtilsTest, ResourceLoaderTest, TestFastOutputStream, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, TestSolrJ, TestUtils, TestDocumentBuilder, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, TestRTGBase, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, CloudExitableDirectoryReaderTest, ConnectionManagerTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribCursorPagingTest, DistributedQueueTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerRolesTest, OverseerStatusTest, SSLMigrationTest, SharedFSAutoReplicaFailoverTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCloudPivotFacet, TestCollectionAPI, TestLeaderElectionZkExpiry, TestMiniSolrCloudCluster, TestShortCircuitedRequests, TriLevelCompositeIdRoutingTest, HdfsBasicDistributedZk2Test, HdfsCollectionsAPIDistributedZkTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest, StressHdfsTest, CachingDirectoryFactoryTest, ExitableDirectoryReaderTest, TestConfigOverlay, TestImplicitCoreProperties, TestNRTOpen, TestNonNRTOpen, TestReloadAndDeleteDocs, TestShardHandlerFactory, TestSolrConfigHandler, TestSolrDynamicMBean, TestSolrXml, TestConfigReload, TestSolrConfigHandlerCloud]
   [junit4] Completed in 48.09s, 1 test, 1 failure <<< FAILURES!

[...truncated 161 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:529: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:477: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:190: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:508: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1363: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:970: There were test failures: 458 suites, 1858 tests, 1 failure, 56 ignored (31 assumptions)

Total time: 125 minutes 18 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_40-ea-b09 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Windows (64bit/jdk1.7.0_67) - Build # 4419 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4419/
Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)

All tests passed

Build Log:
[...truncated 44946 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:529: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:83: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\build.xml:134: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\build.xml:460: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:2502: java.net.SocketException: Connection reset
	at java.net.SocketInputStream.read(SocketInputStream.java:196)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
	at sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1312)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1339)
	at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:1323)
	at sun.net.www.protocol.https.HttpsClient.afterConnect(HttpsClient.java:563)
	at sun.net.www.protocol.https.AbstractDelegateHttpsURLConnection.connect(AbstractDelegateHttpsURLConnection.java:185)
	at sun.net.www.protocol.https.HttpsURLConnectionImpl.connect(HttpsURLConnectionImpl.java:153)
	at org.apache.tools.ant.taskdefs.Get$GetThread.openConnection(Get.java:660)
	at org.apache.tools.ant.taskdefs.Get$GetThread.get(Get.java:579)
	at org.apache.tools.ant.taskdefs.Get$GetThread.run(Get.java:569)

Total time: 167 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:-UseCompressedOops -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any