You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/11/23 05:01:42 UTC

[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_20) - Build # 4342 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4342/
Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: true)

2 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([81BCBB174FE69D8F]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([81BCBB174FE69D8F]:0)




Build Log:
[...truncated 11143 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\init-core-data-001
   [junit4]   2> 1027802 T2395 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1027802 T2395 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1027810 T2395 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1027812 T2395 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1027813 T2396 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1027939 T2395 oasc.ZkTestServer.run start zk server on port:59797
   [junit4]   2> 1027942 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1027944 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1027959 T2403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a1fe8 name:ZooKeeperConnection Watcher:127.0.0.1:59797 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1027959 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1027959 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1027961 T2395 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1027977 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1027979 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1027985 T2406 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e2f6dc name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1027985 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1027985 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1027986 T2395 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1027996 T2395 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1028003 T2395 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1028009 T2395 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1028022 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1028023 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1028034 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1028035 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1028045 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1028046 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1028055 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1028055 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1028066 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1028066 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1028075 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1028075 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1028085 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1028086 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1028093 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1028093 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1028103 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1028103 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1028111 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1028112 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1028120 T2395 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1028120 T2395 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1028131 T2397 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149da5a968e0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1030319 T2395 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1030328 T2395 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59804
   [junit4]   2> 1030329 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1030329 T2395 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1030329 T2395 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002
   [junit4]   2> 1030331 T2395 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002\'
   [junit4]   2> 1030395 T2395 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002\solr.xml
   [junit4]   2> 1030423 T2395 oasc.CoreContainer.<init> New CoreContainer 11689537
   [junit4]   2> 1030423 T2395 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002\]
   [junit4]   2> 1030425 T2395 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1030425 T2395 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1030425 T2395 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1030425 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1030425 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1030426 T2395 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1030426 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1030426 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1030426 T2395 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1030426 T2395 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1030430 T2395 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1030430 T2395 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1030430 T2395 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1030432 T2395 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1030432 T2395 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59797/solr
   [junit4]   2> 1030432 T2395 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1030432 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1030436 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1030443 T2418 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41a42e name:ZooKeeperConnection Watcher:127.0.0.1:59797 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1030445 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1030446 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1030453 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1030459 T2421 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12070d0 name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1030459 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1030464 T2395 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1030470 T2395 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1030482 T2395 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1030491 T2395 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1030498 T2395 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1030508 T2395 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1030512 T2395 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59804_
   [junit4]   2> 1030514 T2395 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59804_
   [junit4]   2> 1030521 T2395 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1030526 T2395 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1030532 T2395 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1030537 T2395 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59804_
   [junit4]   2> 1030538 T2395 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1030544 T2395 oasc.Overseer.start Overseer (id=92845349945606147-127.0.0.1:59804_-n_0000000000) starting
   [junit4]   2> 1030552 T2395 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1030578 T2395 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1030581 T2423 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1030581 T2395 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1030594 T2395 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1030600 T2395 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1030612 T2422 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1030619 T2425 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1030619 T2425 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1030621 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1030624 T2425 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1030632 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59804",
   [junit4]   2> 	  "node_name":"127.0.0.1:59804_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1030632 T2422 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1030632 T2422 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 1030632 T2422 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1030642 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1031864 T2425 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1031864 T2425 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1031867 T2425 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1031867 T2425 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1031870 T2425 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1031870 T2425 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002\collection1\'
   [junit4]   2> 1031875 T2425 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1031877 T2425 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1031879 T2425 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1031959 T2425 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1031988 T2425 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1031993 T2425 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1032021 T2425 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1032193 T2425 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1032196 T2425 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1032196 T2425 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1032204 T2425 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1032270 T2425 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1032271 T2425 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1032326 T2425 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/control/data\
   [junit4]   2> 1032327 T2425 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@117081b
   [junit4]   2> 1032333 T2425 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\control\data
   [junit4]   2> 1032334 T2425 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/control/data\index/
   [junit4]   2> 1032336 T2425 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1032337 T2425 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\control\data\index
   [junit4]   2> 1032338 T2425 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.8994140625, floorSegmentMB=0.71875, forceMergeDeletesPctAllowed=8.157866246957353, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14640645352507536
   [junit4]   2> 1032344 T2425 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1032344 T2425 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1032359 T2425 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1032360 T2425 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1032360 T2425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1032361 T2425 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1032361 T2425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1032361 T2425 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1032364 T2425 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1032364 T2425 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1032365 T2425 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1032365 T2425 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1032366 T2425 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1032367 T2425 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1032367 T2425 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1032368 T2425 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1032368 T2425 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1032370 T2425 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1032371 T2425 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1032371 T2425 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1032372 T2425 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1032373 T2425 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1032381 T2425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1032384 T2425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1032385 T2425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1032390 T2425 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1032401 T2425 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1032402 T2425 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1032404 T2425 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=13.9111328125, floorSegmentMB=1.5791015625, forceMergeDeletesPctAllowed=12.474854150657311, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2360487875702212
   [junit4]   2> 1032405 T2425 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1032405 T2425 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1032406 T2425 oass.SolrIndexSearcher.<init> Opening Searcher@14dc82e[collection1] main
   [junit4]   2> 1032406 T2425 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1032412 T2425 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1032412 T2425 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1032413 T2425 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1032414 T2425 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1032416 T2425 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1032417 T2425 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1032418 T2425 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1032419 T2425 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1032425 T2425 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1032427 T2425 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1032427 T2425 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1032431 T2426 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14dc82e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1032433 T2425 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1032435 T2429 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59804 collection:control_collection shard:shard1
   [junit4]   2> 1032436 T2395 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1032436 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1032437 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1032439 T2429 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1032441 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1032454 T2429 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1032456 T2432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7bb798 name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1032458 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1032459 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1032469 T2395 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1032471 T2429 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1032474 T2429 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C5676 name=collection1 org.apache.solr.core.SolrCore@b9889a url=http://127.0.0.1:59804/collection1 node=127.0.0.1:59804_ C5676_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59804, node_name=127.0.0.1:59804_, state=down}
   [junit4]   2> 1032474 T2429 C5676 P59804 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59804/collection1/
   [junit4]   2> 1032475 T2429 C5676 P59804 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1032475 T2429 C5676 P59804 oasc.SyncStrategy.syncToMe http://127.0.0.1:59804/collection1/ has no replicas
   [junit4]   2> 1032475 T2429 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59804/collection1/ shard1
   [junit4]   2> 1032476 T2429 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1032469 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1032490 T2395 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1032509 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1032509 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1032545 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1032675 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1032675 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1032697 T2429 oasc.ZkController.register We are http://127.0.0.1:59804/collection1/ and leader is http://127.0.0.1:59804/collection1/
   [junit4]   2> 1032697 T2429 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59804
   [junit4]   2> 1032697 T2429 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1032697 T2429 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1032698 T2429 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1032700 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1032717 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59804",
   [junit4]   2> 	  "node_name":"127.0.0.1:59804_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1032852 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1032853 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1034610 T2395 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1034612 T2395 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1034618 T2395 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59816
   [junit4]   2> 1034619 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1034619 T2395 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1034619 T2395 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003
   [junit4]   2> 1034619 T2395 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003\'
   [junit4]   2> 1034668 T2395 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003\solr.xml
   [junit4]   2> 1034696 T2395 oasc.CoreContainer.<init> New CoreContainer 2865085
   [junit4]   2> 1034696 T2395 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003\]
   [junit4]   2> 1034697 T2395 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1034698 T2395 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1034701 T2395 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1034701 T2395 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1034701 T2395 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1034701 T2395 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1034704 T2395 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59797/solr
   [junit4]   2> 1034704 T2395 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1034704 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1034708 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1034714 T2444 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8e827 name:ZooKeeperConnection Watcher:127.0.0.1:59797 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1034715 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1034715 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1034726 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1034736 T2447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54a63e name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1034736 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1034755 T2395 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1036007 T2395 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59816_
   [junit4]   2> 1036009 T2395 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59816_
   [junit4]   2> 1036023 T2395 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1036040 T2448 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1036040 T2448 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1036043 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1036043 T2448 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1036053 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59816",
   [junit4]   2> 	  "node_name":"127.0.0.1:59816_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1036053 T2422 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1036053 T2422 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1
   [junit4]   2> 1036053 T2422 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1036060 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1036060 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1036061 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1037210 T2448 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1037210 T2448 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1037213 T2448 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1037213 T2448 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1037215 T2448 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1037215 T2448 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003\collection1\'
   [junit4]   2> 1037219 T2448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1037219 T2448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1037226 T2448 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1037304 T2448 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1037318 T2448 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1037325 T2448 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1037339 T2448 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1037533 T2448 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1037536 T2448 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1037539 T2448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1037545 T2448 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1037610 T2448 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1037610 T2448 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1037612 T2448 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/jetty1\
   [junit4]   2> 1037612 T2448 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@117081b
   [junit4]   2> 1037615 T2448 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty1
   [junit4]   2> 1037616 T2448 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/jetty1\index/
   [junit4]   2> 1037617 T2448 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1037619 T2448 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty1\index
   [junit4]   2> 1037620 T2448 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.8994140625, floorSegmentMB=0.71875, forceMergeDeletesPctAllowed=8.157866246957353, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14640645352507536
   [junit4]   2> 1037625 T2448 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1037625 T2448 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1037634 T2448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1037636 T2448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1037636 T2448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1037637 T2448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1037637 T2448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1037637 T2448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1037638 T2448 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1037638 T2448 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1037638 T2448 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1037639 T2448 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037640 T2448 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037642 T2448 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037643 T2448 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1037643 T2448 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1037643 T2448 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1037643 T2448 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1037646 T2448 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1037647 T2448 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1037648 T2448 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1037648 T2448 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1037656 T2448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037659 T2448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037661 T2448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037663 T2448 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037666 T2448 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1037666 T2448 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1037670 T2448 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=13.9111328125, floorSegmentMB=1.5791015625, forceMergeDeletesPctAllowed=12.474854150657311, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2360487875702212
   [junit4]   2> 1037670 T2448 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1037670 T2448 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1037671 T2448 oass.SolrIndexSearcher.<init> Opening Searcher@136fbbd[collection1] main
   [junit4]   2> 1037671 T2448 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1037675 T2448 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1037675 T2448 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1037676 T2448 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1037676 T2448 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1037677 T2448 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1037679 T2448 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1037680 T2448 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1037680 T2448 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1037680 T2448 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1037688 T2449 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@136fbbd[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1037691 T2448 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1037693 T2452 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59816 collection:collection1 shard:shard2
   [junit4]   2> 1037693 T2395 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1037695 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1037696 T2452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1037712 T2452 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1037717 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1037719 T2452 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1037720 T2452 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C5677 name=collection1 org.apache.solr.core.SolrCore@5da5d9 url=http://127.0.0.1:59816/collection1 node=127.0.0.1:59816_ C5677_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59816, node_name=127.0.0.1:59816_, state=down}
   [junit4]   2> 1037720 T2452 C5677 P59816 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59816/collection1/
   [junit4]   2> 1037720 T2452 C5677 P59816 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1037721 T2452 C5677 P59816 oasc.SyncStrategy.syncToMe http://127.0.0.1:59816/collection1/ has no replicas
   [junit4]   2> 1037721 T2452 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59816/collection1/ shard2
   [junit4]   2> 1037722 T2452 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1037749 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1037866 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1037866 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1037867 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1037920 T2452 oasc.ZkController.register We are http://127.0.0.1:59816/collection1/ and leader is http://127.0.0.1:59816/collection1/
   [junit4]   2> 1037920 T2452 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59816
   [junit4]   2> 1037920 T2452 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1037920 T2452 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1037920 T2452 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1037925 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1037936 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59816",
   [junit4]   2> 	  "node_name":"127.0.0.1:59816_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1038058 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1038059 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1038060 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1039588 T2395 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1039591 T2395 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1039596 T2395 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59825
   [junit4]   2> 1039598 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1039598 T2395 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1039598 T2395 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004
   [junit4]   2> 1039598 T2395 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004\'
   [junit4]   2> 1039640 T2395 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004\solr.xml
   [junit4]   2> 1039677 T2395 oasc.CoreContainer.<init> New CoreContainer 26316374
   [junit4]   2> 1039677 T2395 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004\]
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1039679 T2395 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1039682 T2395 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1039682 T2395 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1039682 T2395 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1039683 T2395 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1039683 T2395 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59797/solr
   [junit4]   2> 1039683 T2395 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1039684 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1039687 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1039694 T2464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@988de0 name:ZooKeeperConnection Watcher:127.0.0.1:59797 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1039695 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1039695 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1039702 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1039707 T2467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@111c15e name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1039708 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1039729 T2395 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1040855 T2395 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59825_
   [junit4]   2> 1040858 T2395 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59825_
   [junit4]   2> 1040867 T2395 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1040878 T2468 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1040878 T2468 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1040882 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1040882 T2468 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1040891 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59825",
   [junit4]   2> 	  "node_name":"127.0.0.1:59825_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1040891 T2422 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1040892 T2422 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1040898 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1040898 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1040899 T2467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1040900 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1041998 T2468 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1041998 T2468 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1042001 T2468 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1042001 T2468 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1042005 T2468 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1042006 T2468 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004\collection1\'
   [junit4]   2> 1042015 T2468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1042020 T2468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1042023 T2468 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1042099 T2468 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1042136 T2468 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1042141 T2468 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1042166 T2468 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1042414 T2468 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1042417 T2468 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1042420 T2468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1042430 T2468 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1042486 T2468 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1042488 T2468 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1042489 T2468 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/jetty2\
   [junit4]   2> 1042489 T2468 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@117081b
   [junit4]   2> 1042491 T2468 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty2
   [junit4]   2> 1042492 T2468 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001/jetty2\index/
   [junit4]   2> 1042493 T2468 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1042495 T2468 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty2\index
   [junit4]   2> 1042497 T2468 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=85.8994140625, floorSegmentMB=0.71875, forceMergeDeletesPctAllowed=8.157866246957353, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14640645352507536
   [junit4]   2> 1042512 T2468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1042513 T2468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1042524 T2468 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1042524 T2468 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1042525 T2468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1042525 T2468 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1042526 T2468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1042526 T2468 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1042527 T2468 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1042527 T2468 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1042527 T2468 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1042529 T2468 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1042530 T2468 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1042531 T2468 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1042532 T2468 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1042533 T2468 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1042533 T2468 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1042534 T2468 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1042534 T2468 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1042536 T2468 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1042537 T2468 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1042538 T2468 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1042548 T2468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1042550 T2468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1042553 T2468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1042555 T2468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1042557 T2468 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1042557 T2468 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1042561 T2468 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=37, maxMergedSegmentMB=13.9111328125, floorSegmentMB=1.5791015625, forceMergeDeletesPctAllowed=12.474854150657311, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2360487875702212
   [junit4]   2> 1042562 T2468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-001\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1042563 T2468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1042563 T2468 oass.SolrIndexSearcher.<init> Opening Searcher@15e3813[collection1] main
   [junit4]   2> 1042563 T2468 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1042566 T2468 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1042566 T2468 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1042567 T2468 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1042568 T2468 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1042568 T2468 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1042571 T2468 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1042571 T2468 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1042571 T2468 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1042573 T2468 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1042595 T2469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@15e3813[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1042599 T2468 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1042601 T2472 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59825 collection:collection1 shard:shard1
   [junit4]   2> 1042602 T2395 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1042602 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1042604 T2472 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1042631 T2472 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1042636 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1042638 T2472 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1042638 T2472 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C5678 name=collection1 org.apache.solr.core.SolrCore@622fba url=http://127.0.0.1:59825/collection1 node=127.0.0.1:59825_ C5678_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:59825, node_name=127.0.0.1:59825_, state=down}
   [junit4]   2> 1042639 T2472 C5678 P59825 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59825/collection1/
   [junit4]   2> 1042639 T2472 C5678 P59825 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1042639 T2472 C5678 P59825 oasc.SyncStrategy.syncToMe http://127.0.0.1:59825/collection1/ has no replicas
   [junit4]   2> 1042639 T2472 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59825/collection1/ shard1
   [junit4]   2> 1042640 T2472 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1042664 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042664 T2467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042665 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042666 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042698 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1042816 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042821 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042822 T2467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042822 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1042891 T2472 oasc.ZkController.register We are http://127.0.0.1:59825/collection1/ and leader is http://127.0.0.1:59825/collection1/
   [junit4]   2> 1042891 T2472 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59825
   [junit4]   2> 1042891 T2472 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1042891 T2472 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1042891 T2472 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1042895 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1042905 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59825",
   [junit4]   2> 	  "node_name":"127.0.0.1:59825_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1043027 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1043027 T2467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1043028 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1043029 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1044674 T2395 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1044674 T2395 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1044682 T2395 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59834
   [junit4]   2> 1044683 T2395 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1044683 T2395 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1044683 T2395 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-005
   [junit4]   2> 1044683 T2395 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-005\'
   [junit4]   2> 1044752 T2395 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-005\solr.xml
   [junit4]   2> 1044792 T2395 oasc.CoreContainer.<init> New CoreContainer 3726399
   [junit4]   2> 1044792 T2395 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-005\]
   [junit4]   2> 1044795 T2395 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1044795 T2395 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1044795 T2395 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1044797 T2395 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1044800 T2395 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1044800 T2395 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1044802 T2395 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1044803 T2395 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1044803 T2395 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59797/solr
   [junit4]   2> 1044803 T2395 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1044803 T2395 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1044808 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1044812 T2484 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69af74 name:ZooKeeperConnection Watcher:127.0.0.1:59797 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1044813 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1044814 T2395 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1044820 T2397 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x149da5a968e0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 1044822 T2395 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1044827 T2487 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1897a4f name:ZooKeeperConnection Watcher:127.0.0.1:59797/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1044828 T2395 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1044846 T2395 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1045973 T2395 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59834_
   [junit4]   2> 1045975 T2395 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59834_
   [junit4]   2> 1045987 T2395 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1045997 T2488 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1046002 T2488 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1046004 T2421 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1046004 T2488 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1046010 T2422 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:59834",
   [junit4]   2> 	  "node_name":"127.0.0.1:59834_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1046010 T2422 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1046010 T2422 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1046017 T2447 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1046017 T2421 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1046018 T2467 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1046018 T2432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1046018 T2487 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1047120 T2488 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1047120 T2488 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1047122 T2488 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1047122 T2488 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1047125 T2488 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1047126 T2488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001\tempDir-005\collection1\'
   [junit4]   2> 1047129 T2488 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-005/collection1/lib/.svn/' to classloader
   [junit4]   2> 1047133 T2488 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-5.x-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-81BCBB174FE69D8F-001/tempDir-005/collection1/lib/classes/' to classloader
   [junit4]   2> 1047134 T2488 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/

[...truncated too long message...]

4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 	  28) Thread[id=2395, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[81BCBB174FE69D8F], state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.doStop(QueuedThreadPool.java:122)
   [junit4]   2> 	        at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
   [junit4]   2> 	        at org.eclipse.jetty.util.component.AggregateLifeCycle.doStop(AggregateLifeCycle.java:107)
   [junit4]   2> 	        at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:69)
   [junit4]   2> 	        at org.eclipse.jetty.server.handler.HandlerWrapper.doStop(HandlerWrapper.java:108)
   [junit4]   2> 	        at org.eclipse.jetty.server.Server.doStop(Server.java:341)
   [junit4]   2> 	        at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
   [junit4]   2> 	        at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:443)
   [junit4]   2> 	        at org.apache.solr.cloud.ChaosMonkey.stopJettySolrRunner(ChaosMonkey.java:200)
   [junit4]   2> 	        at org.apache.solr.cloud.ChaosMonkey.stop(ChaosMonkey.java:550)
   [junit4]   2> 	        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.destroyServers(AbstractFullDistribZkTestBase.java:1573)
   [junit4]   2> 	        at org.apache.solr.BaseDistributedSearchTestCase.tearDown(BaseDistributedSearchTestCase.java:284)
   [junit4]   2> 	        at org.apache.solr.cloud.AbstractDistribZkTestBase.tearDown(AbstractDistribZkTestBase.java:231)
   [junit4]   2> 	        at org.apache.solr.cloud.AbstractFullDistribZkTestBase.tearDown(AbstractFullDistribZkTestBase.java:1551)
   [junit4]   2> 	        at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.tearDown(ChaosMonkeySafeLeaderTest.java:86)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:483)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:885)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=413), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=413)), sim=DefaultSimilarity, locale=sl, timezone=Etc/GMT0
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0_20 (32-bit)/cpus=2,threads=50,free=13987392,total=167055360
   [junit4]   2> NOTE: All tests run in this JVM: [TestInfoStreamLogging, SuggesterTest, TestTrie, SuggesterFSTTest, BasicZkTest, SampleTest, TestReplicaProperties, PolyFieldTest, TestFieldResource, TestCloudManagedSchemaConcurrent, TestBM25SimilarityFactory, PreAnalyzedFieldTest, TestAtomicUpdateErrorCases, DistributedSpellCheckComponentTest, CursorPagingTest, SpellCheckCollatorTest, PrimitiveFieldTypeTest, SharedFSAutoReplicaFailoverTest, TestSolrIndexConfig, HdfsCollectionsAPIDistributedZkTest, HdfsLockFactoryTest, SolrRequestParserTest, TestSearcherReuse, ExitableDirectoryReaderTest, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=81BCBB174FE69D8F -Dtests.slow=true -Dtests.locale=sl -Dtests.timezone=Etc/GMT0 -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81BCBB174FE69D8F]:0)
   [junit4] Completed in 7325.65s, 1 test, 2 errors <<< FAILURES!

[...truncated 1269 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:525: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:473: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:61: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:508: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:1359: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\common-build.xml:966: There were test failures: 445 suites, 1819 tests, 1 suite-level error, 1 error, 1661 ignored (12 assumptions)

Total time: 193 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_20) - Build # 4345 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4345/
Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)

All tests passed

Build Log:
[...truncated 42684 lines...]
-check-forbidden-all:
[forbidden-apis] Reading bundled API signatures: jdk-unsafe-1.7
[forbidden-apis] Reading bundled API signatures: jdk-deprecated-1.7
[forbidden-apis] Reading bundled API signatures: commons-io-unsafe-2.4
[forbidden-apis] Reading API signatures: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\tools\forbiddenApis\base.txt
[forbidden-apis] Reading API signatures: C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\lucene\tools\forbiddenApis\servlet-api.txt
[forbidden-apis] Loading classes to check...
[forbidden-apis] Scanning for API signatures and dependencies...
[forbidden-apis] Forbidden method invocation: java.io.InputStreamReader#<init>(java.io.InputStream) [Uses default charset]
[forbidden-apis]   in org.apache.solr.core.SolrConfig (SolrConfig.java:356)
[forbidden-apis] Scanned 2289 (and 1563 related) class file(s) for forbidden API invocations (in 3.22s), 1 error(s).

BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:525: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:86: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\build.xml:271: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\solr\common-build.xml:491: Check for forbidden API calls failed, see log.

Total time: 198 minutes 15 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: false)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_20) - Build # 4344 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4344/
Java: 32bit/jdk1.8.0_20 -client -XX:+UseSerialGC (asserts: true)

No tests ran.

Build Log:
[...truncated 12171 lines...]
FATAL: java.io.IOException: Unexpected termination of the channel
hudson.remoting.RequestAbortedException: java.io.IOException: Unexpected termination of the channel
	at hudson.remoting.Request.abort(Request.java:295)
	at hudson.remoting.Channel.terminate(Channel.java:814)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:69)
	at ......remote call to Windows VBOX(Native Method)
	at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1356)
	at hudson.remoting.Request.call(Request.java:171)
	at hudson.remoting.Channel.call(Channel.java:751)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:179)
	at com.sun.proxy.$Proxy81.join(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:979)
	at hudson.Launcher$ProcStarter.join(Launcher.java:388)
	at hudson.tasks.Ant.perform(Ant.java:217)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:770)
	at hudson.model.Build$BuildExecution.build(Build.java:199)
	at hudson.model.Build$BuildExecution.doRun(Build.java:160)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:533)
	at hudson.model.Run.execute(Run.java:1759)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:89)
	at hudson.model.Executor.run(Executor.java:240)
Caused by: java.io.IOException: Unexpected termination of the channel
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:50)
Caused by: java.io.EOFException
	at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2325)
	at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:2794)
	at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:801)
	at java.io.ObjectInputStream.<init>(ObjectInputStream.java:299)
	at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:40)
	at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
	at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:48)



[JENKINS] Lucene-Solr-5.x-Windows (32bit/jdk1.8.0_40-ea-b09) - Build # 4343 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Windows/4343/
Java: 32bit/jdk1.8.0_40-ea-b09 -client -XX:+UseSerialGC (asserts: true)

All tests passed

Build Log:
[...truncated 54258 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:525: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\build.xml:432: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:105: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-5.x-Windows\extra-targets.xml:204: The following files are missing svn:eol-style (or binary svn:mime-type):
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/VM_global_library.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/browse.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/debug.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/error.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/facets.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/footer.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/head.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/header.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/hit.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/jquery.autocomplete.css
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/jquery.autocomplete.js
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/layout.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/main.css
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/pagination_bottom.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/pagination_top.vm
* ./solr/server/solr/configsets/data_driven_schema_configs/conf/velocity/results_list.vm

Total time: 216 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b09 -client -XX:+UseSerialGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any