You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/08 23:47:46 UTC

[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3684 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3684/
Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC

3 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3
	at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)
	at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141)
	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235)
	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100)
	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382)
	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275)
	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250)
	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444)
	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632)
	at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)




Build Log:
[...truncated 10452 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 987106 T2999 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/p
   [junit4]   2> 987113 T2999 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1391891628420
   [junit4]   2> 987118 T2999 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 987119 T3000 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 987208 T2999 oasc.ZkTestServer.run start zk server on port:55824
   [junit4]   2> 987209 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 987218 T3006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c1772 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 987219 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 987219 T2999 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 987233 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 987239 T3008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@170832b name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 987240 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 987240 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 987247 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 987253 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 987256 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 987262 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 987263 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 987272 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 987274 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 987282 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 987284 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 987294 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 987294 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 987301 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 987301 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 987308 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 987309 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 987316 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 987316 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 987323 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 987323 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 987330 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 987331 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 987338 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 987338 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 987345 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 987346 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 988019 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 988035 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55831
   [junit4]   2> 988036 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662
   [junit4]   2> 988037 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\'
   [junit4]   2> 988073 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\solr.xml
   [junit4]   2> 988146 T2999 oasc.CoreContainer.<init> New CoreContainer 5339219
   [junit4]   2> 988146 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\]
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 988151 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 988153 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 988153 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 988156 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 988156 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
   [junit4]   2> 988156 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 988158 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 988170 T3019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2b015 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 988171 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 988180 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 988186 T3021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef853d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 988186 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 988191 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 988198 T2999 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 988207 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 988211 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55831__%2Fp
   [junit4]   2> 988215 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55831__%2Fp
   [junit4]   2> 988224 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 988228 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 988240 T2999 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55831__%2Fp
   [junit4]   2> 988240 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 988245 T2999 oasc.Overseer.start Overseer (id=91219009761181699-127.0.0.1:55831__%2Fp-n_0000000000) starting
   [junit4]   2> 988254 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 988263 T3023 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 988265 T2999 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 988267 T3023 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 988272 T2999 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 988279 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 988287 T3022 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 988294 T3024 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 988294 T3024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 988296 T3024 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 988296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 988301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55831/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55831__%2Fp",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 988302 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 988312 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 988314 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 989187 T3024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 989187 T3024 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1
   [junit4]   2> 989188 T3024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 989189 T3024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 989190 T3024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 989192 T3024 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 989192 T3024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\'
   [junit4]   2> 989196 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/classes/' to classloader
   [junit4]   2> 989198 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/README' to classloader
   [junit4]   2> 989258 T3024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 989314 T3024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 989318 T3024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 989326 T3024 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 989788 T3024 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 989790 T3024 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 989793 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 989801 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 989855 T3024 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 989855 T3024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\
   [junit4]   2> 989855 T3024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
   [junit4]   2> 989856 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data
   [junit4]   2> 989859 T3024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\index/
   [junit4]   2> 989859 T3024 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 989861 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index
   [junit4]   2> 989861 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@f762ea
   [junit4]   2> 989874 T3024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 989874 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 989879 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 989880 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 989881 T3024 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 989882 T3024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 989900 T3024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 989904 T3024 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 989905 T3024 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 989906 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 989908 T3024 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 989908 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 989909 T3024 oass.SolrIndexSearcher.<init> Opening Searcher@c1bc06[collection1] main
   [junit4]   2> 989913 T3025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c1bc06[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 989914 T3024 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 989915 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 989915 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 989915 T3028 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55831/_/p collection:control_collection shard:shard1
   [junit4]   2> 989918 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 989920 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 989922 T3030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19c52d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 989922 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 989924 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 989936 T2999 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 989942 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 989947 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 989948 T3028 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1726 name=collection1 org.apache.solr.core.SolrCore@78f9a5 url=http://127.0.0.1:55831/_/p/collection1 node=127.0.0.1:55831__%2Fp C1726_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55831/_/p, core=collection1, node_name=127.0.0.1:55831__%2Fp}
   [junit4]   2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55831/_/p/collection1/
   [junit4]   2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncToMe http://127.0.0.1:55831/_/p/collection1/ has no replicas
   [junit4]   2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55831/_/p/collection1/ shard1
   [junit4]   2> 989948 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 989953 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 989968 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 989975 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 989975 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 989986 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 989992 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 990088 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 990089 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 990118 T3028 oasc.ZkController.register We are http://127.0.0.1:55831/_/p/collection1/ and leader is http://127.0.0.1:55831/_/p/collection1/
   [junit4]   2> 990118 T3028 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55831/_/p
   [junit4]   2> 990118 T3028 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 990118 T3028 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 990118 T3028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 990125 T3028 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 990127 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 990128 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55831/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55831__%2Fp",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 990133 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 990230 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 990230 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 990591 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 990592 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 990597 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55843
   [junit4]   2> 990598 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241
   [junit4]   2> 990598 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\'
   [junit4]   2> 990629 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\solr.xml
   [junit4]   2> 990703 T2999 oasc.CoreContainer.<init> New CoreContainer 20947143
   [junit4]   2> 990703 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\]
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 990712 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 990712 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 990712 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 990712 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
   [junit4]   2> 990712 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 990716 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 990727 T3041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5471a9 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 990728 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 990731 T3001 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441334c1940005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 990733 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 990742 T3043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141b96e name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 990743 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 990753 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 991653 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55843__%2Fp
   [junit4]   2> 991655 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55843__%2Fp
   [junit4]   2> 991660 T3021 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 991661 T3030 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 991661 T3043 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 991672 T3044 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 991672 T3044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 991675 T3044 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 991677 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 991678 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55843/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55843__%2Fp",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 991683 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 991777 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 991777 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 991777 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 992567 T3044 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 992567 T3044 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1
   [junit4]   2> 992567 T3044 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 992568 T3044 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 992569 T3044 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 992571 T3044 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 992572 T3044 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\'
   [junit4]   2> 992574 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/classes/' to classloader
   [junit4]   2> 992575 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/README' to classloader
   [junit4]   2> 992639 T3044 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 992692 T3044 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 992695 T3044 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 992706 T3044 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 993206 T3044 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 993217 T3044 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 993220 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 993226 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 993276 T3044 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 993276 T3044 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\
   [junit4]   2> 993277 T3044 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
   [junit4]   2> 993277 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1
   [junit4]   2> 993278 T3044 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\index/
   [junit4]   2> 993280 T3044 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 993281 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index
   [junit4]   2> 993282 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d8704c
   [junit4]   2> 993289 T3044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 993289 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 993294 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 993296 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 993297 T3044 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 993300 T3044 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 993309 T3044 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 993314 T3044 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 993314 T3044 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 993315 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 993317 T3044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 993317 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 993317 T3044 oass.SolrIndexSearcher.<init> Opening Searcher@2d83b4[collection1] main
   [junit4]   2> 993324 T3045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d83b4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 993327 T3044 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 993329 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 993330 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 993329 T3048 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55843/_/p collection:collection1 shard:shard1
   [junit4]   2> 993333 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 993356 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993366 T3048 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1727 name=collection1 org.apache.solr.core.SolrCore@ddb135 url=http://127.0.0.1:55843/_/p/collection1 node=127.0.0.1:55843__%2Fp C1727_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55843/_/p, core=collection1, node_name=127.0.0.1:55843__%2Fp}
   [junit4]   2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55843/_/p/collection1/
   [junit4]   2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncToMe http://127.0.0.1:55843/_/p/collection1/ has no replicas
   [junit4]   2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55843/_/p/collection1/ shard1
   [junit4]   2> 993366 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 993370 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 993380 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993383 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993383 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993384 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993396 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 993404 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993510 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993510 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993510 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993543 T3048 oasc.ZkController.register We are http://127.0.0.1:55843/_/p/collection1/ and leader is http://127.0.0.1:55843/_/p/collection1/
   [junit4]   2> 993543 T3048 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55843/_/p
   [junit4]   2> 993543 T3048 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 993543 T3048 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 993543 T3048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993548 T3048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 993552 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 993554 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55843/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55843__%2Fp",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 993560 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 993664 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993665 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 993665 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 994085 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 994086 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 994091 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55852
   [junit4]   2> 994093 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635
   [junit4]   2> 994096 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\'
   [junit4]   2> 994141 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\solr.xml
   [junit4]   2> 994212 T2999 oasc.CoreContainer.<init> New CoreContainer 12769958
   [junit4]   2> 994212 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\]
   [junit4]   2> 994214 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 994217 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 994224 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 994224 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 994224 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 994225 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
   [junit4]   2> 994225 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 994229 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 994246 T3059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0f5d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 994253 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 994267 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 994274 T3061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff2649 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 994274 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 994286 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 995271 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55852__%2Fp
   [junit4]   2> 995273 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55852__%2Fp
   [junit4]   2> 995281 T3021 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 995281 T3061 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 995282 T3030 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 995282 T3043 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 995294 T3062 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 995295 T3062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 995296 T3062 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 995296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 995301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55852/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55852__%2Fp",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 995309 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 995311 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 995311 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 995312 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 995311 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 996277 T3062 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 996277 T3062 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1
   [junit4]   2> 996277 T3062 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 996280 T3062 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 996280 T3062 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 996282 T3062 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 996282 T3062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\'
   [junit4]   2> 996286 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/classes/' to classloader
   [junit4]   2> 996287 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/README' to classloader
   [junit4]   2> 996369 T3062 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 996421 T3062 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 996425 T3062 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 996434 T3062 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 996902 T3062 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 996905 T3062 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 996908 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 996915 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 996960 T3062 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 996961 T3062 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\
   [junit4]   2> 996961 T3062 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
   [junit4]   2> 996963 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2
   [junit4]   2> 996964 T3062 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\index/
   [junit4]   2> 996966 T3062 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 996966 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index
   [junit4]   2> 996967 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1f092fe
   [junit4]   2> 996973 T3062 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 996974 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 996979 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 996981 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 996981 T3062 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 996982 T3062 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 996985 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 996998 T3062 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 997005 T3062 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 997005 T3062 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 997006 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 997008 T3062 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 997008 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 997009 T3062 oass.SolrIndexSearcher.<init> Opening Searcher@1a48267[collection1] main
   [junit4]   2> 997013 T3063 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a48267[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 997016 T3062 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 997018 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 997018 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 997018 T3066 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55852/_/p collection:collection1 shard:shard3
   [junit4]   2> 997021 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 997035 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 997042 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997044 T3066 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 997044 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1728 name=collection1 org.apache.solr.core.SolrCore@f130cd url=http://127.0.0.1:55852/_/p/collection1 node=127.0.0.1:55852__%2Fp C1728_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55852/_/p, core=collection1, node_name=127.0.0.1:55852__%2Fp}
   [junit4]   2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55852/_/p/collection1/
   [junit4]   2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncToMe http://127.0.0.1:55852/_/p/collection1/ has no replicas
   [junit4]   2> 997045 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55852/_/p/collection1/ shard3
   [junit4]   2> 997045 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 997049 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 997062 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997067 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997069 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997069 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997070 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997083 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 997090 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997217 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997218 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997218 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997219 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997231 T3066 oasc.ZkController.register We are http://127.0.0.1:55852/_/p/collection1/ and leader is http://127.0.0.1:55852/_/p/collection1/
   [junit4]   2> 997231 T3066 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55852/_/p
   [junit4]   2> 997231 T3066 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 997231 T3066 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 997231 T3066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997236 T3066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 997238 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 997239 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55852/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55852__%2Fp",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 997247 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 997351 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997351 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997352 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997352 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 997656 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 997656 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 997663 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55861
   [junit4]   2> 997665 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324
   [junit4]   2> 997665 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\'
   [junit4]   2> 997703 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\solr.xml
   [junit4]   2> 997771 T2999 oasc.CoreContainer.<init> New CoreContainer 16179
   [junit4]   2> 997771 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\]
   [junit4]   2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 997775 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 997780 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 997780 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 997780 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 997780 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
   [junit4]   2> 997780 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 997784 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 997797 T3077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3566b7 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 997799 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 997807 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 997810 T3079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b8d2d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 997811 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 997819 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 998807 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55861__%2Fp
   [junit4]   2> 998810 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55861__%2Fp
   [junit4]   2> 998816 T3079 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 998816 T3043 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 998817 T3061 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 998817 T3030 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 998817 T3021 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 998834 T3080 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 998834 T3080 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 998837 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 998837 T3080 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 998841 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 998842 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55861/_/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55861__%2Fp",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 998850 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 998852 T3079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 998853 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 998852 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 998852 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 998852 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 999819 T3080 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 999819 T3080 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1
   [junit4]   2> 999819 T3080 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 999820 T3080 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 999821 T3080 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 999822 T3080 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 999823 T3080 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\'
   [junit4]   2> 999824 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/classes/' to classloader
   [junit4]   2> 999825 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/README' to classloader
   [junit4]   2> 999892 T3080 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 999944 T3080 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 999950 T3080 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 999960 T3080 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1000424 T3080 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1000427 T3080 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1000429 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1000435 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1000480 T3080 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1000480 T3080 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\
   [junit4]   2> 1000481 T3080 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
   [junit4]   2> 1000483 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3
   [junit4]   2> 1000483 T3080 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\index/
   [junit4]   2> 1000485 T3080 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index' doesn't exist. Creating new index...
   [junit4]   2> 1000487 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index
   [junit4]   2> 1000488 T3080 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@44122f
   [junit4]   2> 100

[...truncated too long message...]

afeLeaderTest]
   [junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
   [junit4]   2> 	  61) Thread[id=3629, name=HashSessionScavenger-86, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> 	  62) Thread[id=3462, name=qtp2822754-3462 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	  63) Thread[id=3067, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> 	  64) Thread[id=3784, name=searcherExecutor-2028-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	  65) Thread[id=3719, name=HashSessionScavenger-90, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=pt_BR, timezone=Africa/Abidjan
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=131,free=31522104,total=188809216
   [junit4]   2> NOTE: All tests run in this JVM: [TestBadConfig, DistributedSuggestComponentTest, BasicDistributedZk2Test, TestArbitraryIndexDir, TestFoldingMultitermQuery, BlockDirectoryTest, HdfsBasicDistributedZk2Test, TestImplicitCoreProperties, TestMergePolicyConfig, TestExtendedDismaxParser, TestSolrDeletionPolicy2, TestSystemIdResolver, TestRangeQuery, TestRTGBase, LeaderElectionIntegrationTest, MoreLikeThisHandlerTest, TestDynamicFieldCollectionResource, StandardRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestDistributedSearch, WordBreakSolrSpellCheckerTest, UpdateRequestProcessorFactoryTest, TestDefaultSimilarityFactory, TestNoOpRegenerator, TestFieldTypeResource, TestStressReorder, RegexBoostProcessorTest, SuggesterWFSTTest, BasicZkTest, NotRequiredUniqueKeyTest, FileBasedSpellCheckerTest, TestStressLucene, SimpleFacetsTest, TestAddFieldRealTimeGet, TestSchemaVersionResource, TermVectorComponentTest, TestQueryUtils, TestElisionMultitermQuery, TestFiltering, SolrCmdDistributorTest, ScriptEngineTest, FileUtilsTest, LeaderElectionTest, TestFieldTypeCollectionResource, TestFaceting, RequestHandlersTest, CoreAdminHandlerTest, CSVRequestHandlerTest, EnumFieldTest, QueryParsingTest, DocValuesTest, TimeZoneUtilsTest, TestSchemaNameResource, SolrXmlInZkTest, AssignTest, SolrPluginUtilsTest, DocumentBuilderTest, ResourceLoaderTest, TestSolrJ, DirectUpdateHandlerTest, SystemInfoHandlerTest, TestJoin, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest, UpdateParamsTest, SpellingQueryConverterTest, TestOmitPositions, TestRandomMergePolicy, TestSolrDeletionPolicy1, OverseerCollectionProcessorTest, TestMultiCoreConfBootstrap, DistribCursorPagingTest, BasicDistributedZkTest, StressHdfsTest, TestCoreDiscovery, ShardSplitTest, CursorPagingTest, SolrCoreCheckLockOnStartupTest, TestCustomSort, PreAnalyzedFieldTest, ZkSolrClientTest, OverseerTest, TestNRTOpen, ReturnFieldsTest, TestValueSourceCache, TestWriterPerf, HdfsSyncSliceTest, DirectUpdateHandlerOptimizeTest, TestFreeTextSuggestions, TestPostingsSolrHighlighter, TestCharFilters, TestCSVResponseWriter, URLClassifyProcessorTest, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=950075651ABE109E -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Africa/Abidjan -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    > Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)
   [junit4]    > 	at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382)
   [junit4]    > 	at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275)
   [junit4]    > 	at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250)
   [junit4]    > 	at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444)
   [junit4]    > 	at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632)
   [junit4]    > 	at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
   [junit4]    > 	at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
   [junit4]    > 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
   [junit4] Completed in 7494.92s, 1 test, 3 errors <<< FAILURES!

[...truncated 790 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 358 suites, 1554 tests, 2 suite-level errors, 1 error, 1121 ignored (2 assumptions)

Total time: 177 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3684 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
My FullMetalJenkins box died a little while back and I just got it back up today - the ChaosMonkey tests all appear to be stuck in some ugly slow recovery loop due to tripping an assert while trying to read the transaction logs.

I assume that is the cause of these timeouts.

Headed out for a while now, but I’ll follow up the a JIRA issue and stack traces and such.

- Mark

http://about.me/markrmiller

On Feb 8, 2014, at 8:14 PM, Mark Miller <ma...@gmail.com> wrote:

> Something has started this recently. I have not had a chance to dig into it yet. It takes some mental preparation before diving into these logs...
> 
> - Mark
> 
> http://about.me/markrmiller
> 
> 
> 
> On Feb 8, 2014, 5:47:46 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:
> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3684/ 
> Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC 
> 
> 3 tests failed. 
> REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch 
> 
> Error Message: 
> Test abandoned because suite timeout was reached. 
> 
> Stack Trace: 
> java.lang.Exception: Test abandoned because suite timeout was reached. 
> at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0) 
> 
> 
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest 
> 
> Error Message: 
> Suite timeout exceeded (>= 7200000 msec). 
> 
> Stack Trace: 
> java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). 
> at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0) 
> 
> 
> FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest 
> 
> Error Message: 
> Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest] 
> 
> Stack Trace: 
> com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest] 
> Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3 
> at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0) 
> at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92) 
> at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103) 
> at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141) 
> at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235) 
> at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100) 
> at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382) 
> at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275) 
> at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250) 
> at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444) 
> at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632) 
> at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670) 
> at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490) 
> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322) 
> at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155) 
> at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437) 
> at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247) 
> 
> 
> 
> 
> Build Log: 
> [...truncated 10452 lines...] 
> [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest 
> [junit4] 2> 987106 T2999 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/p 
> [junit4] 2> 987113 T2999 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch 
> [junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1391891628420 
> [junit4] 2> 987118 T2999 oasc.ZkTestServer.run STARTING ZK TEST SERVER 
> [junit4] 2> 987119 T3000 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server 
> [junit4] 2> 987208 T2999 oasc.ZkTestServer.run start zk server on port:55824 
> [junit4] 2> 987209 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 987218 T3006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c1772 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 987219 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 987219 T2999 oascc.SolrZkClient.makePath makePath: /solr 
> [junit4] 2> 987233 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 987239 T3008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@170832b name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 987240 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 987240 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1 
> [junit4] 2> 987247 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards 
> [junit4] 2> 987253 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection 
> [junit4] 2> 987256 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards 
> [junit4] 2> 987262 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml 
> [junit4] 2> 987263 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml 
> [junit4] 2> 987272 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml 
> [junit4] 2> 987274 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml 
> [junit4] 2> 987282 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml 
> [junit4] 2> 987284 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml 
> [junit4] 2> 987294 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt 
> [junit4] 2> 987294 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt 
> [junit4] 2> 987301 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt 
> [junit4] 2> 987301 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt 
> [junit4] 2> 987308 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml 
> [junit4] 2> 987309 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml 
> [junit4] 2> 987316 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml 
> [junit4] 2> 987316 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml 
> [junit4] 2> 987323 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json 
> [junit4] 2> 987323 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json 
> [junit4] 2> 987330 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt 
> [junit4] 2> 987331 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt 
> [junit4] 2> 987338 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt 
> [junit4] 2> 987338 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt 
> [junit4] 2> 987345 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt 
> [junit4] 2> 987346 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt 
> [junit4] 2> 988019 T2999 oejs.Server.doStart jetty-8.1.10.v20130312 
> [junit4] 2> 988035 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55831 
> [junit4] 2> 988036 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() 
> [junit4] 2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) 
> [junit4] 2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662 
> [junit4] 2> 988037 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\' 
> [junit4] 2> 988073 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\solr.xml 
> [junit4] 2> 988146 T2999 oasc.CoreContainer.<init> New CoreContainer 5339219 
> [junit4] 2> 988146 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\] 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http:// 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 
> [junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 
> [junit4] 2> 988151 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false 
> [junit4] 2> 988153 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 
> [junit4] 2> 988153 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 
> [junit4] 2> 988156 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1 
> [junit4] 2> 988156 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr 
> [junit4] 2> 988156 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot 
> [junit4] 2> 988158 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 988170 T3019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2b015 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 988171 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 988180 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 988186 T3021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef853d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 988186 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 988191 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue 
> [junit4] 2> 988198 T2999 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work 
> [junit4] 2> 988207 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes 
> [junit4] 2> 988211 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55831__%2Fp 
> [junit4] 2> 988215 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55831__%2Fp 
> [junit4] 2> 988224 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect 
> [junit4] 2> 988228 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/election 
> [junit4] 2> 988240 T2999 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55831__%2Fp 
> [junit4] 2> 988240 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader 
> [junit4] 2> 988245 T2999 oasc.Overseer.start Overseer (id=91219009761181699-127.0.0.1:55831__%2Fp-n_0000000000) starting 
> [junit4] 2> 988254 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue-work 
> [junit4] 2> 988263 T3023 oasc.OverseerCollectionProcessor.run Process current queue of collection creations 
> [junit4] 2> 988265 T2999 oascc.SolrZkClient.makePath makePath: /clusterstate.json 
> [junit4] 2> 988267 T3023 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes 
> [junit4] 2> 988272 T2999 oascc.SolrZkClient.makePath makePath: /aliases.json 
> [junit4] 2> 988279 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4] 2> 988287 T3022 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue 
> [junit4] 2> 988294 T3024 oasc.ZkController.publish publishing core=collection1 state=down 
> [junit4] 2> 988294 T3024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 988296 T3024 oasc.ZkController.waitForCoreNodeName look for our core node name 
> [junit4] 2> 988296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 988301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"down", 
> [junit4] 2> "base_url":"http://127.0.0.1:55831/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55831__%2Fp", 
> [junit4] 2> "shard":null, 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"control_collection", 
> [junit4] 2> "numShards":"1", 
> [junit4] 2> "core_node_name":null} 
> [junit4] 2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1] 
> [junit4] 2> 988302 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1 
> [junit4] 2> 988312 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 988314 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 989187 T3024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 
> [junit4] 2> 989187 T3024 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1 
> [junit4] 2> 989188 T3024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection 
> [junit4] 2> 989189 T3024 oasc.ZkController.createCollectionZkNode Collection zkNode exists 
> [junit4] 2> 989190 T3024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection 
> [junit4] 2> 989192 T3024 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper 
> [junit4] 2> 989192 T3024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\' 
> [junit4] 2> 989196 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/classes/' to classloader 
> [junit4] 2> 989198 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/README' to classloader 
> [junit4] 2> 989258 T3024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47 
> [junit4] 2> 989314 T3024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml 
> [junit4] 2> 989318 T3024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml 
> [junit4] 2> 989326 T3024 oass.IndexSchema.readSchema [collection1] Schema name=test 
> [junit4] 2> 989788 T3024 oass.IndexSchema.readSchema default search field in schema is text 
> [junit4] 2> 989790 T3024 oass.IndexSchema.readSchema unique key field: id 
> [junit4] 2> 989793 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 989801 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 989855 T3024 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory 
> [junit4] 2> 989855 T3024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\ 
> [junit4] 2> 989855 T3024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80 
> [junit4] 2> 989856 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data 
> [junit4] 2> 989859 T3024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\index/ 
> [junit4] 2> 989859 T3024 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index' doesn't exist. Creating new index... 
> [junit4] 2> 989861 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index 
> [junit4] 2> 989861 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@f762ea 
> [junit4] 2> 989874 T3024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1} 
> [junit4] 2> 989874 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" 
> [junit4] 2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" 
> [junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" 
> [junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" 
> [junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 989881 T3024 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default 
> [junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler 
> [junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler 
> [junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler 
> [junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler 
> [junit4] 2> 989882 T3024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler 
> [junit4] 2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers 
> [junit4] 2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler 
> [junit4] 2> 989900 T3024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 
> [junit4] 2> 989904 T3024 oasu.CommitTracker.<init> Hard AutoCommit: disabled 
> [junit4] 2> 989905 T3024 oasu.CommitTracker.<init> Soft AutoCommit: disabled 
> [junit4] 2> 989906 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] 
> [junit4] 2> 989908 T3024 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1} 
> [junit4] 2> 989908 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 989909 T3024 oass.SolrIndexSearcher.<init> Opening Searcher@c1bc06[collection1] main 
> [junit4] 2> 989913 T3025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c1bc06[collection1] main{StandardDirectoryReader(segments_1:1:nrt)} 
> [junit4] 2> 989914 T3024 oasc.CoreContainer.registerCore registering core: collection1 
> [junit4] 2> 989915 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0 
> [junit4] 2> 989915 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done 
> [junit4] 2> 989915 T3028 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55831/_/p collection:control_collection shard:shard1 
> [junit4] 2> 989918 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 989920 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election 
> [junit4] 2> 989922 T3030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19c52d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 989922 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 989924 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4] 2> 989936 T2999 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false 
> [junit4] 2> 989942 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 
> [junit4] 2> 989947 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. 
> [junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync 
> [junit4] 2> ASYNC NEW_CORE C1726 name=collection1 org.apache.solr.core.SolrCore@78f9a5 url=http://127.0.0.1:55831/_/p/collection1 node=127.0.0.1:55831__%2Fp C1726_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55831/_/p, core=collection1, node_name=127.0.0.1:55831__%2Fp} 
> [junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55831/_/p/collection1/ 
> [junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me 
> [junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncToMe http://127.0.0.1:55831/_/p/collection1/ has no replicas 
> [junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55831/_/p/collection1/ shard1 
> [junit4] 2> 989948 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1 
> [junit4] 2> 989953 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 989968 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 989975 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 989975 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 989986 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 989992 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 990088 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 990089 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 990118 T3028 oasc.ZkController.register We are http://127.0.0.1:55831/_/p/collection1/ and leader is http://127.0.0.1:55831/_/p/collection1/ 
> [junit4] 2> 990118 T3028 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55831/_/p 
> [junit4] 2> 990118 T3028 oasc.ZkController.checkRecovery I am the leader, no recovery necessary 
> [junit4] 2> 990118 T3028 oasc.ZkController.publish publishing core=collection1 state=active 
> [junit4] 2> 990118 T3028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 990125 T3028 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 990127 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 990128 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"active", 
> [junit4] 2> "base_url":"http://127.0.0.1:55831/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55831__%2Fp", 
> [junit4] 2> "shard":"shard1", 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"control_collection", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":"core_node1"} 
> [junit4] 2> 990133 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 990230 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 990230 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1) 
> [junit4] 2> 990591 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 
> [junit4] 2> 990592 T2999 oejs.Server.doStart jetty-8.1.10.v20130312 
> [junit4] 2> 990597 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55843 
> [junit4] 2> 990598 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() 
> [junit4] 2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) 
> [junit4] 2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241 
> [junit4] 2> 990598 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\' 
> [junit4] 2> 990629 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\solr.xml 
> [junit4] 2> 990703 T2999 oasc.CoreContainer.<init> New CoreContainer 20947143 
> [junit4] 2> 990703 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\] 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http:// 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 
> [junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false 
> [junit4] 2> 990712 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 
> [junit4] 2> 990712 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 
> [junit4] 2> 990712 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1 
> [junit4] 2> 990712 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr 
> [junit4] 2> 990712 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot 
> [junit4] 2> 990716 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 990727 T3041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5471a9 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 990728 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 990731 T3001 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441334c1940005, likely client has closed socket 
> [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220) 
> [junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208) 
> [junit4] 2> at java.lang.Thread.run(Thread.java:744) 
> [junit4] 2> 
> [junit4] 2> 990733 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 990742 T3043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141b96e name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 990743 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 990753 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4] 2> 991653 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55843__%2Fp 
> [junit4] 2> 991655 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55843__%2Fp 
> [junit4] 2> 991660 T3021 oascc.ZkStateReader$3.process Updating live nodes... (2) 
> [junit4] 2> 991661 T3030 oascc.ZkStateReader$3.process Updating live nodes... (2) 
> [junit4] 2> 991661 T3043 oascc.ZkStateReader$3.process Updating live nodes... (2) 
> [junit4] 2> 991672 T3044 oasc.ZkController.publish publishing core=collection1 state=down 
> [junit4] 2> 991672 T3044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 991675 T3044 oasc.ZkController.waitForCoreNodeName look for our core node name 
> [junit4] 2> 991677 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 991678 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"down", 
> [junit4] 2> "base_url":"http://127.0.0.1:55843/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55843__%2Fp", 
> [junit4] 2> "shard":null, 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"collection1", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":null} 
> [junit4] 2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3] 
> [junit4] 2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1 
> [junit4] 2> 991683 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 991777 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 991777 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 991777 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 992567 T3044 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 
> [junit4] 2> 992567 T3044 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1 
> [junit4] 2> 992567 T3044 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 
> [junit4] 2> 992568 T3044 oasc.ZkController.createCollectionZkNode Collection zkNode exists 
> [junit4] 2> 992569 T3044 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 
> [junit4] 2> 992571 T3044 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper 
> [junit4] 2> 992572 T3044 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\' 
> [junit4] 2> 992574 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/classes/' to classloader 
> [junit4] 2> 992575 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/README' to classloader 
> [junit4] 2> 992639 T3044 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47 
> [junit4] 2> 992692 T3044 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml 
> [junit4] 2> 992695 T3044 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml 
> [junit4] 2> 992706 T3044 oass.IndexSchema.readSchema [collection1] Schema name=test 
> [junit4] 2> 993206 T3044 oass.IndexSchema.readSchema default search field in schema is text 
> [junit4] 2> 993217 T3044 oass.IndexSchema.readSchema unique key field: id 
> [junit4] 2> 993220 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 993226 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 993276 T3044 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory 
> [junit4] 2> 993276 T3044 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\ 
> [junit4] 2> 993277 T3044 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80 
> [junit4] 2> 993277 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1 
> [junit4] 2> 993278 T3044 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\index/ 
> [junit4] 2> 993280 T3044 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index' doesn't exist. Creating new index... 
> [junit4] 2> 993281 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index 
> [junit4] 2> 993282 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d8704c 
> [junit4] 2> 993289 T3044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1} 
> [junit4] 2> 993289 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 993294 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" 
> [junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" 
> [junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" 
> [junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" 
> [junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 993297 T3044 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default 
> [junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler 
> [junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler 
> [junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler 
> [junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler 
> [junit4] 2> 993300 T3044 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler 
> [junit4] 2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers 
> [junit4] 2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler 
> [junit4] 2> 993309 T3044 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 
> [junit4] 2> 993314 T3044 oasu.CommitTracker.<init> Hard AutoCommit: disabled 
> [junit4] 2> 993314 T3044 oasu.CommitTracker.<init> Soft AutoCommit: disabled 
> [junit4] 2> 993315 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] 
> [junit4] 2> 993317 T3044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1} 
> [junit4] 2> 993317 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 993317 T3044 oass.SolrIndexSearcher.<init> Opening Searcher@2d83b4[collection1] main 
> [junit4] 2> 993324 T3045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d83b4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)} 
> [junit4] 2> 993327 T3044 oasc.CoreContainer.registerCore registering core: collection1 
> [junit4] 2> 993329 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0 
> [junit4] 2> 993330 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done 
> [junit4] 2> 993329 T3048 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55843/_/p collection:collection1 shard:shard1 
> [junit4] 2> 993333 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election 
> [junit4] 2> 993356 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1 
> [junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. 
> [junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync 
> [junit4] 2> ASYNC NEW_CORE C1727 name=collection1 org.apache.solr.core.SolrCore@ddb135 url=http://127.0.0.1:55843/_/p/collection1 node=127.0.0.1:55843__%2Fp C1727_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55843/_/p, core=collection1, node_name=127.0.0.1:55843__%2Fp} 
> [junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55843/_/p/collection1/ 
> [junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me 
> [junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncToMe http://127.0.0.1:55843/_/p/collection1/ has no replicas 
> [junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55843/_/p/collection1/ shard1 
> [junit4] 2> 993366 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1 
> [junit4] 2> 993370 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 993380 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993383 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993383 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993384 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993396 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 993404 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993510 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993510 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993510 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993543 T3048 oasc.ZkController.register We are http://127.0.0.1:55843/_/p/collection1/ and leader is http://127.0.0.1:55843/_/p/collection1/ 
> [junit4] 2> 993543 T3048 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55843/_/p 
> [junit4] 2> 993543 T3048 oasc.ZkController.checkRecovery I am the leader, no recovery necessary 
> [junit4] 2> 993543 T3048 oasc.ZkController.publish publishing core=collection1 state=active 
> [junit4] 2> 993543 T3048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993548 T3048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 993552 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 993554 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"active", 
> [junit4] 2> "base_url":"http://127.0.0.1:55843/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55843__%2Fp", 
> [junit4] 2> "shard":"shard1", 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"collection1", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":"core_node1"} 
> [junit4] 2> 993560 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 993664 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993665 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 993665 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2) 
> [junit4] 2> 994085 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 
> [junit4] 2> 994086 T2999 oejs.Server.doStart jetty-8.1.10.v20130312 
> [junit4] 2> 994091 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55852 
> [junit4] 2> 994093 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() 
> [junit4] 2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) 
> [junit4] 2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635 
> [junit4] 2> 994096 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\' 
> [junit4] 2> 994141 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\solr.xml 
> [junit4] 2> 994212 T2999 oasc.CoreContainer.<init> New CoreContainer 12769958 
> [junit4] 2> 994212 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\] 
> [junit4] 2> 994214 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 
> [junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http:// 
> [junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 
> [junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 
> [junit4] 2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 
> [junit4] 2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 
> [junit4] 2> 994217 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 
> [junit4] 2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 
> [junit4] 2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false 
> [junit4] 2> 994224 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 
> [junit4] 2> 994224 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 
> [junit4] 2> 994224 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1 
> [junit4] 2> 994225 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr 
> [junit4] 2> 994225 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot 
> [junit4] 2> 994229 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 994246 T3059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0f5d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 994253 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 994267 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 994274 T3061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff2649 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 994274 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 994286 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4] 2> 995271 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55852__%2Fp 
> [junit4] 2> 995273 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55852__%2Fp 
> [junit4] 2> 995281 T3021 oascc.ZkStateReader$3.process Updating live nodes... (3) 
> [junit4] 2> 995281 T3061 oascc.ZkStateReader$3.process Updating live nodes... (3) 
> [junit4] 2> 995282 T3030 oascc.ZkStateReader$3.process Updating live nodes... (3) 
> [junit4] 2> 995282 T3043 oascc.ZkStateReader$3.process Updating live nodes... (3) 
> [junit4] 2> 995294 T3062 oasc.ZkController.publish publishing core=collection1 state=down 
> [junit4] 2> 995295 T3062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 995296 T3062 oasc.ZkController.waitForCoreNodeName look for our core node name 
> [junit4] 2> 995296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 995301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"down", 
> [junit4] 2> "base_url":"http://127.0.0.1:55852/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55852__%2Fp", 
> [junit4] 2> "shard":null, 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"collection1", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":null} 
> [junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 
> [junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3 
> [junit4] 2> 995309 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 995311 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 995311 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 995312 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 995311 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 996277 T3062 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 
> [junit4] 2> 996277 T3062 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1 
> [junit4] 2> 996277 T3062 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 
> [junit4] 2> 996280 T3062 oasc.ZkController.createCollectionZkNode Collection zkNode exists 
> [junit4] 2> 996280 T3062 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 
> [junit4] 2> 996282 T3062 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper 
> [junit4] 2> 996282 T3062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\' 
> [junit4] 2> 996286 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/classes/' to classloader 
> [junit4] 2> 996287 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/README' to classloader 
> [junit4] 2> 996369 T3062 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47 
> [junit4] 2> 996421 T3062 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml 
> [junit4] 2> 996425 T3062 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml 
> [junit4] 2> 996434 T3062 oass.IndexSchema.readSchema [collection1] Schema name=test 
> [junit4] 2> 996902 T3062 oass.IndexSchema.readSchema default search field in schema is text 
> [junit4] 2> 996905 T3062 oass.IndexSchema.readSchema unique key field: id 
> [junit4] 2> 996908 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 996915 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 996960 T3062 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory 
> [junit4] 2> 996961 T3062 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\ 
> [junit4] 2> 996961 T3062 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80 
> [junit4] 2> 996963 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2 
> [junit4] 2> 996964 T3062 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\index/ 
> [junit4] 2> 996966 T3062 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index' doesn't exist. Creating new index... 
> [junit4] 2> 996966 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index 
> [junit4] 2> 996967 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1f092fe 
> [junit4] 2> 996973 T3062 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1} 
> [junit4] 2> 996974 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib" 
> [junit4] 2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe" 
> [junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe" 
> [junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig" 
> [junit4] 2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit" 
> [junit4] 2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 996981 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit" 
> [junit4] 2> 996981 T3062 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default 
> [junit4] 2> 996982 T3062 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler 
> [junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler 
> [junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler 
> [junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler 
> [junit4] 2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler 
> [junit4] 2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers 
> [junit4] 2> 996985 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler 
> [junit4] 2> 996998 T3062 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60 
> [junit4] 2> 997005 T3062 oasu.CommitTracker.<init> Hard AutoCommit: disabled 
> [junit4] 2> 997005 T3062 oasu.CommitTracker.<init> Soft AutoCommit: disabled 
> [junit4] 2> 997006 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] 
> [junit4] 2> 997008 T3062 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1 
> [junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1} 
> [junit4] 2> 997008 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1 
> [junit4] 2> 997009 T3062 oass.SolrIndexSearcher.<init> Opening Searcher@1a48267[collection1] main 
> [junit4] 2> 997013 T3063 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a48267[collection1] main{StandardDirectoryReader(segments_1:1:nrt)} 
> [junit4] 2> 997016 T3062 oasc.CoreContainer.registerCore registering core: collection1 
> [junit4] 2> 997018 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0 
> [junit4] 2> 997018 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done 
> [junit4] 2> 997018 T3066 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55852/_/p collection:collection1 shard:shard3 
> [junit4] 2> 997021 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election 
> [junit4] 2> 997035 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3 
> [junit4] 2> 997042 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997044 T3066 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue. 
> [junit4] 2> 997044 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync 
> [junit4] 2> ASYNC NEW_CORE C1728 name=collection1 org.apache.solr.core.SolrCore@f130cd url=http://127.0.0.1:55852/_/p/collection1 node=127.0.0.1:55852__%2Fp C1728_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55852/_/p, core=collection1, node_name=127.0.0.1:55852__%2Fp} 
> [junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55852/_/p/collection1/ 
> [junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me 
> [junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncToMe http://127.0.0.1:55852/_/p/collection1/ has no replicas 
> [junit4] 2> 997045 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55852/_/p/collection1/ shard3 
> [junit4] 2> 997045 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3 
> [junit4] 2> 997049 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 997062 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997067 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997069 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997069 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997070 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997083 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 997090 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997217 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997218 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997218 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997219 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997231 T3066 oasc.ZkController.register We are http://127.0.0.1:55852/_/p/collection1/ and leader is http://127.0.0.1:55852/_/p/collection1/ 
> [junit4] 2> 997231 T3066 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55852/_/p 
> [junit4] 2> 997231 T3066 oasc.ZkController.checkRecovery I am the leader, no recovery necessary 
> [junit4] 2> 997231 T3066 oasc.ZkController.publish publishing core=collection1 state=active 
> [junit4] 2> 997231 T3066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997236 T3066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 997238 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 997239 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"active", 
> [junit4] 2> "base_url":"http://127.0.0.1:55852/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55852__%2Fp", 
> [junit4] 2> "shard":"shard3", 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"collection1", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":"core_node2"} 
> [junit4] 2> 997247 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 997351 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997351 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997352 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997352 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3) 
> [junit4] 2> 997656 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3 
> [junit4] 2> 997656 T2999 oejs.Server.doStart jetty-8.1.10.v20130312 
> [junit4] 2> 997663 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55861 
> [junit4] 2> 997665 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() 
> [junit4] 2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx) 
> [junit4] 2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324 
> [junit4] 2> 997665 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\' 
> [junit4] 2> 997703 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\solr.xml 
> [junit4] 2> 997771 T2999 oasc.CoreContainer.<init> New CoreContainer 16179 
> [junit4] 2> 997771 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\] 
> [junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000 
> [junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http:// 
> [junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000 
> [junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20 
> [junit4] 2> 997775 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0 
> [junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647 
> [junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5 
> [junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1 
> [junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false 
> [junit4] 2> 997780 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory 
> [junit4] 2> 997780 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)] 
> [junit4] 2> 997780 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1 
> [junit4] 2> 997780 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr 
> [junit4] 2> 997780 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot 
> [junit4] 2> 997784 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 997797 T3077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3566b7 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 997799 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 997807 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper 
> [junit4] 2> 997810 T3079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b8d2d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None 
> [junit4] 2> 997811 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper 
> [junit4] 2> 997819 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
> [junit4] 2> 998807 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55861__%2Fp 
> [junit4] 2> 998810 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55861__%2Fp 
> [junit4] 2> 998816 T3079 oascc.ZkStateReader$3.process Updating live nodes... (4) 
> [junit4] 2> 998816 T3043 oascc.ZkStateReader$3.process Updating live nodes... (4) 
> [junit4] 2> 998817 T3061 oascc.ZkStateReader$3.process Updating live nodes... (4) 
> [junit4] 2> 998817 T3030 oascc.ZkStateReader$3.process Updating live nodes... (4) 
> [junit4] 2> 998817 T3021 oascc.ZkStateReader$3.process Updating live nodes... (4) 
> [junit4] 2> 998834 T3080 oasc.ZkController.publish publishing core=collection1 state=down 
> [junit4] 2> 998834 T3080 oasc.ZkController.publish numShards not found on descriptor - reading it from system property 
> [junit4] 2> 998837 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 998837 T3080 oasc.ZkController.waitForCoreNodeName look for our core node name 
> [junit4] 2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 998841 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
> [junit4] 2> 998842 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={ 
> [junit4] 2> "operation":"state", 
> [junit4] 2> "state":"down", 
> [junit4] 2> "base_url":"http://127.0.0.1:55861/_/p", 
> [junit4] 2> "core":"collection1", 
> [junit4] 2> "roles":null, 
> [junit4] 2> "node_name":"127.0.0.1:55861__%2Fp", 
> [junit4] 2> "shard":null, 
> [junit4] 2> "shard_range":null, 
> [junit4] 2> "shard_state":"active", 
> [junit4] 2> "shard_parent":null, 
> [junit4] 2> "collection":"collection1", 
> [junit4] 2> "numShards":"3", 
> [junit4] 2> "core_node_name":null} 
> [junit4] 2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3 
> [junit4] 2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2 
> [junit4] 2> 998850 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged 
> [junit4] 2> 998852 T3079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) 
> [junit4] 2> 998853 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) 
> [junit4] 2> 998852 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) 
> [junit4] 2> 998852 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) 
> [junit4] 2> 998852 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4) 
> [junit4] 2> 999819 T3080 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1 
> [junit4] 2> 999819 T3080 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1 
> [junit4] 2> 999819 T3080 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1 
> [junit4] 2> 999820 T3080 oasc.ZkController.createCollectionZkNode Collection zkNode exists 
> [junit4] 2> 999821 T3080 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1 
> [junit4] 2> 999822 T3080 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper 
> [junit4] 2> 999823 T3080 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\' 
> [junit4] 2> 999824 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/classes/' to classloader 
> [junit4] 2> 999825 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/README' to classloader 
> [junit4] 2> 999892 T3080 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47 
> [junit4] 2> 999944 T3080 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml 
> [junit4] 2> 999950 T3080 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml 
> [junit4] 2> 999960 T3080 oass.IndexSchema.readSchema [collection1] Schema name=test 
> [junit4] 2> 1000424 T3080 oass.IndexSchema.readSchema default search field in schema is text 
> [junit4] 2> 1000427 T3080 oass.IndexSchema.readSchema unique key field: id 
> [junit4] 2> 1000429 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 1000435 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml 
> [junit4] 2> 1000480 T3080 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory 
> [junit4] 2> 1000480 T3080 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\ 
> [junit4] 2> 1000481 T3080 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80 
> [junit4] 2> 1000483 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3 
> [junit4] 2> 1000483 T3080 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\index/ 
> [junit4] 2> 1000485 T3080 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index' doesn't exist. Creating new index... 
> [junit4] 2> 1000487 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index 
> [junit4] 2> 1000488 T3080 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@44122f 
> [junit4] 2> 100 
> 
> [...truncated too long message...] 
> 
> afeLeaderTest] 
> [junit4] 2> at java.lang.Thread.sleep(Native Method) 
> [junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984) 
> [junit4] 2> 61) Thread[id=3629, name=HashSessionScavenger-86, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] 2> at java.lang.Object.wait(Native Method) 
> [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552) 
> [junit4] 2> at java.util.TimerThread.run(Timer.java:505) 
> [junit4] 2> 62) Thread[id=3462, name=qtp2822754-3462 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] 2> at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method) 
> [junit4] 2> at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464) 
> [junit4] 2> at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606) 
> [junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210) 
> [junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216) 
> [junit4] 2> at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157) 
> [junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) 
> [junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) 
> [junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) 
> [junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) 
> [junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) 
> [junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) 
> [junit4] 2> at java.lang.Thread.run(Thread.java:744) 
> [junit4] 2> 63) Thread[id=3067, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] 2> at java.lang.Object.wait(Native Method) 
> [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552) 
> [junit4] 2> at java.util.TimerThread.run(Timer.java:505) 
> [junit4] 2> 64) Thread[id=3784, name=searcherExecutor-2028-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] 2> at sun.misc.Unsafe.park(Native Method) 
> [junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) 
> [junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) 
> [junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) 
> [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) 
> [junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) 
> [junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) 
> [junit4] 2> at java.lang.Thread.run(Thread.java:744) 
> [junit4] 2> 65) Thread[id=3719, name=HashSessionScavenger-90, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] 2> at java.lang.Object.wait(Native Method) 
> [junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552) 
> [junit4] 2> at java.util.TimerThread.run(Timer.java:505) 
> [junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=pt_BR, timezone=Africa/Abidjan 
> [junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=131,free=31522104,total=188809216 
> [junit4] 2> NOTE: All tests run in this JVM: [TestBadConfig, DistributedSuggestComponentTest, BasicDistributedZk2Test, TestArbitraryIndexDir, TestFoldingMultitermQuery, BlockDirectoryTest, HdfsBasicDistributedZk2Test, TestImplicitCoreProperties, TestMergePolicyConfig, TestExtendedDismaxParser, TestSolrDeletionPolicy2, TestSystemIdResolver, TestRangeQuery, TestRTGBase, LeaderElectionIntegrationTest, MoreLikeThisHandlerTest, TestDynamicFieldCollectionResource, StandardRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestDistributedSearch, WordBreakSolrSpellCheckerTest, UpdateRequestProcessorFactoryTest, TestDefaultSimilarityFactory, TestNoOpRegenerator, TestFieldTypeResource, TestStressReorder, RegexBoostProcessorTest, SuggesterWFSTTest, BasicZkTest, NotRequiredUniqueKeyTest, FileBasedSpellCheckerTest, TestStressLucene, SimpleFacetsTest, TestAddFieldRealTimeGet, TestSchemaVersionResource, TermVectorComponentTest, TestQueryUtils, TestElisionMultitermQuery, TestFiltering, SolrCmdDistributorTest, ScriptEngineTest, FileUtilsTest, LeaderElectionTest, TestFieldTypeCollectionResource, TestFaceting, RequestHandlersTest, CoreAdminHandlerTest, CSVRequestHandlerTest, EnumFieldTest, QueryParsingTest, DocValuesTest, TimeZoneUtilsTest, TestSchemaNameResource, SolrXmlInZkTest, AssignTest, SolrPluginUtilsTest, DocumentBuilderTest, ResourceLoaderTest, TestSolrJ, DirectUpdateHandlerTest, SystemInfoHandlerTest, TestJoin, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest, UpdateParamsTest, SpellingQueryConverterTest, TestOmitPositions, TestRandomMergePolicy, TestSolrDeletionPolicy1, OverseerCollectionProcessorTest, TestMultiCoreConfBootstrap, DistribCursorPagingTest, BasicDistributedZkTest, StressHdfsTest, TestCoreDiscovery, ShardSplitTest, CursorPagingTest, SolrCoreCheckLockOnStartupTest, TestCustomSort, PreAnalyzedFieldTest, ZkSolrClientTest, OverseerTest, TestNRTOpen, ReturnFieldsTest, TestValueSourceCache, TestWriterPerf, HdfsSyncSliceTest, DirectUpdateHandlerOptimizeTest, TestFreeTextSuggestions, TestPostingsSolrHighlighter, TestCharFilters, TestCSVResponseWriter, URLClassifyProcessorTest, ChaosMonkeySafeLeaderTest] 
> [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=950075651ABE109E -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Africa/Abidjan -Dtests.file.encoding=Cp1252 
> [junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<< 
> [junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec). 
> [junit4] > at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest] 
> [junit4] > Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3 
> [junit4] > at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0) 
> [junit4] > at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92) 
> [junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103) 
> [junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141) 
> [junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235) 
> [junit4] > at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100) 
> [junit4] > at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382) 
> [junit4] > at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275) 
> [junit4] > at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250) 
> [junit4] > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444) 
> [junit4] > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632) 
> [junit4] > at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670) 
> [junit4] > at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490) 
> [junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322) 
> [junit4] > at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155) 
> [junit4] > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437) 
> [junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247) 
> [junit4] Completed in 7494.92s, 1 test, 3 errors <<< FAILURES! 
> 
> [...truncated 790 lines...] 
> BUILD FAILED 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line: 
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 358 suites, 1554 tests, 2 suite-level errors, 1 error, 1121 ignored (2 assumptions) 
> 
> Total time: 177 minutes 30 seconds 
> Build step 'Invoke Ant' marked build as failure 
> Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC 
> Archiving artifacts 
> Recording test results 
> Email was triggered for: Failure 
> Sending email for trigger: Failure 
> 
> 
> 
> --------------------------------------------------------------------- 
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org 
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3684 - Failure!

Posted by Mark Miller <ma...@gmail.com>.
Something has started this recently. I have not had a chance to dig into it yet. It takes some mental preparation before diving into these logs...

- Mark 

http://about.me/markrmiller



On Feb 8, 2014, 5:47:46 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3684/
Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC

3 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)


FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)


FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3
at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)
at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141)
at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235)
at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100)
at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382)
at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275)
at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250)
at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444)
at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632)
at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)




Build Log:
[...truncated 10452 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 987106 T2999 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/p
[junit4] 2> 987113 T2999 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1391891628420
[junit4] 2> 987118 T2999 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 987119 T3000 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 987208 T2999 oasc.ZkTestServer.run start zk server on port:55824
[junit4] 2> 987209 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 987218 T3006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8c1772 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 987219 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 987219 T2999 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 987233 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 987239 T3008 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@170832b name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 987240 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 987240 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 987247 T2999 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 987253 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 987256 T2999 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 987262 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 987263 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 987272 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 987274 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 987282 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 987284 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 987294 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 987294 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 987301 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 987301 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 987308 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
[junit4] 2> 987309 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 987316 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 987316 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 987323 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 987323 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 987330 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 987331 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 987338 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 987338 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 987345 T2999 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 987346 T2999 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 988019 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 988035 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55831
[junit4] 2> 988036 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 988036 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662
[junit4] 2> 988037 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\'
[junit4] 2> 988073 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\solr.xml
[junit4] 2> 988146 T2999 oasc.CoreContainer.<init> New CoreContainer 5339219
[junit4] 2> 988146 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\]
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 988148 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 988151 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 988153 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 988153 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 988156 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 988156 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
[junit4] 2> 988156 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 988158 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 988170 T3019 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2b015 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 988171 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 988180 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 988186 T3021 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ef853d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 988186 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 988191 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 988198 T2999 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 988207 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 988211 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55831__%2Fp
[junit4] 2> 988215 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55831__%2Fp
[junit4] 2> 988224 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 988228 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 988240 T2999 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55831__%2Fp
[junit4] 2> 988240 T2999 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 988245 T2999 oasc.Overseer.start Overseer (id=91219009761181699-127.0.0.1:55831__%2Fp-n_0000000000) starting
[junit4] 2> 988254 T2999 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 988263 T3023 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 988265 T2999 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 988267 T3023 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 988272 T2999 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 988279 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 988287 T3022 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 988294 T3024 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 988294 T3024 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 988296 T3024 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 988296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 988301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55831/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55831__%2Fp",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 988301 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 988302 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 988312 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 988314 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989187 T3024 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 989187 T3024 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1
[junit4] 2> 989188 T3024 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 989189 T3024 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 989190 T3024 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 989192 T3024 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 989192 T3024 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\'
[junit4] 2> 989196 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/classes/' to classloader
[junit4] 2> 989198 T3024 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662/collection1/lib/README' to classloader
[junit4] 2> 989258 T3024 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 989314 T3024 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 989318 T3024 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 989326 T3024 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 989788 T3024 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 989790 T3024 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 989793 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 989801 T3024 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 989855 T3024 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 989855 T3024 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391891628662\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\
[junit4] 2> 989855 T3024 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
[junit4] 2> 989856 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data
[junit4] 2> 989859 T3024 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/control/data\index/
[junit4] 2> 989859 T3024 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index' doesn't exist. Creating new index...
[junit4] 2> 989861 T3024 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index
[junit4] 2> 989861 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@f762ea
[junit4] 2> 989874 T3024 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 989874 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 989878 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 989879 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 989880 T3024 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 989881 T3024 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 989881 T3024 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 989882 T3024 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 989883 T3024 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 989900 T3024 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 989904 T3024 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 989905 T3024 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 989906 T3024 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 989908 T3024 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\control\data\index,segFN=segments_1,generation=1}
[junit4] 2> 989908 T3024 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 989909 T3024 oass.SolrIndexSearcher.<init> Opening Searcher@c1bc06[collection1] main
[junit4] 2> 989913 T3025 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c1bc06[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 989914 T3024 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 989915 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 989915 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 989915 T3028 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55831/_/p collection:control_collection shard:shard1
[junit4] 2> 989918 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 989920 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 989922 T3030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19c52d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 989922 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 989924 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 989936 T2999 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 989942 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 989947 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1726 name=collection1 org.apache.solr.core.SolrCore@78f9a5 url=http://127.0.0.1:55831/_/p/collection1 node=127.0.0.1:55831__%2Fp C1726_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55831/_/p, core=collection1, node_name=127.0.0.1:55831__%2Fp}
[junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55831/_/p/collection1/
[junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 989948 T3028 C1726 P55831 oasc.SyncStrategy.syncToMe http://127.0.0.1:55831/_/p/collection1/ has no replicas
[junit4] 2> 989948 T3028 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55831/_/p/collection1/ shard1
[junit4] 2> 989948 T3028 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 989953 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 989968 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 989975 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989975 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 989986 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 989992 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 990088 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 990089 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 990118 T3028 oasc.ZkController.register We are http://127.0.0.1:55831/_/p/collection1/ and leader is http://127.0.0.1:55831/_/p/collection1/
[junit4] 2> 990118 T3028 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55831/_/p
[junit4] 2> 990118 T3028 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 990118 T3028 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 990118 T3028 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 990123 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 990125 T3028 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 990127 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 990128 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55831/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55831__%2Fp",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 990133 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 990230 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 990230 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 990591 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 990592 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 990597 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55843
[junit4] 2> 990598 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 990598 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241
[junit4] 2> 990598 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\'
[junit4] 2> 990629 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\solr.xml
[junit4] 2> 990703 T2999 oasc.CoreContainer.<init> New CoreContainer 20947143
[junit4] 2> 990703 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\]
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 990705 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 990712 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 990712 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 990712 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 990712 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
[junit4] 2> 990712 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 990716 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 990727 T3041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5471a9 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 990728 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 990731 T3001 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441334c1940005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2>
[junit4] 2> 990733 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 990742 T3043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@141b96e name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 990743 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 990753 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 991653 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55843__%2Fp
[junit4] 2> 991655 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55843__%2Fp
[junit4] 2> 991660 T3021 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 991661 T3030 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 991661 T3043 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 991672 T3044 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 991672 T3044 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 991675 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 991675 T3044 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 991677 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 991678 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55843/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55843__%2Fp",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 991679 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 991683 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 991777 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 991777 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 991777 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 992567 T3044 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 992567 T3044 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1
[junit4] 2> 992567 T3044 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 992568 T3044 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 992569 T3044 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 992571 T3044 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 992572 T3044 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\'
[junit4] 2> 992574 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/classes/' to classloader
[junit4] 2> 992575 T3044 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241/collection1/lib/README' to classloader
[junit4] 2> 992639 T3044 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 992692 T3044 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 992695 T3044 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 992706 T3044 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 993206 T3044 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 993217 T3044 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 993220 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 993226 T3044 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 993276 T3044 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 993276 T3044 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391891631241\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\
[junit4] 2> 993277 T3044 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
[junit4] 2> 993277 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1
[junit4] 2> 993278 T3044 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty1\index/
[junit4] 2> 993280 T3044 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index' doesn't exist. Creating new index...
[junit4] 2> 993281 T3044 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index
[junit4] 2> 993282 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@d8704c
[junit4] 2> 993289 T3044 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 993289 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 993294 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 993296 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 993297 T3044 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 993297 T3044 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 993298 T3044 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 993300 T3044 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 993301 T3044 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 993309 T3044 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 993314 T3044 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 993314 T3044 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 993315 T3044 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 993317 T3044 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty1\index,segFN=segments_1,generation=1}
[junit4] 2> 993317 T3044 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 993317 T3044 oass.SolrIndexSearcher.<init> Opening Searcher@2d83b4[collection1] main
[junit4] 2> 993324 T3045 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d83b4[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 993327 T3044 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 993329 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 993330 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 993329 T3048 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55843/_/p collection:collection1 shard:shard1
[junit4] 2> 993333 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 993356 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993363 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1727 name=collection1 org.apache.solr.core.SolrCore@ddb135 url=http://127.0.0.1:55843/_/p/collection1 node=127.0.0.1:55843__%2Fp C1727_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55843/_/p, core=collection1, node_name=127.0.0.1:55843__%2Fp}
[junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55843/_/p/collection1/
[junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 993366 T3048 C1727 P55843 oasc.SyncStrategy.syncToMe http://127.0.0.1:55843/_/p/collection1/ has no replicas
[junit4] 2> 993366 T3048 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55843/_/p/collection1/ shard1
[junit4] 2> 993366 T3048 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 993370 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 993380 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993383 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993383 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993384 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993396 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 993404 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993510 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993510 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993510 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993543 T3048 oasc.ZkController.register We are http://127.0.0.1:55843/_/p/collection1/ and leader is http://127.0.0.1:55843/_/p/collection1/
[junit4] 2> 993543 T3048 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55843/_/p
[junit4] 2> 993543 T3048 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 993543 T3048 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 993543 T3048 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993547 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993548 T3048 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 993552 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 993554 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55843/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55843__%2Fp",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 993560 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 993664 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993665 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 993665 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 994085 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 994086 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 994091 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55852
[junit4] 2> 994093 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 994093 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635
[junit4] 2> 994096 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\'
[junit4] 2> 994141 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\solr.xml
[junit4] 2> 994212 T2999 oasc.CoreContainer.<init> New CoreContainer 12769958
[junit4] 2> 994212 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\]
[junit4] 2> 994214 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 994215 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 994216 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 994217 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 994218 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 994224 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 994224 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 994224 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 994225 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
[junit4] 2> 994225 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 994229 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 994246 T3059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a0f5d0 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 994253 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 994267 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 994274 T3061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ff2649 name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 994274 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 994286 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 995271 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55852__%2Fp
[junit4] 2> 995273 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55852__%2Fp
[junit4] 2> 995281 T3021 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 995281 T3061 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 995282 T3030 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 995282 T3043 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 995294 T3062 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 995295 T3062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 995296 T3062 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 995296 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 995297 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 995301 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55852/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55852__%2Fp",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 995303 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 995309 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 995311 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 995311 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 995312 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 995311 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 996277 T3062 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 996277 T3062 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1
[junit4] 2> 996277 T3062 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 996280 T3062 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 996280 T3062 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 996282 T3062 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 996282 T3062 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\'
[junit4] 2> 996286 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/classes/' to classloader
[junit4] 2> 996287 T3062 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635/collection1/lib/README' to classloader
[junit4] 2> 996369 T3062 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 996421 T3062 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 996425 T3062 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 996434 T3062 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 996902 T3062 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 996905 T3062 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 996908 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 996915 T3062 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 996960 T3062 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 996961 T3062 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391891634635\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\
[junit4] 2> 996961 T3062 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
[junit4] 2> 996963 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2
[junit4] 2> 996964 T3062 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty2\index/
[junit4] 2> 996966 T3062 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index' doesn't exist. Creating new index...
[junit4] 2> 996966 T3062 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index
[junit4] 2> 996967 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1f092fe
[junit4] 2> 996973 T3062 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 996974 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 996978 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 996979 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 996980 T3062 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 996981 T3062 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 996981 T3062 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 996982 T3062 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 996983 T3062 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 996984 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 996985 T3062 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 996998 T3062 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 997005 T3062 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 997005 T3062 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 997006 T3062 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=27, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 997008 T3062 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty2\index,segFN=segments_1,generation=1}
[junit4] 2> 997008 T3062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 997009 T3062 oass.SolrIndexSearcher.<init> Opening Searcher@1a48267[collection1] main
[junit4] 2> 997013 T3063 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a48267[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 997016 T3062 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 997018 T2999 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
[junit4] 2> 997018 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 997018 T3066 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55852/_/p collection:collection1 shard:shard3
[junit4] 2> 997021 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 997035 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 997042 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997044 T3066 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 997044 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1728 name=collection1 org.apache.solr.core.SolrCore@f130cd url=http://127.0.0.1:55852/_/p/collection1 node=127.0.0.1:55852__%2Fp C1728_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55852/_/p, core=collection1, node_name=127.0.0.1:55852__%2Fp}
[junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55852/_/p/collection1/
[junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 997044 T3066 C1728 P55852 oasc.SyncStrategy.syncToMe http://127.0.0.1:55852/_/p/collection1/ has no replicas
[junit4] 2> 997045 T3066 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55852/_/p/collection1/ shard3
[junit4] 2> 997045 T3066 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 997049 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 997062 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997067 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997069 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997069 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997070 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997083 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 997090 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997217 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997218 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997218 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997219 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997231 T3066 oasc.ZkController.register We are http://127.0.0.1:55852/_/p/collection1/ and leader is http://127.0.0.1:55852/_/p/collection1/
[junit4] 2> 997231 T3066 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55852/_/p
[junit4] 2> 997231 T3066 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 997231 T3066 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 997231 T3066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997234 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997236 T3066 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 997238 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 997239 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:55852/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55852__%2Fp",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 997247 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 997351 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997351 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997352 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997352 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 997656 T2999 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 997656 T2999 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 997663 T2999 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55861
[junit4] 2> 997665 T2999 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 997665 T2999 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324
[junit4] 2> 997665 T2999 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\'
[junit4] 2> 997703 T2999 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\solr.xml
[junit4] 2> 997771 T2999 oasc.CoreContainer.<init> New CoreContainer 16179
[junit4] 2> 997771 T2999 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\]
[junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 997773 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 997775 T2999 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 997776 T2999 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 997780 T2999 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 997780 T2999 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 997780 T2999 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 997780 T2999 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55824/solr
[junit4] 2> 997780 T2999 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 997784 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997797 T3077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3566b7 name:ZooKeeperConnection Watcher:127.0.0.1:55824 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997799 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997807 T2999 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 997810 T3079 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16b8d2d name:ZooKeeperConnection Watcher:127.0.0.1:55824/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 997811 T2999 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 997819 T2999 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 998807 T2999 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55861__%2Fp
[junit4] 2> 998810 T2999 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55861__%2Fp
[junit4] 2> 998816 T3079 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 998816 T3043 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 998817 T3061 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 998817 T3030 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 998817 T3021 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 998834 T3080 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 998834 T3080 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 998837 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 998837 T3080 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 998838 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 998841 T3022 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 998842 T3022 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:55861/_/p",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:55861__%2Fp",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 998843 T3022 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 998850 T3021 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 998852 T3079 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 998853 T3043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 998852 T3030 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 998852 T3061 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 998852 T3021 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 999819 T3080 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 999819 T3080 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1
[junit4] 2> 999819 T3080 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 999820 T3080 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 999821 T3080 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 999822 T3080 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 999823 T3080 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\'
[junit4] 2> 999824 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/classes/' to classloader
[junit4] 2> 999825 T3080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324/collection1/lib/README' to classloader
[junit4] 2> 999892 T3080 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 999944 T3080 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 999950 T3080 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 999960 T3080 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1000424 T3080 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1000427 T3080 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1000429 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1000435 T3080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1000480 T3080 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1000480 T3080 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391891638324\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\
[junit4] 2> 1000481 T3080 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e1d80
[junit4] 2> 1000483 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3
[junit4] 2> 1000483 T3080 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418/jetty3\index/
[junit4] 2> 1000485 T3080 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index' doesn't exist. Creating new index...
[junit4] 2> 1000487 T3080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391891628418\jetty3\index
[junit4] 2> 1000488 T3080 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@44122f
[junit4] 2> 100

[...truncated too long message...]

afeLeaderTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:984)
[junit4] 2> 61) Thread[id=3629, name=HashSessionScavenger-86, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 62) Thread[id=3462, name=qtp2822754-3462 Selector0, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
[junit4] 2> at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
[junit4] 2> at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
[junit4] 2> at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
[junit4] 2> at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] 2> at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] 2> at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 63) Thread[id=3067, name=HashSessionScavenger-62, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> 64) Thread[id=3784, name=searcherExecutor-2028-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:744)
[junit4] 2> 65) Thread[id=3719, name=HashSessionScavenger-90, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] 2> at java.util.TimerThread.run(Timer.java:505)
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=pt_BR, timezone=Africa/Abidjan
[junit4] 2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=131,free=31522104,total=188809216
[junit4] 2> NOTE: All tests run in this JVM: [TestBadConfig, DistributedSuggestComponentTest, BasicDistributedZk2Test, TestArbitraryIndexDir, TestFoldingMultitermQuery, BlockDirectoryTest, HdfsBasicDistributedZk2Test, TestImplicitCoreProperties, TestMergePolicyConfig, TestExtendedDismaxParser, TestSolrDeletionPolicy2, TestSystemIdResolver, TestRangeQuery, TestRTGBase, LeaderElectionIntegrationTest, MoreLikeThisHandlerTest, TestDynamicFieldCollectionResource, StandardRequestHandlerTest, HdfsCollectionsAPIDistributedZkTest, TestDistributedSearch, WordBreakSolrSpellCheckerTest, UpdateRequestProcessorFactoryTest, TestDefaultSimilarityFactory, TestNoOpRegenerator, TestFieldTypeResource, TestStressReorder, RegexBoostProcessorTest, SuggesterWFSTTest, BasicZkTest, NotRequiredUniqueKeyTest, FileBasedSpellCheckerTest, TestStressLucene, SimpleFacetsTest, TestAddFieldRealTimeGet, TestSchemaVersionResource, TermVectorComponentTest, TestQueryUtils, TestElisionMultitermQuery, TestFiltering, SolrCmd
DistributorTest, ScriptEngineTest, FileUtilsTest, LeaderElectionTest, TestFieldTypeCollectionResource, TestFaceting, RequestHandlersTest, CoreAdminHandlerTest, CSVRequestHandlerTest, EnumFieldTest, QueryParsingTest, DocValuesTest, TimeZoneUtilsTest, TestSchemaNameResource, SolrXmlInZkTest, AssignTest, SolrPluginUtilsTest, DocumentBuilderTest, ResourceLoaderTest, TestSolrJ, DirectUpdateHandlerTest, SystemInfoHandlerTest, TestJoin, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest, UpdateParamsTest, SpellingQueryConverterTest, TestOmitPositions, TestRandomMergePolicy, TestSolrDeletionPolicy1, OverseerCollectionProcessorTest, TestMultiCoreConfBootstrap, DistribCursorPagingTest, BasicDistributedZkTest, StressHdfsTest, TestCoreDiscovery, ShardSplitTest, CursorPagingTest, SolrCoreCheckLockOnStartupTest, TestCustomSort, PreAnalyzedFieldTest, ZkSolrClientTest, OverseerTest, TestNRTOpen, ReturnFieldsTest, TestValueSourceCache, TestWriterPerf, HdfsSyncSliceTest, DirectUpdateHandlerOptimiz
eTest, TestFreeTextSuggestions, TestPostingsSolrHighlighter, TestCharFilters, TestCSVResponseWriter, URLClassifyProcessorTest, ChaosMonkeySafeLeaderTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=950075651ABE109E -Dtests.slow=true -Dtests.locale=pt_BR -Dtests.timezone=Africa/Abidjan -Dtests.file.encoding=Cp1252
[junit4] ERROR 0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3605, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4] > Caused by: java.lang.AssertionError: liveDocs.count()=2 info.docCount=4 info.getDelCount()=3
[junit4] > at __randomizedtesting.SeedInfo.seed([950075651ABE109E]:0)
[junit4] > at org.apache.lucene.codecs.lucene40.Lucene40LiveDocsFormat.readLiveDocs(Lucene40LiveDocsFormat.java:92)
[junit4] > at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:103)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:141)
[junit4] > at org.apache.lucene.index.ReadersAndUpdates.getReadOnlyClone(ReadersAndUpdates.java:235)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:100)
[junit4] > at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:382)
[junit4] > at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:275)
[junit4] > at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250)
[junit4] > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1444)
[junit4] > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1632)
[junit4] > at org.apache.solr.handler.SnapPuller.openNewSearcherAndUpdateCommitPoint(SnapPuller.java:670)
[junit4] > at org.apache.solr.handler.SnapPuller.fetchLatestIndex(SnapPuller.java:490)
[junit4] > at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:322)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.replicate(RecoveryStrategy.java:155)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:437)
[junit4] > at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)
[junit4] Completed in 7494.92s, 1 test, 3 errors <<< FAILURES!

[...truncated 790 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 358 suites, 1554 tests, 2 suite-level errors, 1 error, 1121 ignored (2 assumptions)

Total time: 177 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org 

[JENKINS] Lucene-Solr-4.x-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3688 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3688/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([3FA28437ACE700D8]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([3FA28437ACE700D8]:0)




Build Log:
[...truncated 10617 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 1541164 T6971 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1541170 T6971 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1391995708872
   [junit4]   2> 1541173 T6971 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1541174 T6972 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1541272 T6971 oasc.ZkTestServer.run start zk server on port:55900
   [junit4]   2> 1541275 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1541288 T6978 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74cf4d5a name:ZooKeeperConnection Watcher:127.0.0.1:55900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1541289 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1541290 T6971 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1541300 T6973 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441968e5d50000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1541303 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1541310 T6980 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@473a0aa6 name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1541311 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1541311 T6971 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1541321 T6971 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1541330 T6971 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1541337 T6971 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1541344 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1541344 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1541360 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1541360 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1541372 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1541374 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1541383 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1541383 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1541394 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1541394 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1541405 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1541405 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1541415 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1541415 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1541426 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1541426 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1541436 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1541436 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1541447 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1541448 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1541457 T6971 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1541457 T6971 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1541471 T6973 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441968e5d50001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1541992 T6971 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1541999 T6971 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 1541999 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1541999 T6971 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1541999 T6971 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171
   [junit4]   2> 1541999 T6971 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\'
   [junit4]   2> 1542023 T6971 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\solr.xml
   [junit4]   2> 1542075 T6971 oasc.CoreContainer.<init> New CoreContainer 1269295964
   [junit4]   2> 1542075 T6971 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\]
   [junit4]   2> 1542076 T6971 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1542077 T6971 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1542082 T6971 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1542084 T6971 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1542084 T6971 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1542084 T6971 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55900/solr
   [junit4]   2> 1542084 T6971 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1542087 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1542112 T6991 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d4d0bd1 name:ZooKeeperConnection Watcher:127.0.0.1:55900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1542113 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1542121 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1542127 T6993 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24e10bee name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1542128 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1542132 T6971 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1542144 T6971 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1542152 T6971 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1542157 T6971 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55907_
   [junit4]   2> 1542160 T6971 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55907_
   [junit4]   2> 1542170 T6971 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1542177 T6971 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1542191 T6971 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55907_
   [junit4]   2> 1542191 T6971 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1542200 T6971 oasc.Overseer.start Overseer (id=91225830777487363-127.0.0.1:55907_-n_0000000000) starting
   [junit4]   2> 1542210 T6971 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1542226 T6995 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1542228 T6971 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1542228 T6995 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1542236 T6971 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1542242 T6971 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1542252 T6994 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1542261 T6996 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1542262 T6996 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1542266 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1542266 T6996 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1542271 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1542272 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55907",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55907_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1542272 T6994 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1542272 T6994 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1542281 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1542283 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1543247 T6996 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1543247 T6996 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\collection1
   [junit4]   2> 1543247 T6996 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1543250 T6996 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1543250 T6996 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1543254 T6996 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1543254 T6996 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\collection1\'
   [junit4]   2> 1543254 T6996 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171/collection1/lib/classes/' to classloader
   [junit4]   2> 1543257 T6996 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171/collection1/lib/README' to classloader
   [junit4]   2> 1543314 T6996 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1543356 T6996 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1543358 T6996 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1543367 T6996 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1543742 T6996 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1543745 T6996 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1543746 T6996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1543781 T6996 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1543813 T6996 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1543813 T6996 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391995709171\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/control/data\
   [junit4]   2> 1543813 T6996 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66769463
   [junit4]   2> 1543814 T6996 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\control\data
   [junit4]   2> 1543814 T6996 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/control/data\index/
   [junit4]   2> 1543815 T6996 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1543815 T6996 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\control\data\index
   [junit4]   2> 1543817 T6996 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=10.8828125, floorSegmentMB=1.5322265625, forceMergeDeletesPctAllowed=19.665459570556823, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3490198922739449
   [junit4]   2> 1543822 T6996 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1543822 T6996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1543824 T6996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1543826 T6996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1543826 T6996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1543826 T6996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1543826 T6996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1543827 T6996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1543827 T6996 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1543827 T6996 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1543827 T6996 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1543828 T6996 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1543828 T6996 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1543828 T6996 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1543828 T6996 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1543830 T6996 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1543830 T6996 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1543830 T6996 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1543838 T6996 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1543843 T6996 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1543843 T6996 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1543844 T6996 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6603532828373068]
   [junit4]   2> 1543845 T6996 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1543845 T6996 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1543845 T6996 oass.SolrIndexSearcher.<init> Opening Searcher@7869a8c2[collection1] main
   [junit4]   2> 1543850 T6996 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1543850 T6997 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7869a8c2[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1543851 T6971 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1543851 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1543854 T7000 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55907 collection:control_collection shard:shard1
   [junit4]   2> 1543855 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1543857 T7000 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1543864 T7002 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bc91780 name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1543865 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1543867 T6971 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1543872 T7000 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1543875 T6971 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1543947 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544056 T7000 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1544056 T7000 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1245 name=collection1 org.apache.solr.core.SolrCore@6fc1d5be url=http://127.0.0.1:55907/collection1 node=127.0.0.1:55907_ C1245_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:55907, core=collection1, node_name=127.0.0.1:55907_}
   [junit4]   2> 1544056 T7000 C1245 P55907 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55907/collection1/
   [junit4]   2> 1544056 T7000 C1245 P55907 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1544056 T7000 C1245 P55907 oasc.SyncStrategy.syncToMe http://127.0.0.1:55907/collection1/ has no replicas
   [junit4]   2> 1544056 T7000 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55907/collection1/ shard1
   [junit4]   2> 1544056 T7000 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1544189 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1544255 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544258 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544258 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544268 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1544272 T6971 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1544274 T6971 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1544274 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544278 T6971 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 1544278 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1544279 T6971 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1544279 T6971 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575
   [junit4]   2> 1544279 T6971 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\'
   [junit4]   2> 1544304 T6971 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\solr.xml
   [junit4]   2> 1544359 T6971 oasc.CoreContainer.<init> New CoreContainer 776249500
   [junit4]   2> 1544359 T6971 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\]
   [junit4]   2> 1544361 T6971 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1544361 T6971 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1544361 T6971 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1544361 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1544362 T6971 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1544362 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1544362 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1544364 T6971 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1544364 T6971 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1544369 T6971 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1544369 T6971 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1544369 T6971 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1544370 T6971 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55900/solr
   [junit4]   2> 1544370 T6971 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1544372 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1544377 T7013 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b8c797f name:ZooKeeperConnection Watcher:127.0.0.1:55900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1544377 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1544378 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544379 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544383 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1544386 T7015 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1055d5b9 name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1544387 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1544395 T6971 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1544424 T7000 oasc.ZkController.register We are http://127.0.0.1:55907/collection1/ and leader is http://127.0.0.1:55907/collection1/
   [junit4]   2> 1544424 T7000 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55907
   [junit4]   2> 1544424 T7000 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1544424 T7000 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1544425 T7000 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1544427 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544427 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544427 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544428 T7000 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1544429 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1544431 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55907",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55907_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1544441 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1544554 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544555 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1544555 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1545480 T6971 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55919_
   [junit4]   2> 1545483 T6971 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55919_
   [junit4]   2> 1545492 T7015 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1545493 T6993 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1545493 T7002 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1545513 T7016 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1545514 T7016 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1545520 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1545520 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1545520 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1545522 T7016 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1545526 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1545527 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55919",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55919_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1545527 T6994 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1545527 T6994 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1545536 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1545651 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1545652 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1545652 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1546600 T7016 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1546600 T7016 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\collection1
   [junit4]   2> 1546601 T7016 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1546604 T7016 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1546604 T7016 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1546608 T7016 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1546609 T7016 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\collection1\'
   [junit4]   2> 1546614 T7016 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575/collection1/lib/classes/' to classloader
   [junit4]   2> 1546615 T7016 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575/collection1/lib/README' to classloader
   [junit4]   2> 1546678 T7016 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1546725 T7016 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1546728 T7016 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1546738 T7016 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1547177 T7016 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1547180 T7016 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1547182 T7016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1547189 T7016 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1547229 T7016 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1547229 T7016 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391995711575\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty1\
   [junit4]   2> 1547230 T7016 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66769463
   [junit4]   2> 1547231 T7016 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty1
   [junit4]   2> 1547232 T7016 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty1\index/
   [junit4]   2> 1547233 T7016 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1547233 T7016 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty1\index
   [junit4]   2> 1547233 T7016 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=10.8828125, floorSegmentMB=1.5322265625, forceMergeDeletesPctAllowed=19.665459570556823, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3490198922739449
   [junit4]   2> 1547239 T7016 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1547240 T7016 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1547242 T7016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1547243 T7016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1547243 T7016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1547243 T7016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1547244 T7016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1547244 T7016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1547244 T7016 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1547245 T7016 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1547245 T7016 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1547245 T7016 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1547246 T7016 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1547246 T7016 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1547246 T7016 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1547247 T7016 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1547248 T7016 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1547248 T7016 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1547257 T7016 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1547261 T7016 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1547261 T7016 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1547262 T7016 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6603532828373068]
   [junit4]   2> 1547263 T7016 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1547264 T7016 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1547264 T7016 oass.SolrIndexSearcher.<init> Opening Searcher@286bac3a[collection1] main
   [junit4]   2> 1547269 T7017 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@286bac3a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1547271 T7016 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1547272 T6971 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1547273 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1547272 T7020 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55919 collection:collection1 shard:shard2
   [junit4]   2> 1547276 T7020 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1547289 T7020 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1547293 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547293 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547293 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547295 T7020 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1547295 T7020 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1246 name=collection1 org.apache.solr.core.SolrCore@7d02f368 url=http://127.0.0.1:55919/collection1 node=127.0.0.1:55919_ C1246_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55919, core=collection1, node_name=127.0.0.1:55919_}
   [junit4]   2> 1547295 T7020 C1246 P55919 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55919/collection1/
   [junit4]   2> 1547295 T7020 C1246 P55919 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1547295 T7020 C1246 P55919 oasc.SyncStrategy.syncToMe http://127.0.0.1:55919/collection1/ has no replicas
   [junit4]   2> 1547295 T7020 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55919/collection1/ shard2
   [junit4]   2> 1547295 T7020 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1547300 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1547309 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547311 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547312 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547313 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547322 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1547328 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547441 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547442 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547442 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547481 T7020 oasc.ZkController.register We are http://127.0.0.1:55919/collection1/ and leader is http://127.0.0.1:55919/collection1/
   [junit4]   2> 1547481 T7020 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55919
   [junit4]   2> 1547481 T7020 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1547481 T7020 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1547481 T7020 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1547483 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547483 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547483 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547486 T7020 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1547487 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1547488 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55919",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55919_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1547495 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1547607 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547608 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547608 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1547822 T6971 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1547823 T6971 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1547826 T6971 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 1547827 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1547827 T6971 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1547828 T6971 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973
   [junit4]   2> 1547828 T6971 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\'
   [junit4]   2> 1547857 T6971 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\solr.xml
   [junit4]   2> 1547918 T6971 oasc.CoreContainer.<init> New CoreContainer 1631899921
   [junit4]   2> 1547918 T6971 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\]
   [junit4]   2> 1547919 T6971 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1547920 T6971 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1547920 T6971 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1547920 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1547921 T6971 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1547921 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1547921 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1547922 T6971 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1547922 T6971 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1547927 T6971 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1547927 T6971 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1547927 T6971 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1547927 T6971 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55900/solr
   [junit4]   2> 1547927 T6971 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1547934 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1547940 T7031 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cf9e4fa name:ZooKeeperConnection Watcher:127.0.0.1:55900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1547941 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1547944 T6973 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441968e5d50007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1547945 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1547948 T7033 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@29adf7a name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1547949 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1547957 T6971 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1549039 T6971 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55928_
   [junit4]   2> 1549044 T6971 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55928_
   [junit4]   2> 1549055 T7015 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1549056 T6993 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1549057 T7002 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1549057 T7033 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1549081 T7034 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1549081 T7034 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1549086 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1549086 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1549086 T7034 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1549086 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1549092 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1549094 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55928",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55928_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1549094 T6994 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1549094 T6994 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1549104 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1549109 T7033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1549109 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1549110 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1549110 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550166 T7034 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1550166 T7034 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\collection1
   [junit4]   2> 1550166 T7034 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1550169 T7034 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1550169 T7034 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1550172 T7034 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1550172 T7034 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\collection1\'
   [junit4]   2> 1550172 T7034 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973/collection1/lib/classes/' to classloader
   [junit4]   2> 1550176 T7034 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973/collection1/lib/README' to classloader
   [junit4]   2> 1550271 T7034 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1550319 T7034 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1550322 T7034 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1550333 T7034 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1550725 T7034 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1550729 T7034 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1550731 T7034 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1550739 T7034 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1550773 T7034 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1550773 T7034 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391995714973\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty2\
   [junit4]   2> 1550773 T7034 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66769463
   [junit4]   2> 1550773 T7034 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty2
   [junit4]   2> 1550776 T7034 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty2\index/
   [junit4]   2> 1550776 T7034 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1550776 T7034 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty2\index
   [junit4]   2> 1550778 T7034 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=10.8828125, floorSegmentMB=1.5322265625, forceMergeDeletesPctAllowed=19.665459570556823, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3490198922739449
   [junit4]   2> 1550785 T7034 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1550785 T7034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1550788 T7034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1550788 T7034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1550788 T7034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1550788 T7034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1550789 T7034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1550789 T7034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1550790 T7034 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1550790 T7034 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1550790 T7034 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1550791 T7034 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1550791 T7034 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1550791 T7034 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1550791 T7034 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1550793 T7034 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1550793 T7034 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1550794 T7034 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1550802 T7034 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1550807 T7034 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1550807 T7034 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1550808 T7034 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6603532828373068]
   [junit4]   2> 1550808 T7034 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1550808 T7034 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1550808 T7034 oass.SolrIndexSearcher.<init> Opening Searcher@37719226[collection1] main
   [junit4]   2> 1550813 T7035 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@37719226[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1550815 T7034 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1550816 T6971 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1550817 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1550817 T7038 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:55928 collection:collection1 shard:shard3
   [junit4]   2> 1550819 T7038 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1550832 T7038 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 1550836 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1550838 T7038 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1550838 T7038 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1247 name=collection1 org.apache.solr.core.SolrCore@3b456558 url=http://127.0.0.1:55928/collection1 node=127.0.0.1:55928_ C1247_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:55928, core=collection1, node_name=127.0.0.1:55928_}
   [junit4]   2> 1550838 T7038 C1247 P55928 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:55928/collection1/
   [junit4]   2> 1550838 T7038 C1247 P55928 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1550838 T7038 C1247 P55928 oasc.SyncStrategy.syncToMe http://127.0.0.1:55928/collection1/ has no replicas
   [junit4]   2> 1550838 T7038 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:55928/collection1/ shard3
   [junit4]   2> 1550838 T7038 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 1550842 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1550852 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1550855 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550856 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550856 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550857 T7033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550869 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1550875 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1550988 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550988 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550988 T7033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1550989 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1551029 T7038 oasc.ZkController.register We are http://127.0.0.1:55928/collection1/ and leader is http://127.0.0.1:55928/collection1/
   [junit4]   2> 1551029 T7038 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:55928
   [junit4]   2> 1551029 T7038 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1551029 T7038 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1551029 T7038 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1551032 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1551032 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1551032 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1551034 T7038 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1551036 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1551037 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55928",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55928_",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1551044 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1551156 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1551156 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1551156 T7033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1551157 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1551343 T6971 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1551344 T6971 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1551347 T6971 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 1551348 T6971 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1551348 T6971 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1551348 T6971 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517
   [junit4]   2> 1551349 T6971 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\'
   [junit4]   2> 1551377 T6971 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\solr.xml
   [junit4]   2> 1551437 T6971 oasc.CoreContainer.<init> New CoreContainer 1813934643
   [junit4]   2> 1551438 T6971 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\]
   [junit4]   2> 1551439 T6971 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1551439 T6971 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1551439 T6971 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1551440 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1551440 T6971 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1551440 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1551442 T6971 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1551442 T6971 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1551442 T6971 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1551446 T6971 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1551447 T6971 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1551447 T6971 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1551447 T6971 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55900/solr
   [junit4]   2> 1551448 T6971 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1551450 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1551456 T7049 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@42dba9b9 name:ZooKeeperConnection Watcher:127.0.0.1:55900 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1551457 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1551460 T6973 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441968e5d50009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1551462 T6971 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1551466 T7051 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34ca1ecc name:ZooKeeperConnection Watcher:127.0.0.1:55900/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1551466 T6971 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1551474 T6971 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1552557 T6971 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55937_
   [junit4]   2> 1552561 T6971 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55937_
   [junit4]   2> 1552571 T7015 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1552573 T7051 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1552573 T6993 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1552574 T7002 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1552574 T7033 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1552599 T7052 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1552600 T7052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1552603 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1552604 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1552604 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1552604 T7052 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1552609 T6994 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1552611 T6994 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55937",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55937_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1552611 T6994 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1552611 T6994 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1552622 T6993 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1552736 T6993 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1552738 T7002 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1552739 T7033 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1552738 T7051 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1552738 T7015 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1553683 T7052 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1553683 T7052 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\collection1
   [junit4]   2> 1553684 T7052 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1553686 T7052 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1553686 T7052 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1553690 T7052 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1553691 T7052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\collection1\'
   [junit4]   2> 1553696 T7052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517/collection1/lib/classes/' to classloader
   [junit4]   2> 1553698 T7052 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517/collection1/lib/README' to classloader
   [junit4]   2> 1553757 T7052 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1553801 T7052 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1553804 T7052 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1553812 T7052 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1554223 T7052 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1554227 T7052 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1554229 T7052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1554237 T7052 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1554273 T7052 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1554274 T7052 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391995718517\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty3\
   [junit4]   2> 1554274 T7052 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@66769463
   [junit4]   2> 1554274 T7052 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty3
   [junit4]   2> 1554274 T7052 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870/jetty3\index/
   [junit4]   2> 1554274 T7052 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty3\index' doesn't exist. Creating new index...
   [junit4]   2> 1554274 T7052 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391995708870\jetty3\index
   [junit4]   2> 1554278 T7052 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, 

[...truncated too long message...]


   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	  71) Thread[id=7363, name=qtp225337879-7363 Selector0, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Thread.setPriority0(Native Method)
   [junit4]   2> 	        at java.lang.Thread.setPriority(Thread.java:1130)
   [junit4]   2> 	        at java.lang.Thread.init(Thread.java:413)
   [junit4]   2> 	        at java.lang.Thread.init(Thread.java:349)
   [junit4]   2> 	        at java.lang.Thread.<init>(Thread.java:460)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.newThread(QueuedThreadPool.java:455)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.startThread(QueuedThreadPool.java:435)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.dispatch(QueuedThreadPool.java:366)
   [junit4]   2> 	        at org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager.dispatch(SelectChannelConnector.java:300)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:708)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 	  72) Thread[id=7032, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[3FA28437ACE700D8]-SendThread(127.0.0.1:55900), state=BLOCKED, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:338)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
   [junit4]   2> 	  73) Thread[id=7174, name=coreZkRegister-4540-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=hi_IN, timezone=America/Guyana
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=196,free=378585768,total=533725184
   [junit4]   2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, ConvertedLegacyTest, CoreAdminCreateDiscoverTest, ZkSolrClientTest, QueryElevationComponentTest, TestStressLucene, NoCacheHeaderTest, TestInitQParser, TestRecoveryHdfs, TestRandomDVFaceting, TestStressUserVersions, SearchHandlerTest, RequestHandlersTest, TestSweetSpotSimilarityFactory, DocValuesMissingTest, TestHighFrequencyDictionaryFactory, TestSolrCoreProperties, PreAnalyzedUpdateProcessorTest, BadIndexSchemaTest, ZkCLITest, SampleTest, DistributedDebugComponentTest, TestAtomicUpdateErrorCases, TestSolr4Spatial, StandardRequestHandlerTest, JsonLoaderTest, DateFieldTest, TestSolrDeletionPolicy1, TestFiltering, PreAnalyzedFieldTest, MinimalSchemaTest, TestFastLRUCache, ShardRoutingTest, TestLMDirichletSimilarityFactory, SpellCheckCollatorTest, ShardRoutingCustomTest, FieldAnalysisRequestHandlerTest, TestOverriddenPrefixQueryForCustomFieldType, TestMultiCoreConfBootstrap, DistributedQueryElevationComponentTest, TestCursorMarkWithoutUniqueKey, TestClassNameShortening, JSONWriterTest, TestCloudManagedSchemaAddField, CurrencyFieldXmlFileTest, HdfsBasicDistributedZk2Test, TestOmitPositions, CircularListTest, TestReplicationHandler, TestSolrDeletionPolicy2, TestCodecSupport, UpdateParamsTest, PingRequestHandlerTest, OverseerRolesTest, SolrCoreCheckLockOnStartupTest, TestSolrXmlPersistence, ResponseLogComponentTest, SpellCheckComponentTest, TestSimpleQParserPlugin, DistanceFunctionTest, DirectUpdateHandlerOptimizeTest, TermVectorComponentTest, TestManagedSchema, TestBlendedInfixSuggestions, HdfsSyncSliceTest, SolrIndexConfigTest, TestDocBasedVersionConstraints, TestFieldCollectionResource, SolrXmlInZkTest, TestFieldTypeResource, SynonymTokenizerTest, TestAnalyzedSuggestions, TestDefaultSearchFieldResource, ClusterStateUpdateTest, TestBM25SimilarityFactory, TestCollapseQParserPlugin, RemoteQueryErrorTest, TestAnalyzeInfixSuggestions, TestUtils, TestNonNRTOpen, DocValuesTest, PeerSyncTest, TestReversedWildcardFilterFactory, TestDocSet, TestSerializedLuceneMatchVersion, SystemInfoHandlerTest, TestSurroundQueryParser, PrimUtilsTest, TestFastWriter, CacheHeaderTest, HighlighterConfigTest, TestRangeQuery, OpenCloseCoreStressTest, TestDynamicFieldResource, SolrInfoMBeanTest, LegacyHTMLStripCharFilterTest, TestUpdate, TestDistribDocBasedVersion, StatsComponentTest, TestStandardQParsers, TestCustomSort, TestDocumentBuilder, SolrPluginUtilsTest, SolrTestCaseJ4Test, TestSchemaNameResource, SortByFunctionTest, TestUniqueKeyFieldResource, TestDistributedGrouping, OpenExchangeRatesOrgProviderTest, TestIndexingPerformance, TestWriterPerf, AlternateDirectoryTest, HdfsLockFactoryTest, CollectionsAPIDistributedZkTest, DistributedSuggestComponentTest, TestElisionMultitermQuery, TestQueryUtils, TestLRUCache, TestSuggestSpellingConverter, TestPhraseSuggestions, TestQuerySenderNoQuery, TestCopyFieldCollectionResource, MBeansHandlerTest, NotRequiredUniqueKeyTest, LeaderElectionTest, TestStressReorder, FileBasedSpellCheckerTest, SpellingQueryConverterTest, TestSolrJ, UniqFieldsUpdateProcessorFactoryTest, TestQuerySenderListener, TestPostingsSolrHighlighter, HdfsUnloadDistributedZkTest, TestRandomFaceting, TestCharFilters, TestReloadAndDeleteDocs, ConnectionManagerTest, ShowFileRequestHandlerTest, TermVectorComponentDistributedTest, CursorMarkTest, HdfsCollectionsAPIDistributedZkTest, SimpleFacetsTest, EchoParamsTest, SuggesterTSTTest, TestValueSourceCache, FullSolrCloudDistribCmdsTest, SyncSliceTest, TestLFUCache, StatelessScriptUpdateProcessorFactoryTest, UpdateRequestProcessorFactoryTest, DocumentBuilderTest, RecoveryZkTest, TestFieldTypeCollectionResource, ChaosMonkeyNothingIsSafeTest, IndexSchemaTest, ChangedSchemaMergeTest, QueryEqualityTest, TriLevelCompositeIdRoutingTest, SuggesterTest, HardAutoCommitTest, AddSchemaFieldsUpdateProcessorFactoryTest, BadCopyFieldTest, TermsComponentTest, DistributedSpellCheckComponentTest, SuggesterFSTTest, BadComponentTest, DocValuesMultiTest, SchemaVersionSpecificBehaviorTest, OverseerTest, TestPerFieldSimilarity, TestJoin, URLClassifyProcessorTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=3FA28437ACE700D8 -Dtests.slow=true -Dtests.locale=hi_IN -Dtests.timezone=America/Guyana -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3FA28437ACE700D8]:0)
   [junit4] Completed in 7581.79s, 1 test, 2 errors <<< FAILURES!

[...truncated 544 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 360 suites, 1558 tests, 1 suite-level error, 1 error, 742 ignored (7 assumptions)

Total time: 187 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3687 - Still Failing!

Posted by Areek Zillur <ar...@gmail.com>.
I committed a fix for this. Apparently the Windows tests fails to cleanup
the suggester index created by some tests. I have made the suggester index
cleanup 'best-effort'.


On Sun, Feb 9, 2014 at 1:32 PM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3687/
> Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC
>
> 2 tests failed.
> FAILED:
>  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
>         at org.junit.Assert.fail(Assert.java:92)
>         at org.junit.Assert.assertTrue(Assert.java:43)
>         at org.junit.Assert.assertTrue(Assert.java:54)
>         at
> org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:744)
>
>
> FAILED:
>  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions
>
> Error Message:
>
>
> Stack Trace:
> java.lang.AssertionError
>         at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
>         at org.junit.Assert.fail(Assert.java:92)
>         at org.junit.Assert.assertTrue(Assert.java:43)
>         at org.junit.Assert.assertTrue(Assert.java:54)
>         at
> org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:606)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
>         at java.lang.Thread.run(Thread.java:744)
>
>
>
>
> Build Log:
> [...truncated 10158 lines...]
>    [junit4] Suite:
> org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions
>    [junit4]   2> 929169 T3244 oas.SolrTestCaseJ4.initCore ####initCore
>    [junit4]   2> Creating dataDir:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670
>    [junit4]   2> 929173 T3244 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
>    [junit4]   2> 929173 T3244 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 929176 T3244 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 929258 T3244 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 929320 T3244 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 929320 T3244 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 929328 T3244 oass.IndexSchema.readSchema [null] Schema
> name=test
>    [junit4]   2> 929358 T3244 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 929360 T3244 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
>    [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
>    [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
>    [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for deduced Solr Home:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
>    [junit4]   2> 929439 T3244 oasc.CoreContainer.<init> New CoreContainer
> 75558
>    [junit4]   2> 929440 T3244 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
>    [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 0
>    [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
>    [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 0
>    [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 929443 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 929443 T3244 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 929448 T3244 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 929448 T3244 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 929449 T3244 oasc.CoreContainer.load Host Name:
>    [junit4]   2> 929455 T3245 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
>    [junit4]   2> 929456 T3245 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
>    [junit4]   2> 929457 T3245 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 929457 T3245 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 929515 T3245 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 929577 T3245 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 929577 T3245 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 929586 T3245 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 929615 T3245 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 929617 T3245 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 929619 T3245 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 929620 T3245 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\,
> dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
>    [junit4]   2> 929620 T3245 oasc.SolrCore.<init> JMX monitoring not
> detected for core: collection1
>    [junit4]   2> 929620 T3245 oasc.CachingDirectoryFactory.get return new
> directory for
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
>    [junit4]   2> 929620 T3245 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index/
>    [junit4]   2> 929620 T3245 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index'
> doesn't exist. Creating new index...
>    [junit4]   2> 929621 T3245 oasc.CachingDirectoryFactory.get return new
> directory for
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index
>    [junit4]   2> 929622 T3245 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy:
> [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=40,
> maxMergedSegmentMB=30.7021484375, floorSegmentMB=1.5078125,
> forceMergeDeletesPctAllowed=9.911627139999567, segmentsPerTier=15.0,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8244566905680515
>    [junit4]   2> 929622 T3245 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@74318dlockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b90556
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 929622 T3245 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 929624 T3245 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 929624 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /infix_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_file_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /blended_infix_suggest:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_high_freq_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_max_edit_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 929631 T3245 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 929631 T3245 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 929631 T3245 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 929631 T3245 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@74318dlockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b90556
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 929631 T3245 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 929632 T3245 oass.SolrIndexSearcher.<init> Opening
> Searcher@efdc0[collection1] main
>    [junit4]   2> 929632 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929632 T3245 oasss.Suggester.init init:
> {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
>    [junit4]   2> 929634 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929634 T3245 oasss.Suggester.init init:
> {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
>    [junit4]   2> 929636 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929636 T3245 oasss.Suggester.init init:
> {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
>    [junit4]   2> 929637 T3245 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 929638 T3245 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 929640 T3245 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 929640 T3245 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 929640 T3245 oasss.SolrSuggester.init init:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 929642 T3245 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 929642 T3245 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 929642 T3245 oasss.SolrSuggester.init init:
> {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
>    [junit4]   2> 929643 T3245 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
>    [junit4]   2> 929643 T3245 oasss.SolrSuggester.init init:
> {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
>    [junit4]   2> 929644 T3245 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
>    [junit4]   2> 929644 T3245 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 929644 T3245 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929646 T3245 oasss.SolrSuggester.init WARN Loading stored
> lookup data failed, possibly not cached yet
>    [junit4]   2> 929646 T3245 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929646 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929646 T3245 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929647 T3245 oasss.Suggester.init WARN Loading stored
> lookup data failed java.io.FileNotFoundException:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\fuzzy_suggest_analyzing\fwfsta.bin
> (The system cannot find the file specified)
>    [junit4]   2>        at java.io.FileInputStream.open(Native Method)
>    [junit4]   2>        at
> java.io.FileInputStream.<init>(FileInputStream.java:146)
>    [junit4]   2>        at
> org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
>    [junit4]   2>        at
> org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
>    [junit4]   2>        at
> org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
>    [junit4]   2>        at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    [junit4]   2>        at java.lang.Thread.run(Thread.java:744)
>    [junit4]   2>
>    [junit4]   2> 929647 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929648 T3245 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929649 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929650 T3245 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929651 T3245 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 929651 T3245 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 929653 T3245 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 929653 T3246 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@efdc0[collection1]
> main{StandardDirectoryReader(segments_1:1:nrt)}
>    [junit4]   2> 929660 T3244 oas.SolrTestCaseJ4.initCore ####initCore end
>    [junit4]   2> ASYNC  NEW_CORE C3164 name=collection1
> org.apache.solr.core.SolrCore@14b34bb
>    [junit4]   2> 929662 T3244 C3164 oashc.SuggestComponent.prepare
> SuggestComponent prepare with :
> {params(q=&suggest.buildAll=true&qt=/blended_infix_suggest),defaults(suggest=true)}
>    [junit4]   2> 929662 T3244 C3164 oasss.SolrSuggester.build build()
>    [junit4]   2> 929837 T3244 C3164 oasss.SolrSuggester.build build()
>    [junit4]   2> 929914 T3244 C3164 oashc.SuggestComponent.process
> SuggestComponent process with :
> {params(q=&suggest.buildAll=true&qt=/blended_infix_suggest),defaults(suggest=true)}
>    [junit4]   2> 929915 T3244 C3164 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=&suggest.buildAll=true&qt=/blended_infix_suggest} status=0
> QTime=253
>    [junit4]   2> 929919 T3244 oas.SolrTestCaseJ4.setUp ###Starting
> testReciprocalBlenderType
>    [junit4]   2> 929919 T3244 C3164 oashc.SuggestComponent.prepare
> SuggestComponent prepare with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929919 T3244 C3164 oashc.SuggestComponent.process
> SuggestComponent process with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929926 T3244 C3164 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10}
> status=0 QTime=7
>    [junit4]   2> 929950 T3244 oas.SolrTestCaseJ4.tearDown ###Ending
> testReciprocalBlenderType
>    [junit4]   2> 929955 T3244 oas.SolrTestCaseJ4.setUp ###Starting
> testMultiSuggester
>    [junit4]   2> 929955 T3244 C3164 oashc.SuggestComponent.prepare
> SuggestComponent prepare with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929956 T3244 C3164 oashc.SuggestComponent.process
> SuggestComponent process with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929957 T3244 C3164 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10}
> status=0 QTime=2
>    [junit4]   2> 929976 T3244 oas.SolrTestCaseJ4.tearDown ###Ending
> testMultiSuggester
>    [junit4]   2> 929980 T3244 oas.SolrTestCaseJ4.setUp ###Starting
> testLinearBlenderType
>    [junit4]   2> 929981 T3244 C3164 oashc.SuggestComponent.prepare
> SuggestComponent prepare with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929981 T3244 C3164 oashc.SuggestComponent.process
> SuggestComponent process with :
> {params(q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
>    [junit4]   2> 929982 T3244 C3164 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10}
> status=0 QTime=1
>    [junit4]   2> 929991 T3244 oas.SolrTestCaseJ4.tearDown ###Ending
> testLinearBlenderType
>    [junit4]   2> !!!! WARNING: best effort to remove
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\blendedInfixSuggesterIndexDir\_0.fdt
> FAILED !!!!!
>    [junit4]   2> 929996 T3244 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> 929997 T3244 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=75558
>    [junit4]   2> 929997 T3244 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@14b34bb
>    [junit4]   2> 929997 T3244 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
>    [junit4]   2> 929997 T3244 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
>    [junit4]   2> 929997 T3244 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
>    [junit4]   2> 929997 T3244 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
>    [junit4]   2> 930000 T3244 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
>    [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index
> [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index;done=false>>]
>    [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing
> directory:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index
>    [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
> [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\;done=false>>]
>    [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing
> directory:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
>    [junit4]   2> NOTE: test params are: codec=Asserting,
> sim=DefaultSimilarity, locale=sk, timezone=America/Edmonton
>    [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea
> (32-bit)/cpus=2,threads=1,free=172234112,total=286580736
>    [junit4]   2> NOTE: All tests run in this JVM:
> [PreAnalyzedUpdateProcessorTest, SchemaVersionSpecificBehaviorTest,
> OutputWriterTest, ParsingFieldUpdateProcessorsTest, TestUpdate,
> TestDefaultSimilarityFactory, TestClassNameShortening,
> TestInfoStreamLogging, SignatureUpdateProcessorFactoryTest,
> ChaosMonkeyNothingIsSafeTest, DocumentBuilderTest, SyncSliceTest,
> TestSolrXmlPersistence, TestSolrJ, ChaosMonkeySafeLeaderTest,
> TestFieldTypeResource, SolrPluginUtilsTest, AssignTest, EnumFieldTest,
> TestCodecSupport, TestCollationKeyRangeQueries, TestStressLucene,
> TermVectorComponentDistributedTest, TestReload, TestBadConfig,
> OpenCloseCoreStressTest, TestSchemaVersionResource, TestDocSet,
> PeerSyncTest, TestJoin, TestOverriddenPrefixQueryForCustomFieldType,
> SolrInfoMBeanTest, TestReloadAndDeleteDocs, PluginInfoTest,
> BadCopyFieldTest, TestStressVersions, TestAddFieldRealTimeGet,
> SolrCoreCheckLockOnStartupTest, TestDistributedSearch,
> TestSimpleQParserPlugin, AddSchemaFieldsUpdateProcessorFactoryTest,
> TestFileDictionaryLookup, TestMaxScoreQueryParser, TermsComponentTest,
> TestSolrIndexConfig, CachingDirectoryFactoryTest, TestBinaryResponseWriter,
> MBeansHandlerTest, TestPerFieldSimilarity, RecoveryZkTest,
> CoreAdminHandlerTest, NoCacheHeaderTest, DOMUtilTest, SampleTest,
> TestDynamicFieldCollectionResource, CollectionsAPIDistributedZkTest,
> ZkControllerTest, SOLR749Test, TestSolr4Spatial, InfoHandlerTest,
> TestIndexSearcher, SolrIndexSplitterTest, TestLFUCache, SolrCoreTest,
> DistribCursorPagingTest, TestBlendedInfixSuggestions]
>    [junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=TestBlendedInfixSuggestions -Dtests.seed=F4223265901D0F6F
> -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=America/Edmonton
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   0.00s | TestBlendedInfixSuggestions (suite) <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
>    [junit4]    >        at
> org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)
>    [junit4] Completed in 0.88s, 3 tests, 1 failure <<< FAILURES!
>
> [...truncated 234 lines...]
>    [junit4] Suite:
> org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
>    [junit4]   2> 1542406 T5504 oas.SolrTestCaseJ4.initCore ####initCore
>    [junit4]   2> Creating dataDir:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904
>    [junit4]   2> 1542410 T5504 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
>    [junit4]   2> 1542414 T5504 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 1542421 T5504 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 1542635 T5504 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 1542740 T5504 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 1542741 T5504 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 1542755 T5504 oass.IndexSchema.readSchema [null] Schema
> name=test
>    [junit4]   2> 1542823 T5504 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1542827 T5504 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1542829 T5504 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1542831 T5504 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
>    [junit4]   2> 1542831 T5504 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
>    [junit4]   2> 1542873 T5504 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 1542874 T5504 oasc.SolrResourceLoader.locateSolrHome
> using system property solr.solr.home:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
>    [junit4]   2> 1542874 T5504 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for deduced Solr Home:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
>    [junit4]   2> 1543004 T5504 oasc.CoreContainer.<init> New CoreContainer
> 1360351
>    [junit4]   2> 1543004 T5504 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
>    [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 0
>    [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to: http://
>    [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 0
>    [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 1543027 T5504 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 1543027 T5504 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 1543028 T5504 oasc.CoreContainer.load Host Name:
>    [junit4]   2> 1543043 T5505 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using instanceDir:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
>    [junit4]   2> 1543046 T5505 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
>    [junit4]   2> 1543047 T5505 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 1543048 T5505 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README'
> to classloader
>    [junit4]   2> 1543183 T5505 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: LUCENE_47
>    [junit4]   2> 1543319 T5505 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig-phrasesuggest.xml
>    [junit4]   2> 1543319 T5505 oass.IndexSchema.readSchema Reading Solr
> Schema from schema-phrasesuggest.xml
>    [junit4]   2> 1543336 T5505 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 1543394 T5505 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 1543398 T5505 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 1543401 T5505 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 1543402 T5505 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\,
> dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
>    [junit4]   2> 1543402 T5505 oasc.SolrCore.<init> JMX monitoring not
> detected for core: collection1
>    [junit4]   2> 1543404 T5505 oasc.CachingDirectoryFactory.get return new
> directory for
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
>    [junit4]   2> 1543404 T5505 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index/
>    [junit4]   2> 1543404 T5505 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index'
> doesn't exist. Creating new index...
>    [junit4]   2> 1543406 T5505 oasc.CachingDirectoryFactory.get return new
> directory for
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index
>    [junit4]   2> 1543408 T5505 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class
> org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy:
> minMergeSize=0, mergeFactor=10, maxMergeSize=1677498810,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
>    [junit4]   2> 1543408 T5505 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@18003a2lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb0bb2
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1543408 T5505 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1543413 T5505 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /infix_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_file_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /blended_infix_suggest:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_high_freq_dict:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543419 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_max_edit_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543420 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543420 T5505 oasc.RequestHandlers.initHandlersFromConfig
> created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2:
> org.apache.solr.handler.component.SearchHandler
>    [junit4]   2> 1543428 T5505 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 1543428 T5505 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 1543429 T5505 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class
> org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy:
> minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
>    [junit4]   2> 1543431 T5505 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
>  commit{dir=MockDirectoryWrapper(RAMDirectory@18003a2lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb0bb2
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 1543431 T5505 oasc.SolrDeletionPolicy.updateCommits
> newest commit generation = 1
>    [junit4]   2> 1543432 T5505 oass.SolrIndexSearcher.<init> Opening
> Searcher@f1668d[collection1] main
>    [junit4]   2> 1543432 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543433 T5505 oasss.Suggester.init init:
> {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
>    [junit4]   2> 1543438 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543438 T5505 oasss.Suggester.init init:
> {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
>    [junit4]   2> 1543443 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543444 T5505 oasss.Suggester.init init:
> {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
>    [junit4]   2> 1543446 T5505 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 1543447 T5505 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 1543451 T5505 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
>    [junit4]   2> 1543451 T5505 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 1543452 T5505 oasss.SolrSuggester.init init:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 1543455 T5505 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator=
> ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
>    [junit4]   2> 1543456 T5505 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 1543456 T5505 oasss.SolrSuggester.init init:
> {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
>    [junit4]   2> 1543465 T5505 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
>    [junit4]   2> 1543466 T5505 oasss.SolrSuggester.init init:
> {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
>    [junit4]   2> 1543470 T5505 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
>    [junit4]   2> 1543470 T5505 oashc.SuggestComponent.inform Initializing
> SuggestComponent
>    [junit4]   2> 1543470 T5505 oasss.SolrSuggester.init init:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543473 T5505 oasss.SolrSuggester.init WARN Loading
> stored lookup data failed, possibly not cached yet
>    [junit4]   2> 1543474 T5505 oasss.SolrSuggester.init Dictionary loaded
> with params:
> {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543474 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543475 T5505 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543475 T5505 oasss.Suggester.init WARN Loading stored
> lookup data failed java.io.FileNotFoundException:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\fuzzy_suggest_analyzing\fwfsta.bin
> (The system cannot find the file specified)
>    [junit4]   2>        at java.io.FileInputStream.open(Native Method)
>    [junit4]   2>        at
> java.io.FileInputStream.<init>(FileInputStream.java:146)
>    [junit4]   2>        at
> org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
>    [junit4]   2>        at
> org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
>    [junit4]   2>        at
> org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
>    [junit4]   2>        at
> org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
>    [junit4]   2>        at
> org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
>    [junit4]   2>        at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>    [junit4]   2>        at
> java.util.concurrent.FutureTask.run(FutureTask.java:262)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>    [junit4]   2>        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    [junit4]   2>        at java.lang.Thread.run(Thread.java:744)
>    [junit4]   2>
>    [junit4]   2> 1543478 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543478 T5505 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543482 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543482 T5505 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543486 T5505 oashc.SpellCheckComponent.inform
> Initializing spell checkers
>    [junit4]   2> 1543486 T5505 oasss.Suggester.init init:
> {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
>    [junit4]   2> 1543492 T5505 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 1543492 T5506 oasc.SolrCore.registerSearcher
> [collection1] Registered new searcher Searcher@f1668d[collection1]
> main{StandardDirectoryReader(segments_1:1:nrt)}
>    [junit4]   2> 1543508 T5504 oas.SolrTestCaseJ4.initCore ####initCore end
>    [junit4]   2> ASYNC  NEW_CORE C3840 name=collection1
> org.apache.solr.core.SolrCore@1a402a4
>    [junit4]   2> 1543509 T5504 C3840 oasss.Suggester.build build()
>    [junit4]   2> 1543588 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=&qt=/infix_suggest_analyzing&spellcheck.build=true} status=0
> QTime=79
>    [junit4]   2> 1543600 T5504 oas.SolrTestCaseJ4.setUp ###Starting
> testSingle
>    [junit4]   2> 1543601 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=1} status=0
> QTime=1
>    [junit4]   2> 1543639 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=high&qt=/infix_suggest_analyzing&spellcheck.count=1} status=0
> QTime=0
>    [junit4]   2> 1543643 T5504 oas.SolrTestCaseJ4.tearDown ###Ending
> testSingle
>    [junit4]   2> 1543666 T5504 oas.SolrTestCaseJ4.setUp ###Starting
> testMultiple
>    [junit4]   2> 1543666 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=2} status=0
> QTime=0
>    [junit4]   2> 1543671 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=3} status=0
> QTime=1
>    [junit4]   2> 1543682 T5504 C3840 oasc.SolrCore.execute [collection1]
> webapp=null path=null
> params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=4} status=0
> QTime=0
>    [junit4]   2> 1543693 T5504 oas.SolrTestCaseJ4.tearDown ###Ending
> testMultiple
>    [junit4]   2> !!!! WARNING: best effort to remove
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\analyzingInfixSuggesterIndexDir\_0.fdt
> FAILED !!!!!
>    [junit4]   2> 1543704 T5504 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> 1543704 T5504 oasc.CoreContainer.shutdown Shutting down
> CoreContainer instance=1360351
>    [junit4]   2> 1543707 T5504 oasc.SolrCore.close [collection1]  CLOSING
> SolrCore org.apache.solr.core.SolrCore@1a402a4
>    [junit4]   2> 1543707 T5504 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
>    [junit4]   2> 1543707 T5504 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
>    [junit4]   2> 1543707 T5504 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
>    [junit4]   2> 1543707 T5504 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
>    [junit4]   2> 1543711 T5504 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
>    [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 1543711 T5504
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
> [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\;done=false>>]
>    [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing
> directory:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
>    [junit4]   2> 1543711 T5504
> oasc.CachingDirectoryFactory.closeCacheValue looking to close
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index
> [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index;done=false>>]
>    [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing
> directory:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index
>    [junit4]   2> NOTE: test params are: codec=Appending,
> sim=DefaultSimilarity, locale=sr_ME, timezone=Pacific/Auckland
>    [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea
> (32-bit)/cpus=2,threads=1,free=150875696,total=301367296
>    [junit4]   2> NOTE: All tests run in this JVM:
> [PreAnalyzedUpdateProcessorTest, SchemaVersionSpecificBehaviorTest,
> OutputWriterTest, ParsingFieldUpdateProcessorsTest, TestUpdate,
> TestDefaultSimilarityFactory, TestClassNameShortening,
> TestInfoStreamLogging, SignatureUpdateProcessorFactoryTest,
> ChaosMonkeyNothingIsSafeTest, DocumentBuilderTest, SyncSliceTest,
> TestSolrXmlPersistence, TestSolrJ, ChaosMonkeySafeLeaderTest,
> TestFieldTypeResource, SolrPluginUtilsTest, AssignTest, EnumFieldTest,
> TestCodecSupport, TestCollationKeyRangeQueries, TestStressLucene,
> TermVectorComponentDistributedTest, TestReload, TestBadConfig,
> OpenCloseCoreStressTest, TestSchemaVersionResource, TestDocSet,
> PeerSyncTest, TestJoin, TestOverriddenPrefixQueryForCustomFieldType,
> SolrInfoMBeanTest, TestReloadAndDeleteDocs, PluginInfoTest,
> BadCopyFieldTest, TestStressVersions, TestAddFieldRealTimeGet,
> SolrCoreCheckLockOnStartupTest, TestDistributedSearch,
> TestSimpleQParserPlugin, AddSchemaFieldsUpdateProcessorFactoryTest,
> TestFileDictionaryLookup, TestMaxScoreQueryParser, TermsComponentTest,
> TestSolrIndexConfig, CachingDirectoryFactoryTest, TestBinaryResponseWriter,
> MBeansHandlerTest, TestPerFieldSimilarity, RecoveryZkTest,
> CoreAdminHandlerTest, NoCacheHeaderTest, DOMUtilTest, SampleTest,
> TestDynamicFieldCollectionResource, CollectionsAPIDistributedZkTest,
> ZkControllerTest, SOLR749Test, TestSolr4Spatial, InfoHandlerTest,
> TestIndexSearcher, SolrIndexSplitterTest, TestLFUCache, SolrCoreTest,
> DistribCursorPagingTest, TestBlendedInfixSuggestions,
> HdfsUnloadDistributedZkTest, TestNumberUtils,
> TestHighFrequencyDictionaryFactory, SolrIndexConfigTest,
> StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest,
> FileBasedSpellCheckerTest, FieldAnalysisRequestHandlerTest,
> TestJmxMonitoredMap, FullSolrCloudDistribCmdsTest,
> TestDynamicFieldResource, TestAnalyzedSuggestions,
> TestFieldCollectionResource, HdfsDirectoryTest, PrimUtilsTest,
> ClusterStateUpdateTest, ZkNodePropsTest, ShardSplitTest,
> TestComponentsName, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest,
> DistributedDebugComponentTest, TestQuerySenderNoQuery,
> TestDefaultSearchFieldResource, TestRandomFaceting, TestRTGBase,
> TestCopyFieldCollectionResource, TestCollationFieldDocValues,
> HdfsCollectionsAPIDistributedZkTest, DirectUpdateHandlerOptimizeTest,
> RemoteQueryErrorTest, SuggesterTSTTest, UUIDFieldTest, CircularListTest,
> SpellCheckCollatorTest, TestRemoteStreaming, RequiredFieldsTest,
> TestOmitPositions, OverseerTest, TestJmxIntegration,
> TestCursorMarkWithoutUniqueKey, TestSweetSpotSimilarityFactory,
> TestSolrXMLSerializer, FastVectorHighlighterTest, PingRequestHandlerTest,
> QueryParsingTest, TestRangeQuery, TestFieldTypeCollectionResource,
> TestCloudManagedSchema, TestFunctionQuery, NotRequiredUniqueKeyTest,
> LeaderElectionIntegrationTest, PrimitiveFieldTypeTest, IndexSchemaTest,
> CoreAdminCreateDiscoverTest, ScriptEngineTest,
> XsltUpdateRequestHandlerTest, HdfsSyncSliceTest, TestGroupingSearch,
> CursorPagingTest, DeleteShardTest, BlockCacheTest, TestStressRecovery,
> TestValueSourceCache, QueryResultKeyTest, DocValuesMissingTest,
> TestSolrCoreProperties, TestInitQParser, SolrTestCaseJ4Test,
> DeleteReplicaTest, HighlighterTest, SystemInfoHandlerTest,
> HighlighterConfigTest, TestMultiCoreConfBootstrap, TestRandomDVFaceting,
> TestAnalyzeInfixSuggestions]
>    [junit4]   2> NOTE: reproduce with: ant test
>  -Dtestcase=TestAnalyzeInfixSuggestions -Dtests.seed=F4223265901D0F6F
> -Dtests.slow=true -Dtests.locale=sr_ME -Dtests.timezone=Pacific/Auckland
> -Dtests.file.encoding=US-ASCII
>    [junit4] ERROR   0.00s | TestAnalyzeInfixSuggestions (suite) <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
>    [junit4]    >        at
> org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:744)
>    [junit4] Completed in 1.42s, 2 tests, 1 failure <<< FAILURES!
>
> [...truncated 674 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The
> following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The
> following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The
> following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37:
> The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189:
> The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491:
> The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308:
> The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941:
> There were test failures: 360 suites, 1558 tests, 2 suite-level errors, 40
> ignored (12 assumptions)
>
> Total time: 80 minutes 46 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>

[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3687 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3687/
Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10158 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions
   [junit4]   2> 929169 T3244 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670
   [junit4]   2> 929173 T3244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 929173 T3244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 929176 T3244 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 929258 T3244 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 929320 T3244 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 929320 T3244 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 929328 T3244 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 929358 T3244 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 929360 T3244 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 929361 T3244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 929378 T3244 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 929439 T3244 oasc.CoreContainer.<init> New CoreContainer 75558
   [junit4]   2> 929440 T3244 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
   [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 929441 T3244 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 929442 T3244 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 929443 T3244 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 929443 T3244 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 929448 T3244 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 929448 T3244 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 929449 T3244 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 929455 T3245 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
   [junit4]   2> 929456 T3245 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 929457 T3245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 929457 T3245 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 929515 T3245 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 929577 T3245 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 929577 T3245 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 929586 T3245 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 929615 T3245 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 929617 T3245 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 929619 T3245 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 929620 T3245 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
   [junit4]   2> 929620 T3245 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 929620 T3245 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
   [junit4]   2> 929620 T3245 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index/
   [junit4]   2> 929620 T3245 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index' doesn't exist. Creating new index...
   [junit4]   2> 929621 T3245 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index
   [junit4]   2> 929622 T3245 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=30.7021484375, floorSegmentMB=1.5078125, forceMergeDeletesPctAllowed=9.911627139999567, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8244566905680515
   [junit4]   2> 929622 T3245 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74318d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b90556),segFN=segments_1,generation=1}
   [junit4]   2> 929622 T3245 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 929624 T3245 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 929624 T3245 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929625 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929626 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929627 T3245 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 929631 T3245 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 929631 T3245 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 929631 T3245 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 929631 T3245 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74318d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@b90556),segFN=segments_1,generation=1}
   [junit4]   2> 929631 T3245 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 929632 T3245 oass.SolrIndexSearcher.<init> Opening Searcher@efdc0[collection1] main
   [junit4]   2> 929632 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929632 T3245 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 929634 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929634 T3245 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 929636 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929636 T3245 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 929637 T3245 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 929638 T3245 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 929640 T3245 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 929640 T3245 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 929640 T3245 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 929642 T3245 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 929642 T3245 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 929642 T3245 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 929643 T3245 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 929643 T3245 oasss.SolrSuggester.init init: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 929644 T3245 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 929644 T3245 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 929644 T3245 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929646 T3245 oasss.SolrSuggester.init WARN Loading stored lookup data failed, possibly not cached yet
   [junit4]   2> 929646 T3245 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929646 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929646 T3245 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929647 T3245 oasss.Suggester.init WARN Loading stored lookup data failed java.io.FileNotFoundException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\fuzzy_suggest_analyzing\fwfsta.bin (The system cannot find the file specified)
   [junit4]   2> 	at java.io.FileInputStream.open(Native Method)
   [junit4]   2> 	at java.io.FileInputStream.<init>(FileInputStream.java:146)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
   [junit4]   2> 	at org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 929647 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929648 T3245 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929649 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929650 T3245 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929651 T3245 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 929651 T3245 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 929653 T3245 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 929653 T3246 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@efdc0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 929660 T3244 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C3164 name=collection1 org.apache.solr.core.SolrCore@14b34bb
   [junit4]   2> 929662 T3244 C3164 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(q=&suggest.buildAll=true&qt=/blended_infix_suggest),defaults(suggest=true)}
   [junit4]   2> 929662 T3244 C3164 oasss.SolrSuggester.build build()
   [junit4]   2> 929837 T3244 C3164 oasss.SolrSuggester.build build()
   [junit4]   2> 929914 T3244 C3164 oashc.SuggestComponent.process SuggestComponent process with : {params(q=&suggest.buildAll=true&qt=/blended_infix_suggest),defaults(suggest=true)}
   [junit4]   2> 929915 T3244 C3164 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=&suggest.buildAll=true&qt=/blended_infix_suggest} status=0 QTime=253 
   [junit4]   2> 929919 T3244 oas.SolrTestCaseJ4.setUp ###Starting testReciprocalBlenderType
   [junit4]   2> 929919 T3244 C3164 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929919 T3244 C3164 oashc.SuggestComponent.process SuggestComponent process with : {params(q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929926 T3244 C3164 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=the&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=7 
   [junit4]   2> 929950 T3244 oas.SolrTestCaseJ4.tearDown ###Ending testReciprocalBlenderType
   [junit4]   2> 929955 T3244 oas.SolrTestCaseJ4.setUp ###Starting testMultiSuggester
   [junit4]   2> 929955 T3244 C3164 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929956 T3244 C3164 oashc.SuggestComponent.process SuggestComponent process with : {params(q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929957 T3244 C3164 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=the&suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=2 
   [junit4]   2> 929976 T3244 oas.SolrTestCaseJ4.tearDown ###Ending testMultiSuggester
   [junit4]   2> 929980 T3244 oas.SolrTestCaseJ4.setUp ###Starting testLinearBlenderType
   [junit4]   2> 929981 T3244 C3164 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929981 T3244 C3164 oashc.SuggestComponent.process SuggestComponent process with : {params(q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 929982 T3244 C3164 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=the&suggest.dictionary=blended_infix_suggest_linear&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=1 
   [junit4]   2> 929991 T3244 oas.SolrTestCaseJ4.tearDown ###Ending testLinearBlenderType
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\blendedInfixSuggesterIndexDir\_0.fdt FAILED !!!!!
   [junit4]   2> 929996 T3244 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 929997 T3244 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=75558
   [junit4]   2> 929997 T3244 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@14b34bb
   [junit4]   2> 929997 T3244 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 929997 T3244 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 929997 T3244 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 929997 T3244 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 930000 T3244 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index;done=false>>]
   [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\index
   [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\;done=false>>]
   [junit4]   2> 930000 T3244 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391968555670\
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=sk, timezone=America/Edmonton
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=1,free=172234112,total=286580736
   [junit4]   2> NOTE: All tests run in this JVM: [PreAnalyzedUpdateProcessorTest, SchemaVersionSpecificBehaviorTest, OutputWriterTest, ParsingFieldUpdateProcessorsTest, TestUpdate, TestDefaultSimilarityFactory, TestClassNameShortening, TestInfoStreamLogging, SignatureUpdateProcessorFactoryTest, ChaosMonkeyNothingIsSafeTest, DocumentBuilderTest, SyncSliceTest, TestSolrXmlPersistence, TestSolrJ, ChaosMonkeySafeLeaderTest, TestFieldTypeResource, SolrPluginUtilsTest, AssignTest, EnumFieldTest, TestCodecSupport, TestCollationKeyRangeQueries, TestStressLucene, TermVectorComponentDistributedTest, TestReload, TestBadConfig, OpenCloseCoreStressTest, TestSchemaVersionResource, TestDocSet, PeerSyncTest, TestJoin, TestOverriddenPrefixQueryForCustomFieldType, SolrInfoMBeanTest, TestReloadAndDeleteDocs, PluginInfoTest, BadCopyFieldTest, TestStressVersions, TestAddFieldRealTimeGet, SolrCoreCheckLockOnStartupTest, TestDistributedSearch, TestSimpleQParserPlugin, AddSchemaFieldsUpdateProcessorFactoryTest, TestFileDictionaryLookup, TestMaxScoreQueryParser, TermsComponentTest, TestSolrIndexConfig, CachingDirectoryFactoryTest, TestBinaryResponseWriter, MBeansHandlerTest, TestPerFieldSimilarity, RecoveryZkTest, CoreAdminHandlerTest, NoCacheHeaderTest, DOMUtilTest, SampleTest, TestDynamicFieldCollectionResource, CollectionsAPIDistributedZkTest, ZkControllerTest, SOLR749Test, TestSolr4Spatial, InfoHandlerTest, TestIndexSearcher, SolrIndexSplitterTest, TestLFUCache, SolrCoreTest, DistribCursorPagingTest, TestBlendedInfixSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBlendedInfixSuggestions -Dtests.seed=F4223265901D0F6F -Dtests.slow=true -Dtests.locale=sk -Dtests.timezone=America/Edmonton -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | TestBlendedInfixSuggestions (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4] Completed in 0.88s, 3 tests, 1 failure <<< FAILURES!

[...truncated 234 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
   [junit4]   2> 1542406 T5504 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904
   [junit4]   2> 1542410 T5504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 1542414 T5504 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1542421 T5504 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1542635 T5504 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1542740 T5504 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 1542741 T5504 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 1542755 T5504 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 1542823 T5504 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1542827 T5504 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1542829 T5504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1542831 T5504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 1542831 T5504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 1542873 T5504 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1542874 T5504 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 1542874 T5504 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 1543004 T5504 oasc.CoreContainer.<init> New CoreContainer 1360351
   [junit4]   2> 1543004 T5504 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
   [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1543009 T5504 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1543012 T5504 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1543027 T5504 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1543027 T5504 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1543028 T5504 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 1543043 T5505 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
   [junit4]   2> 1543046 T5505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 1543047 T5505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 1543048 T5505 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 1543183 T5505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 1543319 T5505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 1543319 T5505 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 1543336 T5505 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1543394 T5505 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1543398 T5505 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1543401 T5505 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1543402 T5505 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
   [junit4]   2> 1543402 T5505 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1543404 T5505 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
   [junit4]   2> 1543404 T5505 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index/
   [junit4]   2> 1543404 T5505 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index' doesn't exist. Creating new index...
   [junit4]   2> 1543406 T5505 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index
   [junit4]   2> 1543408 T5505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1677498810, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1543408 T5505 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18003a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb0bb2),segFN=segments_1,generation=1}
   [junit4]   2> 1543408 T5505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1543413 T5505 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543415 T5505 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543416 T5505 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543417 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543419 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543420 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543420 T5505 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 1543428 T5505 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1543428 T5505 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1543429 T5505 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=40, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1543431 T5505 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18003a2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1fb0bb2),segFN=segments_1,generation=1}
   [junit4]   2> 1543431 T5505 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1543432 T5505 oass.SolrIndexSearcher.<init> Opening Searcher@f1668d[collection1] main
   [junit4]   2> 1543432 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543433 T5505 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 1543438 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543438 T5505 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 1543443 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543444 T5505 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 1543446 T5505 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 1543447 T5505 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 1543451 T5505 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 1543451 T5505 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 1543452 T5505 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 1543455 T5505 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 1543456 T5505 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 1543456 T5505 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 1543465 T5505 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 1543466 T5505 oasss.SolrSuggester.init init: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 1543470 T5505 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 1543470 T5505 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 1543470 T5505 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543473 T5505 oasss.SolrSuggester.init WARN Loading stored lookup data failed, possibly not cached yet
   [junit4]   2> 1543474 T5505 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543474 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543475 T5505 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543475 T5505 oasss.Suggester.init WARN Loading stored lookup data failed java.io.FileNotFoundException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\fuzzy_suggest_analyzing\fwfsta.bin (The system cannot find the file specified)
   [junit4]   2> 	at java.io.FileInputStream.open(Native Method)
   [junit4]   2> 	at java.io.FileInputStream.<init>(FileInputStream.java:146)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
   [junit4]   2> 	at org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1543478 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543478 T5505 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543482 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543482 T5505 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543486 T5505 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 1543486 T5505 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 1543492 T5505 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1543492 T5506 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f1668d[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1543508 T5504 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C3840 name=collection1 org.apache.solr.core.SolrCore@1a402a4
   [junit4]   2> 1543509 T5504 C3840 oasss.Suggester.build build()
   [junit4]   2> 1543588 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=&qt=/infix_suggest_analyzing&spellcheck.build=true} status=0 QTime=79 
   [junit4]   2> 1543600 T5504 oas.SolrTestCaseJ4.setUp ###Starting testSingle
   [junit4]   2> 1543601 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=1} status=0 QTime=1 
   [junit4]   2> 1543639 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=high&qt=/infix_suggest_analyzing&spellcheck.count=1} status=0 QTime=0 
   [junit4]   2> 1543643 T5504 oas.SolrTestCaseJ4.tearDown ###Ending testSingle
   [junit4]   2> 1543666 T5504 oas.SolrTestCaseJ4.setUp ###Starting testMultiple
   [junit4]   2> 1543666 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=2} status=0 QTime=0 
   [junit4]   2> 1543671 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=3} status=0 QTime=1 
   [junit4]   2> 1543682 T5504 C3840 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&qt=/infix_suggest_analyzing&spellcheck.count=4} status=0 QTime=0 
   [junit4]   2> 1543693 T5504 oas.SolrTestCaseJ4.tearDown ###Ending testMultiple
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\analyzingInfixSuggesterIndexDir\_0.fdt FAILED !!!!!
   [junit4]   2> 1543704 T5504 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 1543704 T5504 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1360351
   [junit4]   2> 1543707 T5504 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1a402a4
   [junit4]   2> 1543707 T5504 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1543707 T5504 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1543707 T5504 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1543707 T5504 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1543711 T5504 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\;done=false>>]
   [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\
   [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index;done=false>>]
   [junit4]   2> 1543711 T5504 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391969168904\index
   [junit4]   2> NOTE: test params are: codec=Appending, sim=DefaultSimilarity, locale=sr_ME, timezone=Pacific/Auckland
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_60-ea (32-bit)/cpus=2,threads=1,free=150875696,total=301367296
   [junit4]   2> NOTE: All tests run in this JVM: [PreAnalyzedUpdateProcessorTest, SchemaVersionSpecificBehaviorTest, OutputWriterTest, ParsingFieldUpdateProcessorsTest, TestUpdate, TestDefaultSimilarityFactory, TestClassNameShortening, TestInfoStreamLogging, SignatureUpdateProcessorFactoryTest, ChaosMonkeyNothingIsSafeTest, DocumentBuilderTest, SyncSliceTest, TestSolrXmlPersistence, TestSolrJ, ChaosMonkeySafeLeaderTest, TestFieldTypeResource, SolrPluginUtilsTest, AssignTest, EnumFieldTest, TestCodecSupport, TestCollationKeyRangeQueries, TestStressLucene, TermVectorComponentDistributedTest, TestReload, TestBadConfig, OpenCloseCoreStressTest, TestSchemaVersionResource, TestDocSet, PeerSyncTest, TestJoin, TestOverriddenPrefixQueryForCustomFieldType, SolrInfoMBeanTest, TestReloadAndDeleteDocs, PluginInfoTest, BadCopyFieldTest, TestStressVersions, TestAddFieldRealTimeGet, SolrCoreCheckLockOnStartupTest, TestDistributedSearch, TestSimpleQParserPlugin, AddSchemaFieldsUpdateProcessorFactoryTest, TestFileDictionaryLookup, TestMaxScoreQueryParser, TermsComponentTest, TestSolrIndexConfig, CachingDirectoryFactoryTest, TestBinaryResponseWriter, MBeansHandlerTest, TestPerFieldSimilarity, RecoveryZkTest, CoreAdminHandlerTest, NoCacheHeaderTest, DOMUtilTest, SampleTest, TestDynamicFieldCollectionResource, CollectionsAPIDistributedZkTest, ZkControllerTest, SOLR749Test, TestSolr4Spatial, InfoHandlerTest, TestIndexSearcher, SolrIndexSplitterTest, TestLFUCache, SolrCoreTest, DistribCursorPagingTest, TestBlendedInfixSuggestions, HdfsUnloadDistributedZkTest, TestNumberUtils, TestHighFrequencyDictionaryFactory, SolrIndexConfigTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, FileBasedSpellCheckerTest, FieldAnalysisRequestHandlerTest, TestJmxMonitoredMap, FullSolrCloudDistribCmdsTest, TestDynamicFieldResource, TestAnalyzedSuggestions, TestFieldCollectionResource, HdfsDirectoryTest, PrimUtilsTest, ClusterStateUpdateTest, ZkNodePropsTest, ShardSplitTest, TestComponentsName, PathHierarchyTokenizerFactoryTest, MigrateRouteKeyTest, DistributedDebugComponentTest, TestQuerySenderNoQuery, TestDefaultSearchFieldResource, TestRandomFaceting, TestRTGBase, TestCopyFieldCollectionResource, TestCollationFieldDocValues, HdfsCollectionsAPIDistributedZkTest, DirectUpdateHandlerOptimizeTest, RemoteQueryErrorTest, SuggesterTSTTest, UUIDFieldTest, CircularListTest, SpellCheckCollatorTest, TestRemoteStreaming, RequiredFieldsTest, TestOmitPositions, OverseerTest, TestJmxIntegration, TestCursorMarkWithoutUniqueKey, TestSweetSpotSimilarityFactory, TestSolrXMLSerializer, FastVectorHighlighterTest, PingRequestHandlerTest, QueryParsingTest, TestRangeQuery, TestFieldTypeCollectionResource, TestCloudManagedSchema, TestFunctionQuery, NotRequiredUniqueKeyTest, LeaderElectionIntegrationTest, PrimitiveFieldTypeTest, IndexSchemaTest, CoreAdminCreateDiscoverTest, ScriptEngineTest, XsltUpdateRequestHandlerTest, HdfsSyncSliceTest, TestGroupingSearch, CursorPagingTest, DeleteShardTest, BlockCacheTest, TestStressRecovery, TestValueSourceCache, QueryResultKeyTest, DocValuesMissingTest, TestSolrCoreProperties, TestInitQParser, SolrTestCaseJ4Test, DeleteReplicaTest, HighlighterTest, SystemInfoHandlerTest, HighlighterConfigTest, TestMultiCoreConfBootstrap, TestRandomDVFaceting, TestAnalyzeInfixSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestAnalyzeInfixSuggestions -Dtests.seed=F4223265901D0F6F -Dtests.slow=true -Dtests.locale=sr_ME -Dtests.timezone=Pacific/Auckland -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | TestAnalyzeInfixSuggestions (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([F4223265901D0F6F]:0)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4] Completed in 1.42s, 2 tests, 1 failure <<< FAILURES!

[...truncated 674 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 360 suites, 1558 tests, 2 suite-level errors, 40 ignored (12 assumptions)

Total time: 80 minutes 46 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.6.0_45) - Build # 3686 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3686/
Java: 32bit/jdk1.6.0_45 -server -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([3C205D6B94A4E59E]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)


FAILED:  junit.framework.TestSuite.org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([3C205D6B94A4E59E]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:662)




Build Log:
[...truncated 9499 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions
   [junit4]   2> 844057 T2290 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257
   [junit4]   2> 844059 T2290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 844061 T2290 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 844062 T2290 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 844151 T2290 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 844235 T2290 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 844236 T2290 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 844242 T2290 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 844286 T2290 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 844290 T2290 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 844290 T2290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 844292 T2290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 844292 T2290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 844319 T2290 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 844319 T2290 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 844319 T2290 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 844413 T2290 oasc.CoreContainer.<init> New CoreContainer 27971999
   [junit4]   2> 844416 T2290 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 844417 T2290 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 844421 T2290 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 844421 T2290 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 844422 T2290 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 844430 T2291 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
   [junit4]   2> 844430 T2291 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 844431 T2291 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 844431 T2291 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 844499 T2291 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 844574 T2291 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 844576 T2291 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 844582 T2291 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 844619 T2291 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 844623 T2291 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 844623 T2291 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 844624 T2291 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\
   [junit4]   2> 844624 T2291 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 844624 T2291 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\
   [junit4]   2> 844624 T2291 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index/
   [junit4]   2> 844624 T2291 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index' doesn't exist. Creating new index...
   [junit4]   2> 844626 T2291 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index
   [junit4]   2> 844627 T2291 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=33.6328125, floorSegmentMB=0.685546875, forceMergeDeletesPctAllowed=0.0687717659796061, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 844627 T2291 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5f8601 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50cc0b),segFN=segments_1,generation=1}
   [junit4]   2> 844627 T2291 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 844628 T2291 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 844628 T2291 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 844629 T2291 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844629 T2291 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844629 T2291 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844629 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844630 T2291 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844630 T2291 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844630 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844630 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844631 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844631 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844631 T2291 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 844635 T2291 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 844635 T2291 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 844635 T2291 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=37, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6875927098273861]
   [junit4]   2> 844636 T2291 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5f8601 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@50cc0b),segFN=segments_1,generation=1}
   [junit4]   2> 844636 T2291 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 844636 T2291 oass.SolrIndexSearcher.<init> Opening Searcher@12bc6bd[collection1] main
   [junit4]   2> 844637 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844637 T2291 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 844639 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844639 T2291 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 844641 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844641 T2291 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 844641 T2291 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 844641 T2291 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 844644 T2291 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 844644 T2291 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 844644 T2291 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 844645 T2291 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 844645 T2291 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 844645 T2291 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 844646 T2291 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 844646 T2291 oasss.SolrSuggester.init init: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 844647 T2291 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 844647 T2291 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 844647 T2291 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844649 T2291 oasss.SolrSuggester.init WARN Loading stored lookup data failed, possibly not cached yet
   [junit4]   2> 844649 T2291 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844649 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844649 T2291 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844650 T2291 oasss.Suggester.init WARN Loading stored lookup data failed java.io.FileNotFoundException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\fuzzy_suggest_analyzing\fwfsta.bin (The system cannot find the file specified)
   [junit4]   2> 	at java.io.FileInputStream.open(Native Method)
   [junit4]   2> 	at java.io.FileInputStream.<init>(FileInputStream.java:120)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
   [junit4]   2> 	at org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 844656 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844656 T2291 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844659 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844659 T2291 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844660 T2291 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 844660 T2291 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 844663 T2291 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 844663 T2292 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12bc6bd[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 844667 T2290 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C2159 name=collection1 org.apache.solr.core.SolrCore@1cc6bc1
   [junit4]   2> 844670 T2290 C2159 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(suggest.buildAll=true&q=&qt=/blended_infix_suggest),defaults(suggest=true)}
   [junit4]   2> 844670 T2290 C2159 oasss.SolrSuggester.build build()
   [junit4]   2> 844806 T2290 C2159 oasss.SolrSuggester.build build()
   [junit4]   2> 844872 T2290 C2159 oashc.SuggestComponent.process SuggestComponent process with : {params(suggest.buildAll=true&q=&qt=/blended_infix_suggest),defaults(suggest=true)}
   [junit4]   2> 844876 T2290 C2159 oasc.SolrCore.execute [collection1] webapp=null path=null params={suggest.buildAll=true&q=&qt=/blended_infix_suggest} status=0 QTime=209 
   [junit4]   2> 844880 T2290 oas.SolrTestCaseJ4.setUp ###Starting testMultiSuggester
   [junit4]   2> 844880 T2290 C2159 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844880 T2290 C2159 oashc.SuggestComponent.process SuggestComponent process with : {params(suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844887 T2290 C2159 oasc.SolrCore.execute [collection1] webapp=null path=null params={suggest.dictionary=blended_infix_suggest_linear&suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=7 
   [junit4]   2> 844926 T2290 oas.SolrTestCaseJ4.tearDown ###Ending testMultiSuggester
   [junit4]   2> 844931 T2290 oas.SolrTestCaseJ4.setUp ###Starting testReciprocalBlenderType
   [junit4]   2> ASYNC  NEW_CORE C2160 name=collection1 org.apache.solr.core.SolrCore@1cc6bc1
   [junit4]   2> 844931 T2290 C2160 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844932 T2290 C2160 oashc.SuggestComponent.process SuggestComponent process with : {params(suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844932 T2290 C2160 oasc.SolrCore.execute [collection1] webapp=null path=null params={suggest.dictionary=blended_infix_suggest_reciprocal&q=the&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=1 
   [junit4]   2> 844945 T2290 oas.SolrTestCaseJ4.tearDown ###Ending testReciprocalBlenderType
   [junit4]   2> 844950 T2290 oas.SolrTestCaseJ4.setUp ###Starting testLinearBlenderType
   [junit4]   2> 844950 T2290 C2160 oashc.SuggestComponent.prepare SuggestComponent prepare with : {params(suggest.dictionary=blended_infix_suggest_linear&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844950 T2290 C2160 oashc.SuggestComponent.process SuggestComponent process with : {params(suggest.dictionary=blended_infix_suggest_linear&q=the&qt=/blended_infix_suggest&suggest.count=10),defaults(suggest=true)}
   [junit4]   2> 844950 T2290 C2160 oasc.SolrCore.execute [collection1] webapp=null path=null params={suggest.dictionary=blended_infix_suggest_linear&q=the&qt=/blended_infix_suggest&suggest.count=10} status=0 QTime=0 
   [junit4]   2> 844968 T2290 oas.SolrTestCaseJ4.tearDown ###Ending testLinearBlenderType
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\blendedInfixSuggesterIndexDir\_0.fdt FAILED !!!!!
   [junit4]   2> 844972 T2290 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 844972 T2290 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=27971999
   [junit4]   2> 844974 T2290 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1cc6bc1
   [junit4]   2> 844974 T2290 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 844974 T2290 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 844974 T2290 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 844974 T2290 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 844976 T2290 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 844976 T2290 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 844976 T2290 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\;done=false>>]
   [junit4]   2> 844976 T2290 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\
   [junit4]   2> 844977 T2290 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index;done=false>>]
   [junit4]   2> 844977 T2290 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestBlendedInfixSuggestions-1391943907257\index
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=es_PE, timezone=SST
   [junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=2,threads=1,free=63381184,total=242434048
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, TestCodecSupport, TestManagedSchemaFieldResource, TestCharFilters, TestNumberUtils, EchoParamsTest, PolyFieldTest, FastVectorHighlighterTest, TestClassNameShortening, TestGroupingSearch, CollectionsAPIDistributedZkTest, TestSolrJ, TestAddFieldRealTimeGet, TestCloudManagedSchema, TestDistributedSearch, TestDistributedMissingSort, IndexSchemaRuntimeFieldTest, JSONWriterTest, MoreLikeThisHandlerTest, ExternalFileFieldSortTest, TestNRTOpen, StatsComponentTest, PathHierarchyTokenizerFactoryTest, LoggingHandlerTest, ResourceLoaderTest, WordBreakSolrSpellCheckerTest, TestJmxIntegration, TestRandomFaceting, ConvertedLegacyTest, TermVectorComponentTest, ShowFileRequestHandlerTest, ResponseLogComponentTest, SolrCoreTest, TestStressRecovery, TestJoin, TestAnalyzedSuggestions, TestInfoStreamLogging, DefaultValueUpdateProcessorTest, TestDFRSimilarityFactory, SpellPossibilityIteratorTest, TimeZoneUtilsTest, TestDynamicFieldResource, SuggesterFSTTest, TestRTGBase, DisMaxRequestHandlerTest, TestDocBasedVersionConstraints, SchemaVersionSpecificBehaviorTest, TestSuggestSpellingConverter, TestMaxScoreQueryParser, ZkControllerTest, CoreAdminHandlerTest, StandardRequestHandlerTest, SpellCheckCollatorTest, AutoCommitTest, CursorPagingTest, TestQueryTypes, NotRequiredUniqueKeyTest, PingRequestHandlerTest, OpenExchangeRatesOrgProviderTest, TestReversedWildcardFilterFactory, TestUpdate, TestFieldCollectionResource, DocValuesTest, DistributedTermsComponentTest, UUIDFieldTest, TestSerializedLuceneMatchVersion, TestDynamicFieldCollectionResource, RequiredFieldsTest, TestHashPartitioner, XmlUpdateRequestHandlerTest, URLClassifyProcessorTest, TestSystemIdResolver, MultiTermTest, TestOverriddenPrefixQueryForCustomFieldType, TestCollapseQParserPlugin, BlockCacheTest, TestSchemaNameResource, DocValuesMultiTest, DebugComponentTest, ZkSolrClientTest, TestRealTimeGet, TestImplicitCoreProperties, SimpleFacetsTest, BadComponentTest, BasicDistributedZk2Test, QueryResultKeyTest, TestBlendedInfixSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestBlendedInfixSuggestions -Dtests.seed=3C205D6B94A4E59E -Dtests.slow=true -Dtests.locale=es_PE -Dtests.timezone=SST -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | TestBlendedInfixSuggestions (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3C205D6B94A4E59E]:0)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestBlendedInfixSuggestions.afterClass(TestBlendedInfixSuggestions.java:40)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:662)
   [junit4] Completed in 0.97s, 3 tests, 1 failure <<< FAILURES!

[...truncated 832 lines...]
   [junit4] Suite: org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions
   [junit4]   2> 3842501 T11705 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700
   [junit4]   2> 3842504 T11705 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 3842504 T11705 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 3842507 T11705 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 3842604 T11705 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 3842700 T11705 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 3842700 T11705 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 3842709 T11705 oass.IndexSchema.readSchema [null] Schema name=test
   [junit4]   2> 3842763 T11705 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3842765 T11705 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3842767 T11705 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3842767 T11705 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 3842767 T11705 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 3842786 T11705 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 3842786 T11705 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr
   [junit4]   2> 3842786 T11705 oasc.SolrResourceLoader.<init> new SolrResourceLoader for deduced Solr Home: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\'
   [junit4]   2> 3842884 T11705 oasc.CoreContainer.<init> New CoreContainer 32665751
   [junit4]   2> 3842886 T11705 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\]
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 3842888 T11705 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 3842893 T11705 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 3842895 T11705 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 3842895 T11705 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 3842902 T11706 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1
   [junit4]   2> 3842903 T11706 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\'
   [junit4]   2> 3842904 T11706 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 3842904 T11706 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-4.x-Windows/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 3842989 T11706 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 3843098 T11706 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-phrasesuggest.xml
   [junit4]   2> 3843101 T11706 oass.IndexSchema.readSchema Reading Solr Schema from schema-phrasesuggest.xml
   [junit4]   2> 3843109 T11706 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 3843164 T11706 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 3843169 T11706 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 3843169 T11706 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 3843171 T11706 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\
   [junit4]   2> 3843172 T11706 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 3843172 T11706 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\
   [junit4]   2> 3843172 T11706 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index/
   [junit4]   2> 3843172 T11706 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index' doesn't exist. Creating new index...
   [junit4]   2> 3843172 T11706 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index
   [junit4]   2> 3843174 T11706 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=32, maxMergedSegmentMB=61.388671875, floorSegmentMB=0.4609375, forceMergeDeletesPctAllowed=25.81663650373353, segmentsPerTier=13.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 3843175 T11706 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@144c9e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a9c8f),segFN=segments_1,generation=1}
   [junit4]   2> 3843175 T11706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3843176 T11706 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 3843177 T11706 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 3843177 T11706 oasc.RequestHandlers.initHandlersFromConfig created /suggest_wfst: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843177 T11706 oasc.RequestHandlers.initHandlersFromConfig created /suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843177 T11706 oasc.RequestHandlers.initHandlersFromConfig created /infix_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843177 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_file_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843178 T11706 oasc.RequestHandlers.initHandlersFromConfig created /blended_infix_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843178 T11706 oasc.RequestHandlers.initHandlersFromConfig created /free_text_suggest: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843178 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_high_freq_dict: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843178 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843179 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_max_edit_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843179 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843179 T11706 oasc.RequestHandlers.initHandlersFromConfig created /fuzzy_suggest_analyzing_with_min_fuzzy_length_2: org.apache.solr.handler.component.SearchHandler
   [junit4]   2> 3843184 T11706 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 3843184 T11706 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 3843185 T11706 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=20, maxMergedSegmentMB=30.248046875, floorSegmentMB=1.267578125, forceMergeDeletesPctAllowed=2.274959949450246, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5733534366383253
   [junit4]   2> 3843186 T11706 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@144c9e4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a9c8f),segFN=segments_1,generation=1}
   [junit4]   2> 3843186 T11706 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 3843186 T11706 oass.SolrIndexSearcher.<init> Opening Searcher@12e238e[collection1] main
   [junit4]   2> 3843187 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843187 T11706 oasss.Suggester.init init: {name=suggest_wfst,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.WFSTLookupFactory,storeDir=suggest_wfst,buildOnCommit=false,exactMatchFirst=true,sourceLocation=phrasesuggest.txt}
   [junit4]   2> 3843189 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843189 T11706 oasss.Suggester.init init: {name=suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingLookupFactory,storeDir=suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=ja_suggest,preserveSep=false,sourceLocation=jasuggest.txt}
   [junit4]   2> 3843191 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843191 T11706 oasss.Suggester.init init: {name=infix_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.AnalyzingInfixLookupFactory,buildOnCommit=false,suggestAnalyzerFieldType=text,sourceLocation=analyzingInfixSuggest.txt}
   [junit4]   2> 3843192 T11706 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 3843193 T11706 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 3843195 T11706 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_high_freq_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.HighFrequencyDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,field=stext}
   [junit4]   2> 3843195 T11706 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 3843195 T11706 oasss.SolrSuggester.init init: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 3843197 T11706 oasss.SolrSuggester.init Dictionary loaded with params: {name=free_text_suggest,lookupImpl=FreeTextLookupFactory,dictionaryImpl=FileDictionaryFactory,storeDir=free_text_suggest,buildOnCommit=false,sourceLocation=freeTextSuggest.txt,separator= ,suggestFreeTextAnalyzerFieldType=text,ngrams=2}
   [junit4]   2> 3843197 T11706 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 3843198 T11706 oasss.SolrSuggester.init init: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 3843201 T11706 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_linear,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=linear,suggestAnalyzerFieldType=text}
   [junit4]   2> 3843203 T11706 oasss.SolrSuggester.init init: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 3843205 T11706 oasss.SolrSuggester.init Dictionary loaded with params: {name=blended_infix_suggest_reciprocal,lookupImpl=BlendedInfixLookupFactory,dictionaryImpl=FileDictionaryFactory,buildOnCommit=false,sourceLocation=blendedInfixSuggest.txt,blenderType=reciprocal,suggestAnalyzerFieldType=text}
   [junit4]   2> 3843205 T11706 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 3843205 T11706 oasss.SolrSuggester.init init: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843206 T11706 oasss.SolrSuggester.init WARN Loading stored lookup data failed, possibly not cached yet
   [junit4]   2> 3843206 T11706 oasss.SolrSuggester.init Dictionary loaded with params: {name=fuzzy_suggest_analyzing_with_file_dict,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,dictionaryImpl=org.apache.solr.spelling.suggest.FileDictionaryFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843207 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843207 T11706 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843207 T11706 oasss.Suggester.init WARN Loading stored lookup data failed java.io.FileNotFoundException: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\fuzzy_suggest_analyzing\fwfsta.bin (The system cannot find the file specified)
   [junit4]   2> 	at java.io.FileInputStream.open(Native Method)
   [junit4]   2> 	at java.io.FileInputStream.<init>(FileInputStream.java:120)
   [junit4]   2> 	at org.apache.solr.spelling.suggest.Suggester.init(Suggester.java:116)
   [junit4]   2> 	at org.apache.solr.handler.component.SpellCheckComponent.inform(SpellCheckComponent.java:636)
   [junit4]   2> 	at org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:631)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:834)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.<init>(SolrCore.java:629)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.createFromLocal(CoreContainer.java:562)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer.create(CoreContainer.java:597)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:258)
   [junit4]   2> 	at org.apache.solr.core.CoreContainer$1.call(CoreContainer.java:250)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
   [junit4]   2> 	at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:138)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:662)
   [junit4]   2> 
   [junit4]   2> 3843208 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843209 T11706 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_max_edit_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_max_edit_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,maxEdits=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843210 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843211 T11706 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_non_fuzzy_prefix_4,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,nonFuzzyPrefix=4,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843212 T11706 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 3843213 T11706 oasss.Suggester.init init: {name=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,classname=org.apache.solr.spelling.suggest.Suggester,lookupImpl=org.apache.solr.spelling.suggest.fst.FuzzyLookupFactory,storeDir=fuzzy_suggest_analyzing_with_min_fuzzy_length_2,buildOnCommit=false,exactMatchFirst=true,suggestAnalyzerFieldType=text,preserveSep=false,minFuzzyLength=2,sourceLocation=fuzzysuggest.txt}
   [junit4]   2> 3843214 T11706 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 3843214 T11707 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@12e238e[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 3843222 T11705 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> ASYNC  NEW_CORE C10698 name=collection1 org.apache.solr.core.SolrCore@1aac1b7
   [junit4]   2> 3843223 T11705 C10698 oasss.Suggester.build build()
   [junit4]   2> 3843273 T11705 C10698 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=&qt=/infix_suggest_analyzing&spellcheck.build=true} status=0 QTime=51 
   [junit4]   2> 3843278 T11705 oas.SolrTestCaseJ4.setUp ###Starting testMultiple
   [junit4]   2> 3843279 T11705 C10698 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&spellcheck.count=2&qt=/infix_suggest_analyzing} status=0 QTime=1 
   [junit4]   2> 3843306 T11705 C10698 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&spellcheck.count=3&qt=/infix_suggest_analyzing} status=0 QTime=0 
   [junit4]   2> ASYNC  NEW_CORE C10699 name=collection1 org.apache.solr.core.SolrCore@1aac1b7
   [junit4]   2> 3843324 T11705 C10699 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&spellcheck.count=4&qt=/infix_suggest_analyzing} status=0 QTime=0 
   [junit4]   2> 3843329 T11705 oas.SolrTestCaseJ4.tearDown ###Ending testMultiple
   [junit4]   2> 3843336 T11705 oas.SolrTestCaseJ4.setUp ###Starting testSingle
   [junit4]   2> 3843337 T11705 C10699 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=japan&spellcheck.count=1&qt=/infix_suggest_analyzing} status=0 QTime=1 
   [junit4]   2> 3843342 T11705 C10699 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=high&spellcheck.count=1&qt=/infix_suggest_analyzing} status=0 QTime=2 
   [junit4]   2> 3843345 T11705 oas.SolrTestCaseJ4.tearDown ###Ending testSingle
   [junit4]   2> !!!! WARNING: best effort to remove C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\analyzingInfixSuggesterIndexDir\_0.fdt FAILED !!!!!
   [junit4]   2> 3843349 T11705 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 3843349 T11705 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=32665751
   [junit4]   2> 3843351 T11705 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@1aac1b7
   [junit4]   2> 3843352 T11705 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 3843352 T11705 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 3843352 T11705 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 3843352 T11705 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 3843352 T11705 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 3843353 T11705 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 3843353 T11705 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\;done=false>>]
   [junit4]   2> 3843353 T11705 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\
   [junit4]   2> 3843353 T11705 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index;done=false>>]
   [junit4]   2> 3843353 T11705 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-TestAnalyzeInfixSuggestions-1391946905700\index
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=DefaultSimilarity, locale=pl, timezone=Asia/Qatar
   [junit4]   2> NOTE: Windows 7 6.1 x86/Sun Microsystems Inc. 1.6.0_45 (32-bit)/cpus=2,threads=1,free=191424488,total=476995584
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, TestCodecSupport, TestManagedSchemaFieldResource, TestCharFilters, TestNumberUtils, EchoParamsTest, PolyFieldTest, FastVectorHighlighterTest, TestClassNameShortening, TestGroupingSearch, CollectionsAPIDistributedZkTest, TestSolrJ, TestAddFieldRealTimeGet, TestCloudManagedSchema, TestDistributedSearch, TestDistributedMissingSort, IndexSchemaRuntimeFieldTest, JSONWriterTest, MoreLikeThisHandlerTest, ExternalFileFieldSortTest, TestNRTOpen, StatsComponentTest, PathHierarchyTokenizerFactoryTest, LoggingHandlerTest, ResourceLoaderTest, WordBreakSolrSpellCheckerTest, TestJmxIntegration, TestRandomFaceting, ConvertedLegacyTest, TermVectorComponentTest, ShowFileRequestHandlerTest, ResponseLogComponentTest, SolrCoreTest, TestStressRecovery, TestJoin, TestAnalyzedSuggestions, TestInfoStreamLogging, DefaultValueUpdateProcessorTest, TestDFRSimilarityFactory, SpellPossibilityIteratorTest, TimeZoneUtilsTest, TestDynamicFieldResource, SuggesterFSTTest, TestRTGBase, DisMaxRequestHandlerTest, TestDocBasedVersionConstraints, SchemaVersionSpecificBehaviorTest, TestSuggestSpellingConverter, TestMaxScoreQueryParser, ZkControllerTest, CoreAdminHandlerTest, StandardRequestHandlerTest, SpellCheckCollatorTest, AutoCommitTest, CursorPagingTest, TestQueryTypes, NotRequiredUniqueKeyTest, PingRequestHandlerTest, OpenExchangeRatesOrgProviderTest, TestReversedWildcardFilterFactory, TestUpdate, TestFieldCollectionResource, DocValuesTest, DistributedTermsComponentTest, UUIDFieldTest, TestSerializedLuceneMatchVersion, TestDynamicFieldCollectionResource, RequiredFieldsTest, TestHashPartitioner, XmlUpdateRequestHandlerTest, URLClassifyProcessorTest, TestSystemIdResolver, MultiTermTest, TestOverriddenPrefixQueryForCustomFieldType, TestCollapseQParserPlugin, BlockCacheTest, TestSchemaNameResource, DocValuesMultiTest, DebugComponentTest, ZkSolrClientTest, TestRealTimeGet, TestImplicitCoreProperties, SimpleFacetsTest, BadComponentTest, BasicDistributedZk2Test, QueryResultKeyTest, TestBlendedInfixSuggestions, FileBasedSpellCheckerTest, TestDefaultSimilarityFactory, RecoveryZkTest, TestFreeTextSuggestions, SoftAutoCommitTest, ZkNodePropsTest, RegexBoostProcessorTest, ClusterStateTest, TestFieldResource, TestSolrXmlPersistence, DirectUpdateHandlerOptimizeTest, AddBlockUpdateTest, TestSolrQueryParserResource, LukeRequestHandlerTest, SolrCmdDistributorTest, SolrCoreCheckLockOnStartupTest, TestReloadAndDeleteDocs, SuggesterWFSTTest, ScriptEngineTest, DateMathParserTest, TestPartialUpdateDeduplication, SolrXmlInZkTest, CachingDirectoryFactoryTest, DeleteReplicaTest, ChaosMonkeyNothingIsSafeTest, TestManagedSchema, DirectSolrConnectionTest, TestBM25SimilarityFactory, TestSolrQueryParser, SpellingQueryConverterTest, TestArbitraryIndexDir, HighlighterTest, TestCollationKeyRangeQueries, DistributedSpellCheckComponentTest, TestIndexingPerformance, TestSchemaSimilarityResource, FileUtilsTest, TestLuceneMatchVersion, TestDefaultSearchFieldResource, TestDistributedGrouping, PrimitiveFieldTypeTest, TestShardHandlerFactory, DistributedQueryComponentCustomSortTest, SyncSliceTest, TestUniqueKeyFieldResource, SpatialFilterTest, ShardSplitTest, TestOmitPositions, CoreMergeIndexesAdminHandlerTest, TestSolrXmlPersistor, DocValuesMissingTest, OutputWriterTest, SuggestComponentTest, TestConfig, RequestHandlersTest, SolrIndexConfigTest, BasicFunctionalityTest, SpellCheckComponentTest, MBeansHandlerTest, TestFileDictionaryLookup, TestSearchPerf, TestRangeQuery, TestValueSourceCache, SuggesterTSTTest, TestSurroundQueryParser, HdfsUnloadDistributedZkTest, TestMergePolicyConfig, TestReplicationHandler, AddSchemaFieldsUpdateProcessorFactoryTest, SuggesterTest, OverseerCollectionProcessorTest, ParsingFieldUpdateProcessorsTest, OverseerRolesTest, LeaderElectionTest, DirectSolrSpellCheckerTest, TestExtendedDismaxParser, InfoHandlerTest, PreAnalyzedUpdateProcessorTest, EnumFieldTest, BasicZkTest, TestAtomicUpdateErrorCases, SearchHandlerTest, TestCollationField, DOMUtilTest, TestNonNRTOpen, DeleteShardTest, TestInitQParser, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, SliceStateUpdateTest, TestFaceting, TestRecovery, TermVectorComponentDistributedTest, TestStressReorder, TestMultiCoreConfBootstrap, TestReload, TestStressVersions, HardAutoCommitTest, TestCoreContainer, TestSolr4Spatial, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestSort, TestFiltering, TestFunctionQuery, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SolrRequestParserTest, TestFoldingMultitermQuery, TestStressLucene, TestTrie, TestCSVLoader, NoCacheHeaderTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestWriterPerf, DocumentAnalysisRequestHandlerTest, TermsComponentTest, DocumentBuilderTest, FieldAnalysisRequestHandlerTest, SolrPluginUtilsTest, IndexSchemaTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, TestSolrDeletionPolicy2, SampleTest, TestDocSet, TestBinaryField, NumericFieldsTest, MinimalSchemaTest, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, TestPostingsSolrHighlighter, TestPhraseSuggestions, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestIBSimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TestJmxMonitoredMap, TestFastOutputStream, PluginInfoTest, TestFastLRUCache, TestSolrXMLSerializer, PreAnalyzedFieldTest, PrimUtilsTest, DateFieldTest, RAMDirectoryFactoryTest, TestLRUCache, TestUtils, TestDocumentBuilder, SliceStateTest, SystemInfoHandlerTest, CircularListTest, SolrTestCaseJ4Test, TestCursorMarkWithoutUniqueKey, AliasIntegrationTest, AssignTest, ConnectionManagerTest, CustomCollectionTest, DistribCursorPagingTest, MigrateRouteKeyTest, RemoteQueryErrorTest, TestDistribDocBasedVersion, TriLevelCompositeIdRoutingTest, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, StressHdfsTest, TestSolrXml, CoreAdminCreateDiscoverTest, DistributedDebugComponentTest, DistributedSuggestComponentTest, TestCopyFieldCollectionResource, TestFieldTypeCollectionResource, TestFieldTypeResource, TestSchemaResource, TestSchemaVersionResource, TestSolrQueryParserDefaultOperatorResource, BadCopyFieldTest, ChangedSchemaMergeTest, TestCloudManagedSchemaAddField, TestCollationFieldDocValues, CursorMarkTest, TestCustomSort, TestNoOpRegenerator, TestRecoveryHdfs, TestSimpleQParserPlugin, TestStandardQParsers, TestStressUserVersions, BJQParserTest, TestAnalyzeInfixSuggestions]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestAnalyzeInfixSuggestions -Dtests.seed=3C205D6B94A4E59E -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=Asia/Qatar -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s | TestAnalyzeInfixSuggestions (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([3C205D6B94A4E59E]:0)
   [junit4]    > 	at org.apache.solr.spelling.suggest.TestAnalyzeInfixSuggestions.afterClass(TestAnalyzeInfixSuggestions.java:41)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:662)
   [junit4] Completed in 0.89s, 2 tests, 1 failure <<< FAILURES!

[...truncated 28 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 360 suites, 1558 tests, 2 suite-level errors, 43 ignored (15 assumptions)

Total time: 92 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.6.0_45 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-4.x-Windows (32bit/jdk1.8.0-fcs-b128) - Build # 3685 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-Windows/3685/
Java: 32bit/jdk1.8.0-fcs-b128 -client -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.OverseerRolesTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=1612, name=Overseer-91221205524873224-127.0.0.1:64141_h_tzr%2Fz-n_0000000002, state=RUNNABLE, group=Overseer collection creation process.]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1612, name=Overseer-91221205524873224-127.0.0.1:64141_h_tzr%2Fz-n_0000000002, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([31EB88733A88F3B1]:0)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
	at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
	at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
	at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
	... 1 more




Build Log:
[...truncated 10212 lines...]
   [junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
   [junit4]   2> 270647 T1455 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /h_tzr/z
   [junit4]   2> 270649 T1455 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\solrtest-OverseerRolesTest-1391925133126
   [junit4]   2> 270651 T1455 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 270652 T1456 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 270716 T1455 oasc.ZkTestServer.run start zk server on port:64113
   [junit4]   2> 270718 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 270722 T1462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d8235 name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 270723 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 270723 T1455 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 270729 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 270732 T1464 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1accc29 name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 270732 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 270733 T1455 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 270737 T1455 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 270741 T1455 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 270744 T1455 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 270748 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 270748 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 270754 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 270754 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 270758 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 270758 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 270763 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 270763 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 270767 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 270767 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 270774 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 270775 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 270780 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 270780 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 270790 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 270791 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 270797 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 270797 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 270802 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 270802 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 270809 T1455 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 270809 T1455 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 271172 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 271179 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64120
   [junit4]   2> 271179 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 271179 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 271179 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291
   [junit4]   2> 271179 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\'
   [junit4]   2> 271203 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\solr.xml
   [junit4]   2> 271211 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 271211 T1455 oasc.CoreContainer.<init> New CoreContainer 7892295
   [junit4]   2> 271212 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\]
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 271213 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 271214 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 271214 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 271217 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 271217 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 271217 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 271217 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 271219 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 271220 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 271224 T1475 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ef09d name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 271224 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 271227 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 271234 T1477 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7358 name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 271234 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 271236 T1455 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 271240 T1455 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 271244 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 271246 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64120_h_tzr%2Fz
   [junit4]   2> 271247 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64120_h_tzr%2Fz
   [junit4]   2> 271250 T1455 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 271253 T1455 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 271258 T1455 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:64120_h_tzr%2Fz
   [junit4]   2> 271258 T1455 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 271261 T1455 oasc.Overseer.start Overseer (id=91221205524873219-127.0.0.1:64120_h_tzr%2Fz-n_0000000000) starting
   [junit4]   2> 271265 T1455 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 271269 T1479 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 271270 T1455 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 271270 T1479 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 271273 T1455 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 271277 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 271281 T1478 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 271281 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291
   [junit4]   2> 271454 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\conf\
   [junit4]   2> 271463 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 271465 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 271465 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 271466 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 271468 T1482 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fabdf6 name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 271469 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 271470 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 271473 T1455 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 271811 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 271812 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 271814 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64132
   [junit4]   2> 271815 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 271815 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 271816 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949
   [junit4]   2> 271816 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\'
   [junit4]   2> 271837 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\solr.xml
   [junit4]   2> 271849 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 271849 T1455 oasc.CoreContainer.<init> New CoreContainer 11833714
   [junit4]   2> 271849 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\]
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 271850 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 271851 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 271851 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 271851 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 271854 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 271854 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 271854 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 271854 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 271854 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 271858 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 271863 T1493 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@157e63f name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 271864 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 271866 T1457 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441533ff4b0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 271867 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 271869 T1495 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ec6da0 name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 271870 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 271875 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 272524 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64132_h_tzr%2Fz
   [junit4]   2> 272525 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64132_h_tzr%2Fz
   [junit4]   2> 272531 T1477 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 272531 T1495 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 272532 T1482 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 272538 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949
   [junit4]   2> 272719 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\conf\
   [junit4]   2> 272727 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 272728 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 272728 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 273076 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 273077 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 273080 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64141
   [junit4]   2> 273080 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 273081 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 273081 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204
   [junit4]   2> 273081 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\'
   [junit4]   2> 273102 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\solr.xml
   [junit4]   2> 273112 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 273116 T1455 oasc.CoreContainer.<init> New CoreContainer 16855161
   [junit4]   2> 273116 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\]
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 273117 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 273118 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 273118 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 273120 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 273120 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 273120 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 273122 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 273122 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 273124 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 273129 T1507 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d684f5 name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273130 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 273134 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 273136 T1509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bba00c name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 273136 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 273142 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 273791 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64141_h_tzr%2Fz
   [junit4]   2> 273793 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64141_h_tzr%2Fz
   [junit4]   2> 273796 T1495 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 273797 T1477 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 273797 T1509 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 273797 T1482 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 273803 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204
   [junit4]   2> 273974 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\conf\
   [junit4]   2> 273982 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 273984 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 273984 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 274334 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 274334 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 274338 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64150
   [junit4]   2> 274338 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 274339 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 274339 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460
   [junit4]   2> 274339 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\'
   [junit4]   2> 274363 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\solr.xml
   [junit4]   2> 274376 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 274378 T1455 oasc.CoreContainer.<init> New CoreContainer 7606004
   [junit4]   2> 274378 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\]
   [junit4]   2> 274379 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 274379 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 274379 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 274379 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 274380 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 274380 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 274380 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 274380 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 274380 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 274385 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 274385 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 274385 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 274385 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 274385 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 274387 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 274391 T1521 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13b94f4 name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 274392 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 274395 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 274397 T1523 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12f5eba name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 274397 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 274402 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 275051 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64150_h_tzr%2Fz
   [junit4]   2> 275053 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64150_h_tzr%2Fz
   [junit4]   2> 275057 T1495 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 275057 T1523 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 275058 T1482 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 275058 T1509 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 275058 T1477 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 275062 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460
   [junit4]   2> 275233 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\conf\
   [junit4]   2> 275242 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 275242 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 275242 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 275595 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 275596 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 275599 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64159
   [junit4]   2> 275599 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 275600 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 275600 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719
   [junit4]   2> 275600 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\'
   [junit4]   2> 275621 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\solr.xml
   [junit4]   2> 275631 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 275632 T1455 oasc.CoreContainer.<init> New CoreContainer 31315486
   [junit4]   2> 275632 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\]
   [junit4]   2> 275632 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 275632 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 275633 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 275634 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 275637 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 275637 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 275637 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 275638 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 275638 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 275644 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 275653 T1535 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6b073 name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 275654 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 275657 T1457 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441533ff4b000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 275659 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 275661 T1537 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9f763c name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 275661 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 275667 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 276340 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64159_h_tzr%2Fz
   [junit4]   2> 276341 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64159_h_tzr%2Fz
   [junit4]   2> 276348 T1482 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276348 T1495 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276349 T1477 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276349 T1523 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276350 T1537 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276350 T1509 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 276359 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719
   [junit4]   2> 276547 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\conf\
   [junit4]   2> 276555 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 276557 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 276557 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 276928 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
   [junit4]   2> 276929 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 276932 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64168
   [junit4]   2> 276933 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 276933 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 276933 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034
   [junit4]   2> 276934 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\'
   [junit4]   2> 276957 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\solr.xml
   [junit4]   2> 276968 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 276968 T1455 oasc.CoreContainer.<init> New CoreContainer 5374166
   [junit4]   2> 276968 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\]
   [junit4]   2> 276969 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 276969 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 276969 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 276970 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 276974 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 276974 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 276975 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 276975 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 276975 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 276977 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 276988 T1549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f25cc0 name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 276989 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 276993 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 276995 T1551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@124c2bc name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 276996 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 277002 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 277717 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64168_h_tzr%2Fz
   [junit4]   2> 277720 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64168_h_tzr%2Fz
   [junit4]   2> 277726 T1509 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277726 T1551 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277727 T1523 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277727 T1482 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277728 T1495 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277729 T1477 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277729 T1537 oascc.ZkStateReader$3.process Updating live nodes... (6)
   [junit4]   2> 277740 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034
   [junit4]   2> 277925 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\conf\
   [junit4]   2> 277934 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 277935 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 277935 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 278299 T1455 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
   [junit4]   2> 278299 T1455 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 278304 T1455 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:64177
   [junit4]   2> 278304 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 278304 T1455 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 278304 T1455 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411
   [junit4]   2> 278305 T1455 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\'
   [junit4]   2> 278328 T1455 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\solr.xml
   [junit4]   2> 278339 T1455 oasc.ConfigSolrXml.<init> Config-defined core root directory: 
   [junit4]   2> 278340 T1455 oasc.CoreContainer.<init> New CoreContainer 4200636
   [junit4]   2> 278340 T1455 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\]
   [junit4]   2> 278340 T1455 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 278340 T1455 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
   [junit4]   2> 278340 T1455 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 278341 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 278341 T1455 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 278341 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 278342 T1455 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 278342 T1455 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 278342 T1455 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 278345 T1455 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 278345 T1455 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 278346 T1455 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 278347 T1455 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:64113/solr
   [junit4]   2> 278347 T1455 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 278348 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 278353 T1563 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@136fbee name:ZooKeeperConnection Watcher:127.0.0.1:64113 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 278354 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 278357 T1457 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1441533ff4b000f, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 278358 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 278361 T1565 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@93482c name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 278362 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 278368 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 279082 T1455 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:64177_h_tzr%2Fz
   [junit4]   2> 279085 T1455 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:64177_h_tzr%2Fz
   [junit4]   2> 279093 T1537 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279094 T1523 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279094 T1477 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279094 T1495 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279094 T1551 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279095 T1565 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279095 T1509 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279096 T1482 oascc.ZkStateReader$3.process Updating live nodes... (7)
   [junit4]   2> 279106 T1455 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411
   [junit4]   2> 279288 T1455 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\conf\
   [junit4]   2> 279298 T1455 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 279299 T1455 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 279299 T1455 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 279301 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 279304 T1568 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@101b7ae name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 279304 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 279305 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 279310 T1455 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 279313 T1570 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eed0ca name:ZooKeeperConnection Watcher:127.0.0.1:64113/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 279313 T1455 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 279315 T1455 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 279324 T1471 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=testOverseerCol&action=CREATE&numShards=4&wt=javabin&version=2
   [junit4]   2> 279326 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279329 T1479 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 279329 T1479 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"testOverseerCol",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "maxShardsPerNode":"2"}
   [junit4]   2> 279331 T1479 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 279331 T1479 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol 
   [junit4]   2> 279331 T1479 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
   [junit4]   2> 279337 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279339 T1478 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 279340 T1478 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
   [junit4]   2> 279340 T1478 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
   [junit4]   2> 279343 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279345 T1509 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279345 T1482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279345 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279346 T1523 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279346 T1477 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279346 T1570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279345 T1568 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279345 T1495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279345 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279347 T1537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279408 T1479 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
   [junit4]   2> 279408 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:64177_h_tzr%2Fz
   [junit4]   2> 279410 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:64120_h_tzr%2Fz
   [junit4]   2> 279413 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:64168_h_tzr%2Fz
   [junit4]   2> 279413 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:64132_h_tzr%2Fz
   [junit4]   2> 279413 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:64159_h_tzr%2Fz
   [junit4]   2> 279417 T1472 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
   [junit4]   2> 279417 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:64141_h_tzr%2Fz
   [junit4]   2> 279418 T1557 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
   [junit4]   2> 279418 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:64150_h_tzr%2Fz
   [junit4]   2> 279420 T1546 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
   [junit4]   2> 279422 T1472 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279422 T1528 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
   [junit4]   2> 279422 T1557 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279424 T1505 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
   [junit4]   2> 279422 T1488 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
   [junit4]   2> 279426 T1546 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279422 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279426 T1488 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279422 T1479 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:64177_h_tzr%2Fz
   [junit4]   2> 279426 T1528 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279427 T1505 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279427 T1517 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
   [junit4]   2> 279430 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279430 T1517 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279431 T1478 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 279431 T1559 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
   [junit4]   2> 279431 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64120/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64120_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279433 T1559 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 279438 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64177/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64177_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279441 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279442 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64168/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64168_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279446 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279447 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64159/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64159_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279450 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279451 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64141/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard3_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64141_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279455 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279456 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64132/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64132_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279459 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279460 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64150/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64150_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279464 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279465 T1478 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:64177/h_tzr/z",
   [junit4]   2> 	  "core":"testOverseerCol_shard4_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:64177_h_tzr%2Fz",
   [junit4]   2> 	  "shard":"shard4",
   [junit4]   2> 	  "shard_range":null,
   [junit4]   2> 	  "shard_state":"active",
   [junit4]   2> 	  "shard_parent":null,
   [junit4]   2> 	  "collection":"testOverseerCol",
   [junit4]   2> 	  "numShards":"4",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 279468 T1477 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 279544 T1509 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1565 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1495 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1523 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1477 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1570 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1482 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279544 T1568 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 279545 T1537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
   [junit4]   2> 280133 T1472 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
   [junit4]   2> 280135 T1557 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
   [junit4]   2> 280135 T1472 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\testOverseerCol_shard1_replica2
   [junit4]   2> 280135 T1472 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280137 T1546 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
   [junit4]   2> 280137 T1546 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\testOverseerCol_shard2_replica1
   [junit4]   2> 280137 T1546 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280138 T1472 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280138 T1472 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280139 T1505 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
   [junit4]   2> 280140 T1546 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280140 T1546 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280141 T1505 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\testOverseerCol_shard3_replica2
   [junit4]   2> 280141 T1505 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280138 T1557 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\testOverseerCol_shard1_replica1
   [junit4]   2> 280142 T1557 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280142 T1517 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
   [junit4]   2> 280142 T1505 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280142 T1505 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280144 T1557 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280144 T1557 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280141 T1528 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
   [junit4]   2> 280145 T1546 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280145 T1546 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty5-1391925139034\testOverseerCol_shard2_replica1\'
   [junit4]   2> 280141 T1488 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
   [junit4]   2> 280146 T1488 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\testOverseerCol_shard2_replica2
   [junit4]   2> 280147 T1488 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280145 T1559 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
   [junit4]   2> 280149 T1559 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\testOverseerCol_shard4_replica2
   [junit4]   2> 280150 T1559 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280151 T1505 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280151 T1505 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty2-1391925135204\testOverseerCol_shard3_replica2\'
   [junit4]   2> 280145 T1517 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\testOverseerCol_shard4_replica1
   [junit4]   2> 280151 T1517 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280144 T1472 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280151 T1472 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-controljetty-1391925133291\testOverseerCol_shard1_replica2\'
   [junit4]   2> 280152 T1559 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280152 T1559 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280153 T1557 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280153 T1557 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\testOverseerCol_shard1_replica1\'
   [junit4]   2> 280158 T1517 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280158 T1517 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280158 T1528 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1
   [junit4]   2> 280160 T1528 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
   [junit4]   2> 280161 T1488 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280161 T1488 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280166 T1528 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 280166 T1528 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
   [junit4]   2> 280169 T1559 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280169 T1559 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.OverseerRolesTest-jetty6-1391925140411\testOverseerCol_shard4_replica2\'
   [junit4]   2> 280169 T1517 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280169 T1517 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty3-1391925136460\testOverseerCol_shard4_replica1\'
   [junit4]   2> 280182 T1488 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280182 T1488 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty1-1391925133949\testOverseerCol_shard2_replica2\'
   [junit4]   2> 280190 T1528 oascc.ZkStateReader.readConfigName path=/collections/testOverseerCol configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 280201 T1528 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\'
   [junit4]   2> 280242 T1546 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280250 T1546 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280253 T1505 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280266 T1559 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280269 T1505 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280279 T1559 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280289 T1517 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280304 T1517 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280305 T1557 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280307 T1472 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280316 T1559 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280322 T1472 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280323 T1559 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
   [junit4]   2> 280325 T1557 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280327 T1505 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280341 T1505 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
   [junit4]   2> 280353 T1546 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280359 T1546 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
   [junit4]   2> 280437 T1557 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280443 T1557 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
   [junit4]   2> 280455 T1472 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280460 T1472 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
   [junit4]   2> 280507 T1488 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280560 T1505 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280560 T1505 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280561 T1505 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280566 T1505 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280567 T1505 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280585 T1546 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280586 T1546 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280588 T1546 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280591 T1546 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280592 T1546 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280602 T1517 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280607 T1517 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
   [junit4]   2> 280608 T1528 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
   [junit4]   2> 280652 T1559 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280653 T1559 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280653 T1559 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280656 T1559 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280658 T1559 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280686 T1528 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280689 T1472 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280690 T1472 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280691 T1472 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280696 T1472 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280705 T1472 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280712 T1488 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 280803 T1557 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280803 T1557 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280805 T1557 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280813 T1557 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280814 T1557 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280819 T1528 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280819 T1517 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280819 T1517 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280821 T1517 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280823 T1517 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280823 T1528 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
   [junit4]   2> 280823 T1517 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280833 T1488 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 280849 T1488 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
   [junit4]   2> 280984 T1528 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280984 T1528 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 280986 T1528 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 280988 T1528 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 280997 T1528 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 280999 T1488 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 281000 T1488 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
   [junit4]   2> 281000 T1488 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 281006 T1488 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 281008 T1488 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 281016 T1559 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281018 T1557 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281019 T1517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281022 T1559 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281032 T1557 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281033 T1517 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281034 T1559 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 281036 T1505 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 281038 T1557 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 281040 T1517 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 281040 T1559 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 281040 T1559 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 281041 T1559 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates 

[...truncated too long message...]

stOverseerCol_shard3_replica1\data\index [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\data\index;done=false>>]
   [junit4]   2> 288190 T1537 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\data\index
   [junit4]   2> 288190 T1537 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\data\;done=false>>]
   [junit4]   2> 288190 T1537 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.OverseerRolesTest-jetty4-1391925137719\testOverseerCol_shard3_replica1\data\
   [junit4]   2> 288191 T1537 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leaders/shard3
   [junit4]   2> 288191 T1537 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 288191 T1537 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard3/election/91221205524873228-core_node4-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 288193 T1537 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 288194 T1537 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 288194 T1537 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 288194 T1537 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 17548 T1454 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ms, timezone=America/Montreal
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=1,free=32365776,total=118861824
   [junit4]   2> NOTE: All tests run in this JVM: [TestRandomDVFaceting, UpdateParamsTest, DistanceFunctionTest, TestDynamicFieldResource, SolrCmdDistributorTest, TestSolrQueryParser, HdfsUnloadDistributedZkTest, WordBreakSolrSpellCheckerTest, TestCloudManagedSchema, TestBinaryResponseWriter, DirectSolrConnectionTest, TestLuceneMatchVersion, ZkSolrClientTest, SimplePostToolTest, CoreAdminCreateDiscoverTest, SuggesterWFSTTest, SolrCoreCheckLockOnStartupTest, FieldMutatingUpdateProcessorTest, SuggesterTest, TestNRTOpen, TestCollationField, TestFunctionQuery, SolrInfoMBeanTest, HdfsCollectionsAPIDistributedZkTest, TestImplicitCoreProperties, TestReplicationHandler, TestValueSourceCache, TestDFRSimilarityFactory, SpatialFilterTest, TermVectorComponentTest, TestCSVLoader, TestFieldTypeResource, TestPseudoReturnFields, TestSolrJ, CursorPagingTest, DirectSolrSpellCheckerTest, TestCollationKeyRangeQueries, TestRecoveryHdfs, InfoHandlerTest, XmlUpdateRequestHandlerTest, TestSurroundQueryParser, DistributedDebugComponentTest, TestFieldTypeCollectionResource, TestFiltering, TestFastWriter, TestDocSet, PathHierarchyTokenizerFactoryTest, AddBlockUpdateTest, BasicFunctionalityTest, TestInitQParser, BJQParserTest, SignatureUpdateProcessorFactoryTest, TestTrie, IndexSchemaTest, StressHdfsTest, ZkNodePropsTest, TestSolrDeletionPolicy2, EnumFieldTest, TestSolrQueryParserResource, OpenCloseCoreStressTest, LoggingHandlerTest, PrimUtilsTest, TestPHPSerializedResponseWriter, SpellCheckComponentTest, DocumentBuilderTest, OverseerRolesTest]
   [junit4] Completed in 17.77s, 1 test, 1 error <<< FAILURES!

[...truncated 914 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:459: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:439: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:1308: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-4.x-Windows\lucene\common-build.xml:941: There were test failures: 359 suites, 1555 tests, 1 error, 40 ignored (12 assumptions)

Total time: 73 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b128 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure