You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/31 21:58:32 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b15) - Build # 4078 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/4078/
Java: 64bit/jdk1.7.0_60-ea-b15 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.ReplicationFactorTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([DF1AECC70B9A00AA]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([DF1AECC70B9A00AA]:0)




Build Log:
[...truncated 10626 lines...]
   [junit4] Suite: org.apache.solr.cloud.ReplicationFactorTest
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\init-core-data-001
   [junit4]   2> 58271 T128 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_d/
   [junit4]   2> 58276 T128 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 58283 T128 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 58289 T129 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 58493 T128 oasc.ZkTestServer.run start zk server on port:65338
   [junit4]   2> 58670 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 58789 T135 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4074ca7c name:ZooKeeperConnection Watcher:127.0.0.1:65338 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 58790 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 58795 T128 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 58882 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 58885 T137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c63cef9 name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 58885 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 58890 T128 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 58897 T128 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 58903 T128 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 58909 T128 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 58916 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 58918 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 58928 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 58928 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 58938 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 58938 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 58946 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 58946 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 58954 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 58954 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 58963 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 58964 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 58972 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 58972 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 58981 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 58982 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 58994 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 58995 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 59003 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 59004 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 59011 T128 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 59012 T128 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 59029 T130 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146536c9ec30001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 61189 T128 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 61196 T128 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65346
   [junit4]   2> 61197 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 61198 T128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 61198 T128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002
   [junit4]   2> 61198 T128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002\'
   [junit4]   2> 61235 T128 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002\solr.xml
   [junit4]   2> 61302 T128 oasc.CoreContainer.<init> New CoreContainer 1821553057
   [junit4]   2> 61303 T128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002\]
   [junit4]   2> 61304 T128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 61305 T128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 61305 T128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 61305 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 61306 T128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 61306 T128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 61307 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 61307 T128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 61307 T128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 61308 T128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 61309 T128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 61309 T128 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 61310 T128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65338/solr
   [junit4]   2> 61342 T128 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 61344 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 61348 T148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@112696ed name:ZooKeeperConnection Watcher:127.0.0.1:65338 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 61349 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 61365 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 61367 T150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76f85a0f name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 61367 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 61384 T128 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 61399 T128 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 61411 T128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 61421 T128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 61428 T128 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 61448 T128 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 61452 T128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65345__d
   [junit4]   2> 61459 T128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65345__d
   [junit4]   2> 61471 T128 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 61480 T128 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 61508 T128 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:65345__d
   [junit4]   2> 61509 T128 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 61516 T128 oasc.Overseer.start Overseer (id=91852568392826883-127.0.0.1:65345__d-n_0000000000) starting
   [junit4]   2> 61541 T128 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 61595 T152 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 61597 T128 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 61600 T128 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 61605 T128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 61634 T151 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 61707 T153 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 61708 T153 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 61719 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 61719 T153 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 61729 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 61731 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65345/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65345__d",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 61731 T151 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 61754 T151 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 61763 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 61777 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 62711 T153 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 62712 T153 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 62714 T153 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 62714 T153 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 62718 T153 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 62719 T153 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002\collection1\'
   [junit4]   2> 62719 T153 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 62722 T153 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 62722 T153 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 62859 T153 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 62909 T153 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 62913 T153 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 62924 T153 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 63332 T153 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 63346 T153 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 63349 T153 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 63378 T153 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 63384 T153 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 63390 T153 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 63392 T153 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 63393 T153 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 63393 T153 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 63397 T153 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 63397 T153 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 63397 T153 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 63397 T153 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 63398 T153 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-002\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/control/data\
   [junit4]   2> 63399 T153 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df758a7
   [junit4]   2> 63409 T153 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/control/data\
   [junit4]   2> 63409 T153 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/control/data\index/
   [junit4]   2> 63409 T153 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 63410 T153 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/control/data\index
   [junit4]   2> 63411 T153 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=2003117287, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 63412 T153 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@20bc27d9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f2ed504),segFN=segments_1,generation=1}
   [junit4]   2> 63412 T153 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 63425 T153 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 63477 T153 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 63478 T153 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 63478 T153 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 63478 T153 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 63479 T153 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 63479 T153 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 63480 T153 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 63480 T153 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 63480 T153 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 63481 T153 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 63481 T153 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 63482 T153 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 63483 T153 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 63484 T153 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 63484 T153 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 63485 T153 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 63497 T153 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 63504 T153 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 63504 T153 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 63505 T153 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2554467243037058]
   [junit4]   2> 63505 T153 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@20bc27d9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f2ed504),segFN=segments_1,generation=1}
   [junit4]   2> 63505 T153 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 63506 T153 oass.SolrIndexSearcher.<init> Opening Searcher@34ca6c3e[collection1] main
   [junit4]   2> 63506 T153 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 63509 T153 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 63509 T153 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 63518 T153 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 63518 T153 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 63518 T153 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 63520 T153 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 63520 T153 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 63520 T153 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 63520 T153 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 63531 T154 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@34ca6c3e[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 63537 T153 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 63539 T157 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65345/_d collection:control_collection shard:shard1
   [junit4]   2> 63540 T128 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 63540 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 63560 T157 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 63567 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 63570 T160 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@322c21a0 name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 63570 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 63573 T128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 63578 T157 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 63583 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63584 T157 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 63584 T128 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 63584 T157 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C17 name=collection1 org.apache.solr.core.SolrCore@7fa229ca url=http://127.0.0.1:65345/_d/collection1 node=127.0.0.1:65345__d C17_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:65345/_d, core=collection1, node_name=127.0.0.1:65345__d}
   [junit4]   2> 63588 T157 C17 P65345 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65345/_d/collection1/
   [junit4]   2> 63588 T157 C17 P65345 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 63588 T157 C17 P65345 oasc.SyncStrategy.syncToMe http://127.0.0.1:65345/_d/collection1/ has no replicas
   [junit4]   2> 63589 T157 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65345/_d/collection1/ shard1
   [junit4]   2> 63595 T157 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 63600 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 63614 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63617 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63618 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63634 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 63641 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63756 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63757 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63769 T157 oasc.ZkController.register We are http://127.0.0.1:65345/_d/collection1/ and leader is http://127.0.0.1:65345/_d/collection1/
   [junit4]   2> 63769 T157 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65345/_d
   [junit4]   2> 63769 T157 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 63769 T157 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 63769 T157 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 63774 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63774 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63774 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63775 T157 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 63777 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 63778 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65345/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65345__d",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 63784 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 63899 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 63900 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 65311 T128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 65312 T128 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 65316 T128 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65359
   [junit4]   2> 65318 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 65318 T128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 65318 T128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003
   [junit4]   2> 65318 T128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003\'
   [junit4]   2> 65346 T128 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003\solr.xml
   [junit4]   2> 65404 T128 oasc.CoreContainer.<init> New CoreContainer 968730223
   [junit4]   2> 65404 T128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003\]
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 65407 T128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 65409 T128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 65409 T128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 65409 T128 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 65409 T128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65338/solr
   [junit4]   2> 65409 T128 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 65413 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 65426 T171 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51f9df06 name:ZooKeeperConnection Watcher:127.0.0.1:65338 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 65426 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 65431 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 65434 T173 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78bc1b9c name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 65435 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 65451 T128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 66350 T128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65358__d
   [junit4]   2> 66353 T128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65358__d
   [junit4]   2> 66388 T174 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 66389 T174 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 66392 T174 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 66392 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 66393 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 66393 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 66397 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 66399 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65358/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65358__d",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 66399 T151 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 66400 T151 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 66407 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 66409 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 66409 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 66409 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 67283 T174 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 67283 T174 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 67284 T174 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 67284 T174 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 67287 T174 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 67287 T174 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003\collection1\'
   [junit4]   2> 67290 T174 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 67290 T174 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 67290 T174 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 67350 T174 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 67398 T174 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 67401 T174 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 67411 T174 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 67818 T174 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 67827 T174 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 67830 T174 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 67859 T174 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 67865 T174 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 67870 T174 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 67872 T174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 67874 T174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 67874 T174 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 67875 T174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 67876 T174 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 67876 T174 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 67876 T174 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 67877 T174 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-003\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty1\
   [junit4]   2> 67877 T174 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df758a7
   [junit4]   2> 67878 T174 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty1\
   [junit4]   2> 67878 T174 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty1\index/
   [junit4]   2> 67879 T174 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 67879 T174 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty1\index
   [junit4]   2> 67880 T174 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=2003117287, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 67880 T174 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@397d29ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76677710),segFN=segments_1,generation=1}
   [junit4]   2> 67880 T174 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 67890 T174 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 67891 T174 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 67891 T174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 67891 T174 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 67892 T174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 67892 T174 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 67892 T174 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 67893 T174 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 67893 T174 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 67894 T174 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 67895 T174 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 67895 T174 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 67896 T174 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 67897 T174 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 67898 T174 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 67900 T174 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 67900 T174 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 67910 T174 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 67915 T174 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 67915 T174 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 67917 T174 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2554467243037058]
   [junit4]   2> 67919 T174 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@397d29ec lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@76677710),segFN=segments_1,generation=1}
   [junit4]   2> 67919 T174 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 67920 T174 oass.SolrIndexSearcher.<init> Opening Searcher@6cd2587d[collection1] main
   [junit4]   2> 67920 T174 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 67922 T174 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 67922 T174 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 67925 T174 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 67925 T174 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 67925 T174 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 67931 T174 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 67931 T174 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 67931 T174 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 67931 T174 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 67944 T175 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6cd2587d[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 67954 T174 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 67954 T178 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65358/_d collection:collection1 shard:shard2
   [junit4]   2> 67956 T128 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 67957 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 67959 T178 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 67981 T178 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 67992 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 67995 T178 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 67995 T178 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C18 name=collection1 org.apache.solr.core.SolrCore@31e0fc8 url=http://127.0.0.1:65358/_d/collection1 node=127.0.0.1:65358__d C18_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:65358/_d, core=collection1, node_name=127.0.0.1:65358__d}
   [junit4]   2> 67995 T178 C18 P65358 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65358/_d/collection1/
   [junit4]   2> 67998 T178 C18 P65358 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 67998 T178 C18 P65358 oasc.SyncStrategy.syncToMe http://127.0.0.1:65358/_d/collection1/ has no replicas
   [junit4]   2> 68001 T178 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65358/_d/collection1/ shard2
   [junit4]   2> 68001 T178 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 68015 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 68030 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68036 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68039 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68040 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68063 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 68078 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68182 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68184 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68185 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68199 T178 oasc.ZkController.register We are http://127.0.0.1:65358/_d/collection1/ and leader is http://127.0.0.1:65358/_d/collection1/
   [junit4]   2> 68199 T178 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65358/_d
   [junit4]   2> 68199 T178 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 68199 T178 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 68199 T178 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 68203 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68203 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68203 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68206 T178 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 68209 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 68210 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65358/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65358__d",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 68216 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 68312 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68313 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 68314 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 69841 T128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 69842 T128 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 69846 T128 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65369
   [junit4]   2> 69848 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 69849 T128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 69849 T128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004
   [junit4]   2> 69849 T128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004\'
   [junit4]   2> 69878 T128 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004\solr.xml
   [junit4]   2> 69937 T128 oasc.CoreContainer.<init> New CoreContainer 1157091295
   [junit4]   2> 69937 T128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004\]
   [junit4]   2> 69938 T128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 69939 T128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 69939 T128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 69940 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 69940 T128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 69940 T128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 69941 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 69941 T128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 69941 T128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 69942 T128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 69943 T128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 69943 T128 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 69943 T128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65338/solr
   [junit4]   2> 69943 T128 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 69945 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 69955 T190 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@69705cd8 name:ZooKeeperConnection Watcher:127.0.0.1:65338 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 69956 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 69960 T130 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x146536c9ec30007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> 69963 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 69966 T192 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4cd700cd name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 69966 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 69985 T128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 70883 T128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65368__d
   [junit4]   2> 70887 T128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65368__d
   [junit4]   2> 70912 T193 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 70913 T193 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 70915 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 70915 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 70915 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 70915 T193 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 70919 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 70921 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65368/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65368__d",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 70921 T151 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 70921 T151 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 70929 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 70931 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 70931 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 70932 T192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 70932 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 71807 T193 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 71807 T193 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 71809 T193 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 71809 T193 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 71812 T193 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 71812 T193 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004\collection1\'
   [junit4]   2> 71812 T193 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 71814 T193 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 71814 T193 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/temp/solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 71872 T193 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
   [junit4]   2> 71917 T193 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 71920 T193 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 71930 T193 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 72341 T193 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 72351 T193 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 72354 T193 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 72384 T193 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 72390 T193 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 72396 T193 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 72399 T193 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 72400 T193 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 72400 T193 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 72402 T193 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 72402 T193 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 72402 T193 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 72402 T193 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 72404 T193 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-004\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty2\
   [junit4]   2> 72404 T193 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5df758a7
   [junit4]   2> 72406 T193 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty2\
   [junit4]   2> 72406 T193 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty2\index/
   [junit4]   2> 72406 T193 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 72407 T193 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-001/jetty2\index
   [junit4]   2> 72407 T193 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=2003117287, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 72408 T193 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5609277d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fa7c7d7),segFN=segments_1,generation=1}
   [junit4]   2> 72409 T193 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 72417 T193 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 72418 T193 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 72418 T193 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 72418 T193 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 72422 T193 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 72422 T193 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 72423 T193 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 72423 T193 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 72423 T193 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 72425 T193 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 72427 T193 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 72427 T193 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 72427 T193 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 72429 T193 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 72430 T193 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 72432 T193 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 72432 T193 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 72441 T193 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 72448 T193 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 72448 T193 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 72454 T193 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2554467243037058]
   [junit4]   2> 72454 T193 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5609277d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6fa7c7d7),segFN=segments_1,generation=1}
   [junit4]   2> 72454 T193 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 72455 T193 oass.SolrIndexSearcher.<init> Opening Searcher@5cd408b7[collection1] main
   [junit4]   2> 72455 T193 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 72467 T193 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 72467 T193 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 72469 T193 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 72469 T193 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 72469 T193 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 72471 T193 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 72471 T193 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 72471 T193 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
   [junit4]   2> 72472 T193 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 72478 T194 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5cd408b7[collection1] main{UninvertingDirectoryReader()}
   [junit4]   2> 72484 T193 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 72487 T197 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:65368/_d collection:collection1 shard:shard1
   [junit4]   2> 72488 T128 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 72488 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 72491 T197 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 72507 T197 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 72512 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72516 T197 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 72516 T197 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C19 name=collection1 org.apache.solr.core.SolrCore@688a7372 url=http://127.0.0.1:65368/_d/collection1 node=127.0.0.1:65368__d C19_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:65368/_d, core=collection1, node_name=127.0.0.1:65368__d}
   [junit4]   2> 72516 T197 C19 P65368 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:65368/_d/collection1/
   [junit4]   2> 72516 T197 C19 P65368 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 72517 T197 C19 P65368 oasc.SyncStrategy.syncToMe http://127.0.0.1:65368/_d/collection1/ has no replicas
   [junit4]   2> 72517 T197 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:65368/_d/collection1/ shard1
   [junit4]   2> 72517 T197 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 72522 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 72534 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72540 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72541 T192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72541 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72542 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72560 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 72566 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72672 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72673 T192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72674 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72674 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72700 T197 oasc.ZkController.register We are http://127.0.0.1:65368/_d/collection1/ and leader is http://127.0.0.1:65368/_d/collection1/
   [junit4]   2> 72700 T197 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:65368/_d
   [junit4]   2> 72700 T197 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 72701 T197 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 72701 T197 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 72707 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72707 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72707 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72709 T197 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 72713 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 72716 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65368/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65368__d",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 72726 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 72831 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72832 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72832 T192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 72832 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 74605 T128 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 74606 T128 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 74611 T128 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:65379
   [junit4]   2> 74613 T128 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 74614 T128 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 74614 T128 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-005
   [junit4]   2> 74614 T128 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-005\'
   [junit4]   2> 74648 T128 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-005\solr.xml
   [junit4]   2> 74713 T128 oasc.CoreContainer.<init> New CoreContainer 2066236006
   [junit4]   2> 74713 T128 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\temp\solr.cloud.ReplicationFactorTest-DF1AECC70B9A00AA-001\tempDir-005\]
   [junit4]   2> 74714 T128 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 74715 T128 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 74715 T128 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 74716 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 74716 T128 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 74716 T128 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 74717 T128 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 74717 T128 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 74717 T128 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 74718 T128 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 74719 T128 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 74719 T128 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 74719 T128 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:65338/solr
   [junit4]   2> 74720 T128 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 74722 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 74728 T209 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@101f75b5 name:ZooKeeperConnection Watcher:127.0.0.1:65338 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 74729 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 74735 T128 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 74739 T211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94e3f28 name:ZooKeeperConnection Watcher:127.0.0.1:65338/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 74740 T128 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 74763 T128 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 75752 T128 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:65378__d
   [junit4]   2> 75754 T128 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:65378__d
   [junit4]   2> 75784 T212 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 75785 T212 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 75788 T212 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 75788 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 75789 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 75790 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 75794 T151 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 75796 T151 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:65378/_d",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:65378__d",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 75796 T151 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 75796 T151 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 75807 T150 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 75811 T192 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 75812 T211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 75813 T173 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 75813 T150 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 75814 T160 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 76769 T212 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 76769 T212 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collecti

[...truncated too long message...]

ing.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   2) Thread[id=216, name=coreZkRegister-141-thread-1, state=WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   3) Thread[id=210, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[DF1AECC70B9A00AA]-SendThread(127.0.0.1:65338), state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 	   4) Thread[id=200, name=qtp2129313393-200 Selector0, state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.setWakeupSocket(WindowsSelectorImpl.java:464)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.wakeup(WindowsSelectorImpl.java:606)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:210)
   [junit4]   2> 	        at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:216)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:157)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
   [junit4]   2> 	        at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   5) Thread[id=337, name=searcherExecutor-161-thread-1, state=TERMINATED, group={null group}]
   [junit4]   2> 	        at sun.misc.Unsafe.park(Native Method)
   [junit4]   2> 	        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
   [junit4]   2> 	        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
   [junit4]   2> 	        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2> 	        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 	   6) Thread[id=199, name=HashSessionScavenger-7, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> 	   7) Thread[id=159, name=TEST-ReplicationFactorTest.testDistribSearch-seed#[DF1AECC70B9A00AA]-SendThread(127.0.0.1:65338), state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll0(Native Method)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.poll(WindowsSelectorImpl.java:296)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl$SubSelector.access$400(WindowsSelectorImpl.java:278)
   [junit4]   2> 	        at sun.nio.ch.WindowsSelectorImpl.doSelect(WindowsSelectorImpl.java:159)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
   [junit4]   2> 	        at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:349)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1081)
   [junit4]   2> 	   8) Thread[id=201, name=qtp2129313393-201 Acceptor0 SelectChannelConnector@127.0.0.1:65379, state=RUNNABLE, group=TGRP-ReplicationFactorTest]
   [junit4]   2> 	        at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:956)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	        at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_CO, timezone=Asia/Omsk
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=12,free=88679456,total=285212672
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsDirectoryTest, LukeRequestHandlerTest, TestLuceneMatchVersion, TestSchemaNameResource, OpenExchangeRatesOrgProviderTest, TestQuerySenderListener, JSONWriterTest, TestExtendedDismaxParser, HighlighterTest, TestSearchPerf, TestFieldTypeResource, TestReversedWildcardFilterFactory, EchoParamsTest, TestManagedSynonymFilterFactory, DateFieldTest, ResponseHeaderTest, ReplicationFactorTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ReplicationFactorTest -Dtests.seed=DF1AECC70B9A00AA -Dtests.slow=true -Dtests.locale=es_CO -Dtests.timezone=Asia/Omsk -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s | ReplicationFactorTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([DF1AECC70B9A00AA]:0)
   [junit4] Completed in 7262.23s, 1 test, 2 errors <<< FAILURES!

[...truncated 1172 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:467: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:447: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:45: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:496: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1296: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 suite-level error, 1 error, 1513 ignored (8 assumptions)

Total time: 157 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b15 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure