You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/19 08:05:42 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0-fcs-b129) - Build # 3795 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3795/
Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Captured an uncaught exception in thread: Thread[id=6391, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=6391, name=RecoveryThread, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
	at __randomizedtesting.SeedInfo.seed([ACBB864637FE7F8C:2D5D085E40A11FB0]:0)
Caused by: java.lang.AssertionError: file _0.si does not exist
	at __randomizedtesting.SeedInfo.seed([ACBB864637FE7F8C]:0)
	at org.apache.lucene.index.IndexWriter.filesExist(IndexWriter.java:4302)
	at org.apache.lucene.index.IndexWriter.startCommit(IndexWriter.java:4368)
	at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2865)
	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2961)
	at org.apache.lucene.index.IndexWriter.commit(IndexWriter.java:2928)
	at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:578)
	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:396)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:247)


REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
	at __randomizedtesting.SeedInfo.seed([ACBB864637FE7F8C:2D5D085E40A11FB0]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:785)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:201)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10901 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 1268999 T6051 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1268999 T6051 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_/i
   [junit4]   2> 1269003 T6051 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392792086188
   [junit4]   2> 1269004 T6051 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1269006 T6052 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1269112 T6051 oasc.ZkTestServer.run start zk server on port:50899
   [junit4]   2> 1269114 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269128 T6058 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76a6efd0 name:ZooKeeperConnection Watcher:127.0.0.1:50899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1269128 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1269128 T6051 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1269142 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269166 T6060 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@255543da name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1269166 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1269166 T6051 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1269170 T6051 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1269174 T6051 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1269176 T6051 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1269179 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1269179 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1269186 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1269186 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1269191 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1269191 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1269194 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1269194 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1269198 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1269198 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1269202 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1269202 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1269205 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1269205 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1269210 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1269210 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1269245 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1269245 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1269257 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1269257 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1269262 T6051 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1269263 T6051 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1269270 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269273 T6062 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6334d092 name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1269274 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1269758 T6051 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1269766 T6051 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1269770 T6051 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50909
   [junit4]   2> 1269773 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1269774 T6051 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1269775 T6051 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461
   [junit4]   2> 1269779 T6051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\'
   [junit4]   2> 1269809 T6051 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\solr.xml
   [junit4]   2> 1269848 T6051 oasc.CoreContainer.<init> New CoreContainer 130259906
   [junit4]   2> 1269848 T6051 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\]
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1269851 T6051 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1269862 T6051 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1269862 T6051 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1269862 T6051 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1269862 T6051 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50899/solr
   [junit4]   2> 1269862 T6051 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1269865 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269870 T6075 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b02fb0 name:ZooKeeperConnection Watcher:127.0.0.1:50899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1269870 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1269874 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1269877 T6077 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4edd0523 name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1269877 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1269880 T6051 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1269884 T6051 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1269890 T6051 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1269893 T6051 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50909__%2Fi
   [junit4]   2> 1269894 T6051 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50909__%2Fi
   [junit4]   2> 1269898 T6051 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1269901 T6051 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1269906 T6051 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50909__%2Fi
   [junit4]   2> 1269906 T6051 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1269910 T6051 oasc.Overseer.start Overseer (id=91278022160875524-127.0.0.1:50909__%2Fi-n_0000000000) starting
   [junit4]   2> 1269915 T6051 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1269920 T6079 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1269921 T6051 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1269922 T6079 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1269926 T6051 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1269930 T6051 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1269936 T6078 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1269939 T6080 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1269939 T6080 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1269941 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269941 T6080 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1269943 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1269943 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50909/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50909__%2Fi",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1269943 T6078 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1269943 T6078 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1269947 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1269948 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1270980 T6080 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1270980 T6080 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\collection1
   [junit4]   2> 1270980 T6080 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1270982 T6080 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1270982 T6080 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1270985 T6080 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1270985 T6080 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\collection1\'
   [junit4]   2> 1270987 T6080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461/collection1/lib/classes/' to classloader
   [junit4]   2> 1270989 T6080 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461/collection1/lib/README' to classloader
   [junit4]   2> 1271041 T6080 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1271056 T6080 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1271059 T6080 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1271065 T6080 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1271199 T6080 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1271201 T6080 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1271204 T6080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1271207 T6080 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1271243 T6080 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1271244 T6080 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392792086461\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/control/data\
   [junit4]   2> 1271244 T6080 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d4b1170
   [junit4]   2> 1271244 T6080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\control\data
   [junit4]   2> 1271244 T6080 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/control/data\index/
   [junit4]   2> 1271244 T6080 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1271247 T6080 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\control\data\index
   [junit4]   2> 1271248 T6080 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=4.310546875, floorSegmentMB=1.544921875, forceMergeDeletesPctAllowed=12.321402776263014, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1271253 T6080 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1271253 T6080 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271257 T6080 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1271257 T6080 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1271257 T6080 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1271257 T6080 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1271258 T6080 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1271258 T6080 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1271258 T6080 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1271259 T6080 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1271259 T6080 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1271259 T6080 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1271260 T6080 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1271260 T6080 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1271260 T6080 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1271260 T6080 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1271261 T6080 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1271261 T6080 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1271261 T6080 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1271268 T6080 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1271271 T6080 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1271271 T6080 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1271274 T6080 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8790865353499983]
   [junit4]   2> 1271275 T6080 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1271275 T6080 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271275 T6080 oass.SolrIndexSearcher.<init> Opening Searcher@2a49bdfb[collection1] main
   [junit4]   2> 1271280 T6080 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1271280 T6081 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a49bdfb[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1271281 T6051 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1271281 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1271290 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1271290 T6084 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50909/_/i collection:control_collection shard:shard1
   [junit4]   2> 1271294 T6086 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24222f4a name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1271295 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1271296 T6084 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1271298 T6051 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1271307 T6051 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1271460 T6084 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1271464 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1271466 T6084 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1271466 T6084 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2941 name=collection1 org.apache.solr.core.SolrCore@54e41fda url=https://127.0.0.1:50909/_/i/collection1 node=127.0.0.1:50909__%2Fi C2941_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:50909/_/i, core=collection1, node_name=127.0.0.1:50909__%2Fi}
   [junit4]   2> 1271466 T6084 C2941 P50909 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50909/_/i/collection1/
   [junit4]   2> 1271466 T6084 C2941 P50909 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1271466 T6084 C2941 P50909 oasc.SyncStrategy.syncToMe https://127.0.0.1:50909/_/i/collection1/ has no replicas
   [junit4]   2> 1271466 T6084 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50909/_/i/collection1/ shard1
   [junit4]   2> 1271466 T6084 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1271470 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1271479 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1271482 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1271482 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1271736 T6051 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1271740 T6051 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1271747 T6051 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1271750 T6051 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50921
   [junit4]   2> 1271753 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1271753 T6051 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1271753 T6051 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491
   [junit4]   2> 1271753 T6051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\'
   [junit4]   2> 1271813 T6051 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\solr.xml
   [junit4]   2> 1271825 T6051 oasc.CoreContainer.<init> New CoreContainer 2012423446
   [junit4]   2> 1271825 T6051 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\]
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1271828 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1271830 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1271830 T6051 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1271830 T6051 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1271840 T6051 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1271840 T6051 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1271840 T6051 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1271840 T6051 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50899/solr
   [junit4]   2> 1271840 T6051 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1271845 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1271859 T6099 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1512260a name:ZooKeeperConnection Watcher:127.0.0.1:50899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1271860 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1271866 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1271872 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1271879 T6101 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19948d32 name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1271879 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1271887 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1271892 T6051 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1271999 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272000 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272001 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272017 T6084 oasc.ZkController.register We are https://127.0.0.1:50909/_/i/collection1/ and leader is https://127.0.0.1:50909/_/i/collection1/
   [junit4]   2> 1272017 T6084 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50909/_/i
   [junit4]   2> 1272017 T6084 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1272018 T6084 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1272018 T6084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1272021 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272021 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272021 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272023 T6084 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1272025 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1272025 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50909/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50909__%2Fi",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1272030 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272144 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272145 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272146 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1272936 T6051 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50921__%2Fi
   [junit4]   2> 1272941 T6051 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50921__%2Fi
   [junit4]   2> 1272952 T6077 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1272953 T6101 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1272952 T6086 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1272969 T6102 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1272970 T6102 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1272974 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272974 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272974 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1272974 T6102 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1272980 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1272982 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50921/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50921__%2Fi",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1272983 T6078 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1272983 T6078 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1272992 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1273104 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1273105 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1273105 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274016 T6102 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1274016 T6102 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\collection1
   [junit4]   2> 1274016 T6102 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1274017 T6102 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1274018 T6102 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1274020 T6102 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1274020 T6102 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\collection1\'
   [junit4]   2> 1274022 T6102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491/collection1/lib/classes/' to classloader
   [junit4]   2> 1274023 T6102 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491/collection1/lib/README' to classloader
   [junit4]   2> 1274057 T6102 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1274070 T6102 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1274072 T6102 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1274082 T6102 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1274198 T6102 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1274210 T6102 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1274212 T6102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1274216 T6102 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1274256 T6102 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1274257 T6102 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392792088491\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/jetty1\
   [junit4]   2> 1274257 T6102 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d4b1170
   [junit4]   2> 1274258 T6102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty1
   [junit4]   2> 1274260 T6102 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/jetty1\index/
   [junit4]   2> 1274260 T6102 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1274260 T6102 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty1\index
   [junit4]   2> 1274262 T6102 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=4.310546875, floorSegmentMB=1.544921875, forceMergeDeletesPctAllowed=12.321402776263014, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1274267 T6102 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1274267 T6102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1274272 T6102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1274272 T6102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1274273 T6102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1274273 T6102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1274273 T6102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1274273 T6102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1274274 T6102 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1274274 T6102 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1274274 T6102 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1274278 T6102 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1274279 T6102 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1274279 T6102 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1274279 T6102 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1274280 T6102 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1274280 T6102 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1274280 T6102 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1274281 T6102 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1274285 T6102 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1274287 T6102 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1274287 T6102 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1274290 T6102 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8790865353499983]
   [junit4]   2> 1274291 T6102 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1274291 T6102 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1274291 T6102 oass.SolrIndexSearcher.<init> Opening Searcher@5aab0956[collection1] main
   [junit4]   2> 1274297 T6102 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1274298 T6051 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1274298 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1274327 T6103 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5aab0956[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1274328 T6106 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50921/_/i collection:collection1 shard:shard2
   [junit4]   2> 1274330 T6106 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1274343 T6106 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1274348 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274348 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274348 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274350 T6106 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1274350 T6106 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2942 name=collection1 org.apache.solr.core.SolrCore@de582be url=https://127.0.0.1:50921/_/i/collection1 node=127.0.0.1:50921__%2Fi C2942_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:50921/_/i, core=collection1, node_name=127.0.0.1:50921__%2Fi}
   [junit4]   2> 1274350 T6106 C2942 P50921 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50921/_/i/collection1/
   [junit4]   2> 1274350 T6106 C2942 P50921 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1274361 T6106 C2942 P50921 oasc.SyncStrategy.syncToMe https://127.0.0.1:50921/_/i/collection1/ has no replicas
   [junit4]   2> 1274361 T6106 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50921/_/i/collection1/ shard2
   [junit4]   2> 1274361 T6106 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1274366 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1274375 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274378 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274386 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274502 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274502 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274503 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274540 T6106 oasc.ZkController.register We are https://127.0.0.1:50921/_/i/collection1/ and leader is https://127.0.0.1:50921/_/i/collection1/
   [junit4]   2> 1274540 T6106 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50921/_/i
   [junit4]   2> 1274540 T6106 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1274540 T6106 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1274540 T6106 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1274544 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274544 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274544 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274546 T6106 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1274549 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1274550 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50921/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50921__%2Fi",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1274556 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1274665 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274666 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274666 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1274846 T6051 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1274847 T6051 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1274854 T6051 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1274858 T6051 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50930
   [junit4]   2> 1274863 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1274864 T6051 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1274864 T6051 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485
   [junit4]   2> 1274864 T6051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\'
   [junit4]   2> 1274899 T6051 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\solr.xml
   [junit4]   2> 1274911 T6051 oasc.CoreContainer.<init> New CoreContainer 1571975313
   [junit4]   2> 1274911 T6051 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\]
   [junit4]   2> 1274911 T6051 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1274911 T6051 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1274911 T6051 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1274911 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1274911 T6051 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1274915 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1274915 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1274915 T6051 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1274915 T6051 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1274925 T6051 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1274925 T6051 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1274925 T6051 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1274925 T6051 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50899/solr
   [junit4]   2> 1274925 T6051 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1274930 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1274935 T6117 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e51a835 name:ZooKeeperConnection Watcher:127.0.0.1:50899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1274935 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1274941 T6053 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14448e0a6b30008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1274943 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1274949 T6119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65a3c482 name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1274949 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1274959 T6051 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1276108 T6051 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50930__%2Fi
   [junit4]   2> 1276113 T6051 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50930__%2Fi
   [junit4]   2> 1276132 T6119 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1276133 T6086 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1276133 T6077 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1276133 T6101 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1276140 T6120 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1276140 T6120 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1276143 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1276143 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1276143 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1276143 T6120 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1276145 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1276146 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50930/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50930__%2Fi",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1276146 T6078 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1276146 T6078 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1276151 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1276270 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1276271 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1276271 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1276272 T6119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1277287 T6120 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1277287 T6120 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\collection1
   [junit4]   2> 1277287 T6120 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1277290 T6120 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1277290 T6120 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1277293 T6120 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1277293 T6120 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\collection1\'
   [junit4]   2> 1277296 T6120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485/collection1/lib/classes/' to classloader
   [junit4]   2> 1277296 T6120 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485/collection1/lib/README' to classloader
   [junit4]   2> 1277337 T6120 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1277347 T6120 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1277353 T6120 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1277357 T6120 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1277498 T6120 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1277498 T6120 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1277500 T6120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1277508 T6120 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1277540 T6120 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1277541 T6120 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392792091485\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/jetty2\
   [junit4]   2> 1277541 T6120 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3d4b1170
   [junit4]   2> 1277541 T6120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty2
   [junit4]   2> 1277541 T6120 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187/jetty2\index/
   [junit4]   2> 1277541 T6120 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1277545 T6120 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty2\index
   [junit4]   2> 1277546 T6120 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=4.310546875, floorSegmentMB=1.544921875, forceMergeDeletesPctAllowed=12.321402776263014, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1277852 T6120 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1277852 T6120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1277856 T6120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1277857 T6120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1277857 T6120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1277857 T6120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1277857 T6120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1277859 T6120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1277859 T6120 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1277859 T6120 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1277859 T6120 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1277860 T6120 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1277860 T6120 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1277860 T6120 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1277860 T6120 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1277861 T6120 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1277861 T6120 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1277862 T6120 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1277862 T6120 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1277869 T6120 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1277893 T6120 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1277893 T6120 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1277895 T6120 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=41, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8790865353499983]
   [junit4]   2> 1277897 T6120 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392792086187\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1277897 T6120 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1277897 T6120 oass.SolrIndexSearcher.<init> Opening Searcher@5788a83f[collection1] main
   [junit4]   2> 1277903 T6120 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1277904 T6121 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5788a83f[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1277906 T6051 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1277906 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1277914 T6124 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50930/_/i collection:collection1 shard:shard3
   [junit4]   2> 1277917 T6124 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1277931 T6124 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 1277935 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1277935 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1277935 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1277937 T6124 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1277937 T6124 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2943 name=collection1 org.apache.solr.core.SolrCore@195fe098 url=https://127.0.0.1:50930/_/i/collection1 node=127.0.0.1:50930__%2Fi C2943_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:50930/_/i, core=collection1, node_name=127.0.0.1:50930__%2Fi}
   [junit4]   2> 1277937 T6124 C2943 P50930 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50930/_/i/collection1/
   [junit4]   2> 1277937 T6124 C2943 P50930 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1277937 T6124 C2943 P50930 oasc.SyncStrategy.syncToMe https://127.0.0.1:50930/_/i/collection1/ has no replicas
   [junit4]   2> 1277937 T6124 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50930/_/i/collection1/ shard3
   [junit4]   2> 1277937 T6124 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 1277941 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1277950 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1277952 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1277952 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1277954 T6119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1277954 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1277966 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1277975 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1278094 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278095 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278095 T6119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278097 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278132 T6124 oasc.ZkController.register We are https://127.0.0.1:50930/_/i/collection1/ and leader is https://127.0.0.1:50930/_/i/collection1/
   [junit4]   2> 1278132 T6124 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50930/_/i
   [junit4]   2> 1278132 T6124 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1278132 T6124 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1278132 T6124 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1278135 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1278135 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1278135 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1278136 T6124 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1278138 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1278139 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50930/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50930__%2Fi",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1278143 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1278264 T6101 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278265 T6086 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278266 T6077 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1278266 T6119 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1279920 T6051 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1279922 T6051 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1279932 T6051 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1279936 T6051 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:50939
   [junit4]   2> 1279940 T6051 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1279940 T6051 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1279940 T6051 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392792095096
   [junit4]   2> 1279943 T6051 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392792095096\'
   [junit4]   2> 1279994 T6051 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392792095096\solr.xml
   [junit4]   2> 1280011 T6051 oasc.CoreContainer.<init> New CoreContainer 486766358
   [junit4]   2> 1280011 T6051 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392792095096\]
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1280013 T6051 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1280025 T6051 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1280025 T6051 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1280025 T6051 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1280025 T6051 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50899/solr
   [junit4]   2> 1280027 T6051 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1280029 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1280055 T6137 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@bcfef54 name:ZooKeeperConnection Watcher:127.0.0.1:50899 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1280056 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1280060 T6051 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1280077 T6139 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@44f7f41e name:ZooKeeperConnection Watcher:127.0.0.1:50899/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1280078 T6051 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1280089 T6051 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1281240 T6051 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50939__%2Fi
   [junit4]   2> 1281245 T6051 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50939__%2Fi
   [junit4]   2> 1281257 T6119 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1281258 T6077 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1281259 T6086 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1281259 T6101 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1281260 T6139 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1281278 T6140 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1281278 T6140 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1281282 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1281282 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1281284 T6077 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1281282 T6140 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1281288 T6078 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1281290 T6078 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:50939/_/i",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:50939__%2Fi",
   [junit4]   2> 	  "shard":null,
 

[...truncated too long message...]

171)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 		at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:932)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:768)
   [junit4]   2> 		... 2 more
   [junit4]   2> 	
   [junit4]   2> 1500204 T6930 oasc.ZkController.register Register replica - core:awholynewcollection_1_shard1_replica1 address:https://127.0.0.1:51586 collection:awholynewcollection_1 shard:shard1
   [junit4]   2> 1500204 T6930 oasc.SolrException.log ERROR Error registering SolrCore:org.apache.solr.common.cloud.ZooKeeperException: 
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:774)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController$1.command(ZkController.java:243)
   [junit4]   2> 		at org.apache.solr.common.cloud.ConnectionManager$1$1.run(ConnectionManager.java:165)
   [junit4]   2> 	Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_1/leader_elect/shard1/election/91278032869261325-core_node1-n_0000000000
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 		at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.joinElection(ZkController.java:932)
   [junit4]   2> 		at org.apache.solr.cloud.ZkController.register(ZkController.java:768)
   [junit4]   2> 		... 2 more
   [junit4]   2> 	
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1498316 T6929 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.method=testDistribSearch -Dtests.seed=ACBB864637FE7F8C -Dtests.slow=true -Dtests.locale=lt -Dtests.timezone=America/Bogota -Dtests.file.encoding=Cp1252
   [junit4] ERROR   67.8s | CollectionsAPIDistributedZkTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: KeeperErrorCode = Session expired for /overseer/collection-queue-work/qn-
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([ACBB864637FE7F8C:2D5D085E40A11FB0]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:785)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:201)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 1500213 T6674 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=lt, timezone=America/Bogota
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=2,threads=1,free=187115408,total=519438336
   [junit4]   2> NOTE: All tests run in this JVM: [OpenCloseCoreStressTest, TestCopyFieldCollectionResource, CoreAdminCreateDiscoverTest, CurrencyFieldOpenExchangeTest, AliasIntegrationTest, TestLFUCache, BadCopyFieldTest, TestInfoStreamLogging, TestLRUCache, SuggesterTest, HdfsBasicDistributedZk2Test, QueryFacetTest, WordBreakSolrSpellCheckerTest, SolrInfoMBeanTest, CursorMarkTest, TestPseudoReturnFields, QueryParsingTest, SpellCheckComponentTest, UpdateRequestProcessorFactoryTest, BinaryUpdateRequestHandlerTest, TestSweetSpotSimilarityFactory, TestCloudManagedSchema, TestMaxScoreQueryParser, OpenExchangeRatesOrgProviderTest, TestSolrQueryParserResource, BasicDistributedZkTest, TestImplicitCoreProperties, TestLuceneMatchVersion, TestDistributedGrouping, TestSerializedLuceneMatchVersion, TestMergePolicyConfig, FileUtilsTest, MultiTermTest, ZkNodePropsTest, TestCloudManagedSchemaAddField, CSVRequestHandlerTest, DeleteReplicaTest, PreAnalyzedUpdateProcessorTest, TestSolrDeletionPolicy1, ZkCLITest, TestRangeQuery, TestSolrXml, SuggesterFSTTest, BasicZkTest, DocumentBuilderTest, TestLazyCores, TestSort, StatsComponentTest, AbstractAnalyticsStatsTest, TestDistribDocBasedVersion, TestTrie, TestFileDictionaryLookup, TestFunctionQuery, HdfsDirectoryTest, ShowFileRequestHandlerTest, TestIndexSearcher, TestSchemaNameResource, PreAnalyzedFieldTest, TestBM25SimilarityFactory, TestDFRSimilarityFactory, UpdateParamsTest, TestDocumentBuilder, JsonLoaderTest, BadIndexSchemaTest, TestNoOpRegenerator, TestFreeTextSuggestions, DistributedSpellCheckComponentTest, TestSolrQueryParser, CopyFieldTest, HighlighterTest, QueryEqualityTest, LukeRequestHandlerTest, SignatureUpdateProcessorFactoryTest, DirectSolrConnectionTest, DocValuesTest, OutputWriterTest, SortByFunctionTest, AnalysisErrorHandlingTest, TestOmitPositions, ClusterStateUpdateTest, StressHdfsTest, TestFieldCollectionResource, RAMDirectoryFactoryTest, CircularListTest, TestPerFieldSimilarity, TriLevelCompositeIdRoutingTest, TestStressReorder, TestModifyConfFiles, TestCodecSupport, DateFieldTest, MigrateRouteKeyTest, NumericFieldsTest, TestReplicationHandler, TestDocBasedVersionConstraints, LeaderElectionIntegrationTest, SliceStateTest, TestSchemaSimilarityResource, TestXIncludeConfig, PluginInfoTest, UnloadDistributedZkTest, TestCSVLoader, CursorPagingTest, TestSystemIdResolver, DeleteShardTest, BlockDirectoryTest, TestSchemaVersionResource, AssignTest, DebugComponentTest, LoggingHandlerTest, TermVectorComponentDistributedTest, SolrTestCaseJ4Test, TestSimpleQParserPlugin, SimplePostToolTest, SolrCmdDistributorTest, TestFaceting, DistributedQueryComponentCustomSortTest, TestIBSimilarityFactory, SynonymTokenizerTest, SolrCoreTest, HdfsSyncSliceTest, TestAnalyzedSuggestions, BasicFunctionalityTest, DirectUpdateHandlerTest, DistributedSuggestComponentTest, TestPHPSerializedResponseWriter, TestFieldResource, TestUtils, RequiredFieldsTest, TestFastOutputStream, TestRecoveryHdfs, TestLMJelinekMercerSimilarityFactory, SuggesterWFSTTest, SolrIndexSplitterTest, HdfsUnloadDistributedZkTest, DocValuesMissingTest, FileBasedSpellCheckerTest, TestSurroundQueryParser, TestArbitraryIndexDir, HdfsChaosMonkeySafeLeaderTest, XmlUpdateRequestHandlerTest, MBeansHandlerTest, ConvertedLegacyTest, TestFuzzyAnalyzedSuggestions, SuggesterTSTTest, TestInitQParser, NotRequiredUniqueKeyTest, SystemInfoHandlerTest, RecoveryZkTest, TestConfig, ModifyConfFileTest, URLClassifyProcessorTest, ConnectionManagerTest, OverseerCollectionProcessorTest, UniqFieldsUpdateProcessorFactoryTest, TestZkChroot, SolrCoreCheckLockOnStartupTest, NoCacheHeaderTest, TestSolr4Spatial, TestSolrIndexConfig, SOLR749Test, TestRandomDVFaceting, AutoCommitTest, DocumentAnalysisRequestHandlerTest, ResponseLogComponentTest, TestStressUserVersions, TestSchemaResource, CoreContainerCoreInitFailuresTest, TestElisionMultitermQuery, HighlighterConfigTest, TestPhraseSuggestions, TestBlendedInfixSuggestions, LegacyHTMLStripCharFilterTest, TestShardHandlerFactory, TestQuerySenderListener, PathHierarchyTokenizerFactoryTest, TestBinaryResponseWriter, FullSolrCloudDistribCmdsTest, InfoHandlerTest, SliceStateUpdateTest, TestDistributedSearch, AddBlockUpdateTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 67.86s, 1 test, 1 error <<< FAILURES!

[...truncated 577 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 372 suites, 1604 tests, 2 errors, 40 ignored (12 assumptions)

Total time: 73 minutes 24 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3799 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3799/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseParallelGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([8BC5DC0CBE9AFD37]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([8BC5DC0CBE9AFD37]:0)




Build Log:
[...truncated 10623 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 1640246 T6487 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1640246 T6487 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /p/
   [junit4]   2> 1640252 T6487 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1392869653038
   [junit4]   2> 1640255 T6487 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1640256 T6488 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1640336 T6487 oasc.ZkTestServer.run start zk server on port:59283
   [junit4]   2> 1640337 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1640348 T6494 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48f53241 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1640348 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1640349 T6487 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1640358 T6489 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444d803a370000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1640361 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1640366 T6496 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7092296a name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1640366 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1640366 T6487 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1640375 T6487 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1640382 T6487 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1640389 T6487 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1640396 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1640397 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1640410 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1640411 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1640422 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1640423 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1640431 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1640431 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1640439 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1640441 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1640449 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1640449 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1640457 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1640458 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1640467 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1640468 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1640477 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1640477 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1640485 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1640485 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1640495 T6487 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1640495 T6487 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1640505 T6489 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444d803a370001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1640509 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1640514 T6498 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@23a75a1d name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1640515 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1640520 T6489 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444d803a370002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1640894 T6487 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1640904 T6487 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1640906 T6487 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59293
   [junit4]   2> 1640911 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1640911 T6487 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1640911 T6487 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303
   [junit4]   2> 1640911 T6487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\'
   [junit4]   2> 1640934 T6487 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\solr.xml
   [junit4]   2> 1640976 T6487 oasc.CoreContainer.<init> New CoreContainer 1811730442
   [junit4]   2> 1640976 T6487 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\]
   [junit4]   2> 1640977 T6487 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1640977 T6487 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1640977 T6487 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1640977 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1640978 T6487 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1640978 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1640978 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1640978 T6487 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1640979 T6487 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1640986 T6487 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1640986 T6487 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1640987 T6487 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1640987 T6487 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
   [junit4]   2> 1640987 T6487 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1640989 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1640996 T6509 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@428b0b32 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1640996 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1641000 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1641002 T6511 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66405b15 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1641003 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1641005 T6487 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1641011 T6487 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1641016 T6487 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1641019 T6487 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59293_p
   [junit4]   2> 1641020 T6487 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59293_p
   [junit4]   2> 1641023 T6487 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1641025 T6487 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1641030 T6487 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:59293_p
   [junit4]   2> 1641030 T6487 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1641032 T6487 oasc.Overseer.start Overseer (id=91283105582088196-127.0.0.1:59293_p-n_0000000000) starting
   [junit4]   2> 1641036 T6487 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1641040 T6513 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1641041 T6487 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1641041 T6513 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1641044 T6487 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1641046 T6487 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1641050 T6512 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1641062 T6514 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1641062 T6514 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1641064 T6514 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1641064 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1641066 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1641067 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59293/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59293_p",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1641067 T6512 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1641067 T6512 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1641071 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1641073 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1641803 T6514 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1641803 T6514 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\collection1
   [junit4]   2> 1641803 T6514 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1641806 T6514 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1641806 T6514 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1641808 T6514 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1641809 T6514 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\collection1\'
   [junit4]   2> 1641811 T6514 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303/collection1/lib/classes/' to classloader
   [junit4]   2> 1641813 T6514 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303/collection1/lib/README' to classloader
   [junit4]   2> 1641860 T6514 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1641888 T6514 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1641891 T6514 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1641896 T6514 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1642136 T6514 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1642138 T6514 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1642138 T6514 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1642143 T6514 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1642169 T6514 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1642169 T6514 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1392869653303\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/control/data\
   [junit4]   2> 1642169 T6514 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79c3dec3
   [junit4]   2> 1642170 T6514 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\control\data
   [junit4]   2> 1642171 T6514 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/control/data\index/
   [junit4]   2> 1642171 T6514 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1642171 T6514 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\control\data\index
   [junit4]   2> 1642172 T6514 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1642176 T6514 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1642176 T6514 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1642178 T6514 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1642179 T6514 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1642179 T6514 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1642179 T6514 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1642179 T6514 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1642179 T6514 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1642180 T6514 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1642180 T6514 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1642180 T6514 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1642180 T6514 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1642180 T6514 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1642181 T6514 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1642181 T6514 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1642181 T6514 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1642182 T6514 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1642182 T6514 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1642182 T6514 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1642188 T6514 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1642190 T6514 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1642190 T6514 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1642191 T6514 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4613143344228908]
   [junit4]   2> 1642192 T6514 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 1642192 T6514 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1642192 T6514 oass.SolrIndexSearcher.<init> Opening Searcher@68b7b994[collection1] main
   [junit4]   2> 1642194 T6515 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@68b7b994[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1642194 T6514 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1642195 T6487 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1642195 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1642195 T6518 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:59293/p collection:control_collection shard:shard1
   [junit4]   2> 1642197 T6518 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1642202 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1642206 T6520 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12cf52a8 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1642206 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1642208 T6487 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1642211 T6518 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1642212 T6487 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1642213 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642213 T6518 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1642213 T6518 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2015 name=collection1 org.apache.solr.core.SolrCore@6691cd3c url=https://127.0.0.1:59293/p/collection1 node=127.0.0.1:59293_p C2015_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:59293/p, core=collection1, node_name=127.0.0.1:59293_p}
   [junit4]   2> 1642213 T6518 C2015 P59293 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:59293/p/collection1/
   [junit4]   2> 1642213 T6518 C2015 P59293 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1642213 T6518 C2015 P59293 oasc.SyncStrategy.syncToMe https://127.0.0.1:59293/p/collection1/ has no replicas
   [junit4]   2> 1642213 T6518 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:59293/p/collection1/ shard1
   [junit4]   2> 1642213 T6518 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1642216 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1642221 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642224 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642228 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642302 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1642303 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1642335 T6518 oasc.ZkController.register We are https://127.0.0.1:59293/p/collection1/ and leader is https://127.0.0.1:59293/p/collection1/
   [junit4]   2> 1642335 T6518 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59293/p
   [junit4]   2> 1642335 T6518 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1642335 T6518 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1642335 T6518 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1642337 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642337 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642337 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642338 T6518 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1642340 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1642340 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59293/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59293_p",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1642342 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1642417 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1642417 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1642546 T6487 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1642547 T6487 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1642555 T6487 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1642556 T6487 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59305
   [junit4]   2> 1642560 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1642560 T6487 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1642560 T6487 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996
   [junit4]   2> 1642560 T6487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\'
   [junit4]   2> 1642578 T6487 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\solr.xml
   [junit4]   2> 1642612 T6487 oasc.CoreContainer.<init> New CoreContainer 2022149981
   [junit4]   2> 1642612 T6487 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\]
   [junit4]   2> 1642613 T6487 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1642614 T6487 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1642620 T6487 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1642620 T6487 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1642620 T6487 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1642620 T6487 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
   [junit4]   2> 1642620 T6487 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1642623 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1642627 T6531 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1561d15 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1642627 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1642634 T6489 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444d803a370006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1642634 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1642636 T6533 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d27d78a name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1642637 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1642644 T6487 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1643365 T6487 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59305_p
   [junit4]   2> 1643369 T6487 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59305_p
   [junit4]   2> 1643374 T6511 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1643375 T6533 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1643376 T6520 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1643391 T6534 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1643391 T6534 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1643393 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1643393 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1643394 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1643393 T6534 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1643396 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1643398 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59305/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59305_p",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1643398 T6512 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1643398 T6512 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1643405 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1643481 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1643482 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1643482 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644112 T6534 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1644112 T6534 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\collection1
   [junit4]   2> 1644112 T6534 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1644114 T6534 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1644114 T6534 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1644117 T6534 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1644117 T6534 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\collection1\'
   [junit4]   2> 1644120 T6534 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996/collection1/lib/classes/' to classloader
   [junit4]   2> 1644121 T6534 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996/collection1/lib/README' to classloader
   [junit4]   2> 1644168 T6534 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1644197 T6534 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1644199 T6534 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1644205 T6534 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1644467 T6534 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1644468 T6534 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1644469 T6534 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1644473 T6534 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1644502 T6534 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1644502 T6534 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1392869654996\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/jetty1\
   [junit4]   2> 1644502 T6534 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79c3dec3
   [junit4]   2> 1644502 T6534 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty1
   [junit4]   2> 1644503 T6534 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/jetty1\index/
   [junit4]   2> 1644504 T6534 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1644504 T6534 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty1\index
   [junit4]   2> 1644504 T6534 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1644507 T6534 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1644507 T6534 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1644510 T6534 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1644511 T6534 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1644511 T6534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1644511 T6534 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1644511 T6534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1644511 T6534 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1644512 T6534 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1644512 T6534 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1644512 T6534 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1644512 T6534 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1644512 T6534 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1644512 T6534 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1644512 T6534 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1644513 T6534 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1644513 T6534 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1644513 T6534 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1644514 T6534 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1644519 T6534 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1644522 T6534 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1644522 T6534 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1644523 T6534 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4613143344228908]
   [junit4]   2> 1644523 T6534 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 1644523 T6534 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1644523 T6534 oass.SolrIndexSearcher.<init> Opening Searcher@5b5018d6[collection1] main
   [junit4]   2> 1644526 T6535 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b5018d6[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1644528 T6534 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1644528 T6487 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1644528 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1644528 T6538 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:59305/p collection:collection1 shard:shard1
   [junit4]   2> 1644530 T6538 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1644540 T6538 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1644543 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644543 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644543 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644544 T6538 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1644544 T6538 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2016 name=collection1 org.apache.solr.core.SolrCore@683ca7d8 url=https://127.0.0.1:59305/p/collection1 node=127.0.0.1:59305_p C2016_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:59305/p, core=collection1, node_name=127.0.0.1:59305_p}
   [junit4]   2> 1644544 T6538 C2016 P59305 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:59305/p/collection1/
   [junit4]   2> 1644544 T6538 C2016 P59305 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1644544 T6538 C2016 P59305 oasc.SyncStrategy.syncToMe https://127.0.0.1:59305/p/collection1/ has no replicas
   [junit4]   2> 1644544 T6538 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:59305/p/collection1/ shard1
   [junit4]   2> 1644545 T6538 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1644547 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1644552 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644554 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644559 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644635 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644636 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644636 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644664 T6538 oasc.ZkController.register We are https://127.0.0.1:59305/p/collection1/ and leader is https://127.0.0.1:59305/p/collection1/
   [junit4]   2> 1644665 T6538 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59305/p
   [junit4]   2> 1644665 T6538 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1644665 T6538 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1644665 T6538 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1644667 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644667 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644667 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644667 T6538 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1644669 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1644669 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59305/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59305_p",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1644672 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1644748 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644748 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644749 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1644861 T6487 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1644861 T6487 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1644867 T6487 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1644869 T6487 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59314
   [junit4]   2> 1644873 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1644873 T6487 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1644874 T6487 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315
   [junit4]   2> 1644874 T6487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\'
   [junit4]   2> 1644893 T6487 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\solr.xml
   [junit4]   2> 1644938 T6487 oasc.CoreContainer.<init> New CoreContainer 1216305032
   [junit4]   2> 1644938 T6487 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\]
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1644939 T6487 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1644941 T6487 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1644946 T6487 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1644946 T6487 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1644946 T6487 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1644946 T6487 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
   [junit4]   2> 1644946 T6487 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1644948 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1644952 T6549 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5fe47a3f name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1644952 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1644955 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1644957 T6551 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@727199e3 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1644957 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1644961 T6487 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1645683 T6487 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59314_p
   [junit4]   2> 1645685 T6487 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59314_p
   [junit4]   2> 1645692 T6533 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1645692 T6551 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1645692 T6511 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1645693 T6520 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1645711 T6552 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1645711 T6552 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1645714 T6552 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1645714 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1645714 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1645714 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1645718 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1645720 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59314/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59314_p",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1645720 T6512 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1645720 T6512 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1645726 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1645803 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1645803 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1645803 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1645803 T6551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1646432 T6552 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1646432 T6552 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\collection1
   [junit4]   2> 1646432 T6552 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1646434 T6552 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1646434 T6552 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1646436 T6552 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1646436 T6552 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\collection1\'
   [junit4]   2> 1646439 T6552 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315/collection1/lib/classes/' to classloader
   [junit4]   2> 1646441 T6552 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315/collection1/lib/README' to classloader
   [junit4]   2> 1646488 T6552 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1646522 T6552 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1646524 T6552 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1646529 T6552 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1646777 T6552 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1646778 T6552 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1646779 T6552 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1646783 T6552 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1646811 T6552 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1646811 T6552 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1392869657315\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/jetty2\
   [junit4]   2> 1646811 T6552 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79c3dec3
   [junit4]   2> 1646811 T6552 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty2
   [junit4]   2> 1646812 T6552 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/jetty2\index/
   [junit4]   2> 1646813 T6552 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1646813 T6552 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty2\index
   [junit4]   2> 1646813 T6552 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=28, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1646817 T6552 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1646818 T6552 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1646820 T6552 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1646820 T6552 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1646820 T6552 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1646821 T6552 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1646821 T6552 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1646821 T6552 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1646822 T6552 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1646822 T6552 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1646822 T6552 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1646823 T6552 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1646823 T6552 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1646823 T6552 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1646823 T6552 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1646823 T6552 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1646824 T6552 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1646824 T6552 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1646825 T6552 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1646830 T6552 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1646833 T6552 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1646833 T6552 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1646834 T6552 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4613143344228908]
   [junit4]   2> 1646834 T6552 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 1646834 T6552 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1646835 T6552 oass.SolrIndexSearcher.<init> Opening Searcher@48fa0a5[collection1] main
   [junit4]   2> 1646837 T6553 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@48fa0a5[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1646838 T6552 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1646839 T6487 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1646839 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1646839 T6556 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:59314/p collection:collection1 shard:shard3
   [junit4]   2> 1646840 T6556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1646848 T6556 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 1646851 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646851 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646851 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646852 T6556 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1646852 T6556 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C2017 name=collection1 org.apache.solr.core.SolrCore@2bada492 url=https://127.0.0.1:59314/p/collection1 node=127.0.0.1:59314_p C2017_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:59314/p, core=collection1, node_name=127.0.0.1:59314_p}
   [junit4]   2> 1646853 T6556 C2017 P59314 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:59314/p/collection1/
   [junit4]   2> 1646853 T6556 C2017 P59314 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1646853 T6556 C2017 P59314 oasc.SyncStrategy.syncToMe https://127.0.0.1:59314/p/collection1/ has no replicas
   [junit4]   2> 1646853 T6556 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:59314/p/collection1/ shard3
   [junit4]   2> 1646853 T6556 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 1646854 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1646862 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646863 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646868 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646943 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1646943 T6551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1646943 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1646944 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1646974 T6556 oasc.ZkController.register We are https://127.0.0.1:59314/p/collection1/ and leader is https://127.0.0.1:59314/p/collection1/
   [junit4]   2> 1646974 T6556 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:59314/p
   [junit4]   2> 1646974 T6556 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1646974 T6556 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1646974 T6556 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1646975 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646975 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646975 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1646977 T6556 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1646978 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1646979 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59314/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59314_p",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1646982 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1647057 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1647057 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1647057 T6551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1647058 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1647175 T6487 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1647175 T6487 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1647181 T6487 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1647181 T6487 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:59323
   [junit4]   2> 1647185 T6487 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1647185 T6487 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1647185 T6487 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625
   [junit4]   2> 1647185 T6487 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\'
   [junit4]   2> 1647204 T6487 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\solr.xml
   [junit4]   2> 1647241 T6487 oasc.CoreContainer.<init> New CoreContainer 1165394769
   [junit4]   2> 1647241 T6487 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\]
   [junit4]   2> 1647242 T6487 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1647242 T6487 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1647242 T6487 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1647242 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1647243 T6487 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1647243 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1647243 T6487 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1647243 T6487 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1647244 T6487 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1647250 T6487 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1647250 T6487 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1647251 T6487 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1647251 T6487 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:59283/solr
   [junit4]   2> 1647251 T6487 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1647252 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1647258 T6567 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@499086d9 name:ZooKeeperConnection Watcher:127.0.0.1:59283 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1647258 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1647261 T6489 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444d803a37000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1647261 T6487 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1647265 T6569 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a312937 name:ZooKeeperConnection Watcher:127.0.0.1:59283/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1647265 T6487 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1647271 T6487 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1647992 T6487 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59323_p
   [junit4]   2> 1647996 T6487 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59323_p
   [junit4]   2> 1648003 T6533 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1648004 T6551 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1648004 T6569 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1648005 T6511 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1648005 T6520 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1648020 T6570 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1648020 T6570 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1648023 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1648024 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1648024 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1648023 T6570 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1648026 T6512 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1648028 T6512 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:59323/p",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:59323_p",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1648028 T6512 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1648028 T6512 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1648036 T6511 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1648112 T6520 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1648113 T6551 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1648113 T6511 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1648113 T6533 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1648113 T6569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1648714 T6570 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1648714 T6570 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\collection1
   [junit4]   2> 1648714 T6570 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1648715 T6570 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1648716 T6570 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1648718 T6570 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1648718 T6570 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\collection1\'
   [junit4]   2> 1648721 T6570 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625/collection1/lib/classes/' to classloader
   [junit4]   2> 1648723 T6570 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625/collection1/lib/README' to classloader
   [junit4]   2> 1648764 T6570 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1648791 T6570 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1648793 T6570 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1648801 T6570 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1649023 T6570 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1649025 T6570 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1649026 T6570 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1649029 T6570 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1649051 T6570 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 1649051 T6570 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1392869659625\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036/jetty3\
   [junit4]   2> 1649051 T6570 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79c3dec3
   [junit4]   2> 1649051 T6570 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1392869653036\jetty3
   [junit4]   2> 1649052 T6570 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.Chaos

[...truncated too long message...]

> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.TypeAdapters$22.write(TypeAdapters.java:626)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.TypeAdapters$22.write(TypeAdapters.java:578)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.Streams.write(Streams.java:67)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.GsonToMiniGsonTypeAdapterFactory$3.write(GsonToMiniGsonTypeAdapterFactory.java:98)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.write(TypeAdapterRuntimeTypeWrapper.java:66)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.write(ReflectiveTypeAdapterFactory.java:82)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.write(ReflectiveTypeAdapterFactory.java:194)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.dependencies.com.google.gson.Gson.toJson(Gson.java:512)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.events.Serializer.serialize(Serializer.java:61)
   [junit4]   2> 	        at com.carrotsearch.ant.tasks.junit4.slave.SlaveMain$4.write(SlaveMain.java:375)
   [junit4]   2> 	        at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
   [junit4]   2> 	        at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
   [junit4]   2> 	        at java.io.PrintStream.flush(PrintStream.java:338)
   [junit4]   2> 	        at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:297)
   [junit4]   2> 	        at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:141)
   [junit4]   2> 	        at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:229)
   [junit4]   2> 	        at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:59)
   [junit4]   2> 	        at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:324)
   [junit4]   2> 	        at org.apache.log4j.WriterAppender.append(WriterAppender.java:162)
   [junit4]   2> 	        at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:251)
   [junit4]   2> 	        at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:66)
   [junit4]   2> 	        at org.apache.log4j.Category.callAppenders(Category.java:206)
   [junit4]   2> 	        at org.apache.log4j.Category.forcedLog(Category.java:391)
   [junit4]   2> 	        at org.apache.log4j.Category.log(Category.java:856)
   [junit4]   2> 	        at org.slf4j.impl.Log4jLoggerAdapter.warn(Log4jLoggerAdapter.java:479)
   [junit4]   2> 	        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1089)
   [junit4]   2> 	  73) Thread[id=6539, name=HashSessionScavenger-152, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> 	        at java.lang.Object.wait(Native Method)
   [junit4]   2> 	        at java.util.TimerThread.mainLoop(Timer.java:552)
   [junit4]   2> 	        at java.util.TimerThread.run(Timer.java:505)
   [junit4]   2> NOTE: test params are: codec=Lucene46: {a_si=PostingsFormat(name=Direct), id=Lucene41(blocksize=128), a_t=PostingsFormat(name=FSTPulsing41), rnd_b=Lucene41(blocksize=128), _version_=PostingsFormat(name=FSTPulsing41)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=pl, timezone=Asia/Beirut
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=211,free=124953720,total=492830720
   [junit4]   2> NOTE: All tests run in this JVM: [TestPHPSerializedResponseWriter, DistributedSuggestComponentTest, TestRandomDVFaceting, ZkCLITest, TestSolrXMLSerializer, TestBM25SimilarityFactory, TestSchemaResource, TermVectorComponentDistributedTest, RangeFacetTest, QueryResultKeyTest, SoftAutoCommitTest, SliceStateUpdateTest, TestDefaultSimilarityFactory, TestSerializedLuceneMatchVersion, StatsComponentTest, NumericFieldsTest, UpdateParamsTest, TestStressLucene, ModifyConfFileTest, TestAnalyzedSuggestions, CursorMarkTest, PrimUtilsTest, DirectUpdateHandlerOptimizeTest, SuggestComponentTest, ZkControllerTest, ShardSplitTest, CoreAdminCreateDiscoverTest, TestTrie, TestStandardQParsers, TestRangeQuery, DistributedTermsComponentTest, AssignTest, CurrencyFieldXmlFileTest, TestDocSet, TestOverriddenPrefixQueryForCustomFieldType, PrimitiveFieldTypeTest, ResponseLogComponentTest, TestBinaryField, LukeRequestHandlerTest, SuggesterFSTTest, BinaryUpdateRequestHandlerTest, TestGroupingSearch, TestQuerySenderListener, TestQuerySenderNoQuery, TestJoin, TestDistribDocBasedVersion, DocumentBuilderTest, TestStressVersions, TestCoreDiscovery, NotRequiredUniqueKeyTest, DocValuesTest, TestMergePolicyConfig, BadCopyFieldTest, TestCustomSort, PolyFieldTest, TestJmxIntegration, FieldMutatingUpdateProcessorTest, TestCoreContainer, TestFileDictionaryLookup, BasicDistributedZkTest, TestFieldCollectionResource, HdfsChaosMonkeySafeLeaderTest, TestLuceneMatchVersion, DateFieldTest, TestInfoStreamLogging, RegexBoostProcessorTest, OpenExchangeRatesOrgProviderTest, TestFieldTypeResource, TestSimpleQParserPlugin, TestNRTOpen, TestNonDefinedSimilarityFactory, CoreMergeIndexesAdminHandlerTest, TermVectorComponentTest, TestFreeTextSuggestions, ChaosMonkeyNothingIsSafeTest, ShardRoutingCustomTest, FullSolrCloudDistribCmdsTest, TestSolrXmlPersistence, TestIBSimilarityFactory, BadIndexSchemaTest, TestFuzzyAnalyzedSuggestions, TestDistributedMissingSort, SolrIndexConfigTest, RequiredFieldsTest, SolrPluginUtilsTest, MoreLikeThisHandlerTest, TestSort, TestBadConfig, TestCollationField, CSVRequestHandlerTest, TestFastOutputStream, DirectUpdateHandlerTest, TestRandomFaceting, InfoHandlerTest, SolrCoreTest, TestPhraseSuggestions, JSONWriterTest, TestPostingsSolrHighlighter, TestRecovery, LeaderElectionIntegrationTest, BlockCacheTest, StressHdfsTest, TestHighlightDedupGrouping, TestWriterPerf, TestDefaultSearchFieldResource, BJQParserTest, PluginInfoTest, TestUtils, FieldAnalysisRequestHandlerTest, SolrIndexSplitterTest, TestIndexSearcher, TestNonNRTOpen, TestArbitraryIndexDir, TestConfig, TestSolrXmlPersistor, ParsingFieldUpdateProcessorsTest, QueryElevationComponentTest, AliasIntegrationTest, FileBasedSpellCheckerTest, ShardRoutingTest, TestHighFrequencyDictionaryFactory, TestFaceting, DefaultValueUpdateProcessorTest, TestCloudManagedSchema, TestFoldingMultitermQuery, NoFacetTest, TestSolrXml, TestSurroundQueryParser, TestRecoveryHdfs, TestUpdate, AddSchemaFieldsUpdateProcessorFactoryTest, DistribCursorPagingTest, DirectSolrSpellCheckerTest, TestCloudManagedSchemaAddField, TestUniqueKeyFieldResource, UniqFieldsUpdateProcessorFactoryTest, BadComponentTest, QueryParsingTest, TestFiltering, TestImplicitCoreProperties, ResourceLoaderTest, DistributedQueryElevationComponentTest, TestLMDirichletSimilarityFactory, AnalysisAfterCoreReloadTest, SystemInfoHandlerTest, DistributedQueryComponentCustomSortTest, SignatureUpdateProcessorFactoryTest, SpellCheckComponentTest, OverseerTest, FieldFacetExtrasTest, MBeansHandlerTest, MinimalSchemaTest, TestNoOpRegenerator, DocValuesMultiTest, CircularListTest, SuggesterTSTTest, NoCacheHeaderTest, TestSearchPerf, QueryEqualityTest, DisMaxRequestHandlerTest, TestPartialUpdateDeduplication, TestWordDelimiterFilterFactory, CursorPagingTest, TestZkChroot, TestSolr4Spatial, TestBlendedInfixSuggestions, UnloadDistributedZkTest, TestQueryTypes, TestSolrQueryParserDefaultOperatorResource, TestCSVLoader, TestOmitPositions, ConvertedLegacyTest, RecoveryZkTest, TestCharFilters, TestDynamicFieldResource, TestReloadAndDeleteDocs, DistributedDebugComponentTest, OverseerRolesTest, SolrTestCaseJ4Test, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=8BC5DC0CBE9AFD37 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=Asia/Beirut -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8BC5DC0CBE9AFD37]:0)
   [junit4] Completed in 7464.88s, 1 test, 2 errors <<< FAILURES!

[...truncated 565 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 372 suites, 1604 tests, 1 suite-level error, 1 error, 767 ignored (5 assumptions)

Total time: 186 minutes 38 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_51) - Build # 3798 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
Went to harden this and ended up agreeing with the comment attached to it - so I’ve pulled it.

- Mark

http://about.me/markrmiller

On Feb 19, 2014, at 6:50 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3798/
> Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC
> 
> 1 tests failed.
> FAILED:  org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.AssertionError
> 	at __randomizedtesting.SeedInfo.seed([34D7B74EB30FBF7E:1B7E135F6480F07A]:0)
> 	at org.junit.Assert.fail(Assert.java:92)
> 	at org.junit.Assert.assertTrue(Assert.java:43)
> 	at org.junit.Assert.assertTrue(Assert.java:54)
> 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> 
> 
> 
> Build Log:
> [...truncated 11443 lines...]
>   [junit4] Suite: org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest
>   [junit4]   2> 82704 T140 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
>   [junit4]   2> 82705 T140 oas.SolrTestCaseJ4.initCore ####initCore
>   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\.\solrtest-BasicHttpSolrServerTest-1392853661222
>   [junit4]   2> 82705 T140 oas.SolrTestCaseJ4.initCore ####initCore end
>   [junit4]   2> 82708 T140 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 82724 T140 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 82735 T140 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56002
>   [junit4]   2> 82739 T140 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\'
>   [junit4]   2> 82776 T140 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\solr.xml
>   [junit4]   2> 82892 T140 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 82893 T140 oasc.CoreContainer.<init> New CoreContainer 1230126684
>   [junit4]   2> 82893 T140 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\]
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 82898 T140 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 82911 T140 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 82911 T140 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 82912 T140 oasc.CoreContainer.load Host Name: 
>   [junit4]   2> 82919 T140 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 82934 T140 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\
>   [junit4]   2> 82935 T140 oasc.CorePropertiesLocator.discover Found 1 core definitions
>   [junit4]   2> 82937 T150 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1
>   [junit4]   2> 82943 T150 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\'
>   [junit4]   2> 82990 T150 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/extraction/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\extraction\lib).
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/clustering/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\clustering\lib).
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/langid/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\langid\lib).
>   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 82997 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/velocity/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\velocity\lib).
>   [junit4]   2> 82997 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 83065 T150 oasu.SolrIndexConfig.<init> IndexWriter infoStream solr logging is enabled
>   [junit4]   2> 83069 T150 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 83199 T150 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 83200 T150 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 83224 T150 oass.IndexSchema.readSchema [collection1] Schema name=example
>   [junit4]   2> 84267 T150 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 84292 T150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 84314 T150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 84348 T150 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
>   [junit4]   2> 84349 T150 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
>   [junit4]   2> 84349 T150 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
>   [junit4]   2> 84349 T150 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
>   [junit4]   2> 84349 T150 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
>   [junit4]   2> 84350 T150 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
>   [junit4]   2> 84350 T150 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index/
>   [junit4]   2> 84350 T150 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index' doesn't exist. Creating new index...
>   [junit4]   2> 84354 T150 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index
>   [junit4]   2> 84357 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: current segments file is "null"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@70760c9f
>   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
>   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: init: create=true
>   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: 
>   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index)
>   [junit4]   2> 	index=
>   [junit4]   2> 	version=5.0-SNAPSHOT
>   [junit4]   2> 	matchVersion=LUCENE_50
>   [junit4]   2> 	analyzer=null
>   [junit4]   2> 	ramBufferSizeMB=100.0
>   [junit4]   2> 	maxBufferedDocs=-1
>   [junit4]   2> 	maxBufferedDeleteTerms=-1
>   [junit4]   2> 	mergedSegmentWarmer=null
>   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
>   [junit4]   2> 	commit=null
>   [junit4]   2> 	openMode=CREATE
>   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
>   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
>   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
>   [junit4]   2> 	writeLockTimeout=1000
>   [junit4]   2> 	codec=Lucene46
>   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
>   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@5636d467
>   [junit4]   2> 	readerPooling=false
>   [junit4]   2> 	perThreadHardLimitMB=1945
>   [junit4]   2> 	useCompoundFile=false
>   [junit4]   2> 	
>   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: now flush at close waitForMerges=true
>   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   start flush: applyAllDeletes=true
>   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   index before flush 
>   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
>   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
>   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
>   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@29b2e269 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]: now merge
>   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]:   index: 
>   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]:   no more merges pending; now return
>   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: waitForMerges
>   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: waitForMerges done
>   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: now call final commit()
>   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: start
>   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: enter lock
>   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: now prepare
>   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: prepareCommit: flush
>   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   index before flush 
>   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
>   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
>   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@29b2e269 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
>   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: startCommit(): start
>   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: startCommit index= changeCount=1
>   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: done all syncs: []
>   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: pendingCommit != null
>   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: wrote segments file "segments_1"
>   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = true]
>   [junit4]   2> 84365 T150 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index),segFN=segments_1,generation=1}
>   [junit4]   2> 84366 T150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: done
>   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: at close: 
>   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
>   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
>   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
>   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
>   [junit4]   2> 84368 T150 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
>   [junit4]   2> 84371 T150 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 84371 T150 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/json: solr.UpdateRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: solr.UpdateRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/extract: solr.extraction.ExtractingRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
>   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
>   [junit4]   2> 84373 T150 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /suggest: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
>   [junit4]   2> 84386 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 84386 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 84389 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 84400 T150 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
>   [junit4]   2> 84400 T150 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: current segments file is "segments_1"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@70760c9f
>   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: load commit "segments_1"
>   [junit4]   2> 84401 T150 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index),segFN=segments_1,generation=1}
>   [junit4]   2> 84401 T150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: init: create=false
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: 
>   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index)
>   [junit4]   2> 	index=
>   [junit4]   2> 	version=5.0-SNAPSHOT
>   [junit4]   2> 	matchVersion=LUCENE_50
>   [junit4]   2> 	analyzer=null
>   [junit4]   2> 	ramBufferSizeMB=100.0
>   [junit4]   2> 	maxBufferedDocs=-1
>   [junit4]   2> 	maxBufferedDeleteTerms=-1
>   [junit4]   2> 	mergedSegmentWarmer=null
>   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
>   [junit4]   2> 	commit=null
>   [junit4]   2> 	openMode=APPEND
>   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
>   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
>   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
>   [junit4]   2> 	writeLockTimeout=1000
>   [junit4]   2> 	codec=Lucene46
>   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
>   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@3ef2f9ff
>   [junit4]   2> 	readerPooling=false
>   [junit4]   2> 	perThreadHardLimitMB=1945
>   [junit4]   2> 	useCompoundFile=false
>   [junit4]   2> 	
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: flush at getReader
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
>   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: return reader version=1 reader=StandardDirectoryReader(segments_1:1:nrt)
>   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
>   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: getReader took 2 msec
>   [junit4]   2> 84404 T150 oass.SolrIndexSearcher.<init> Opening Searcher@20c6cd09[collection1] main
>   [junit4]   2> 84404 T150 oashc.SpellCheckComponent.inform Initializing spell checkers
>   [junit4]   2> 84406 T150 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
>   [junit4]   2> 84406 T150 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
>   [junit4]   2> 84406 T150 oashc.SuggestComponent.inform Initializing SuggestComponent
>   [junit4]   2> 84406 T150 oasss.SolrSuggester.init init: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
>   [junit4]   2> 84407 T150 oasss.SolrSuggester.init Dictionary loaded with params: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
>   [junit4]   2> 84408 T150 oashc.QueryElevationComponent.inform Loading QueryElevation from: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\conf\elevate.xml
>   [junit4]   2> 84443 T150 oash.ReplicationHandler.inform Commits will be reserved for  10000
>   [junit4]   2> 84443 T150 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 84444 T140 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
>   [junit4]   2> 84444 T140 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 84444 T140 oas.SolrJettyTestBase.createJetty Jetty Assigned Port#56002
>   [junit4]   2> 84451 T151 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@20c6cd09[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> ASYNC  NEW_CORE C85 name=collection1 org.apache.solr.core.SolrCore@3da9cc12
>   [junit4]   2> 84453 T151 C85 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=static+firstSearcher+warming+in+solrconfig.xml&distrib=false&event=firstSearcher} hits=0 status=0 QTime=2 
>   [junit4]   2> 84453 T151 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
>   [junit4]   2> 84453 T151 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
>   [junit4]   2> 84453 T151 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
>   [junit4]   2> 84453 T151 oashc.SuggestComponent$SuggesterListener.newSearcher Loading suggester index for: mySuggester
>   [junit4]   2> 84453 T151 oasss.SolrSuggester.reload reload()
>   [junit4]   2> 84454 T151 oasss.SolrSuggester.build build()
>   [junit4]   2> 84459 T151 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20c6cd09[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 84467 T140 oas.SolrTestCaseJ4.setUp ###Starting testRedirect
>   [junit4]   2> 84577 T147 C85 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=1 
>   [junit4]   2> 84581 T140 oas.SolrTestCaseJ4.tearDown ###Ending testRedirect
>   [junit4]   2> 84597 T140 oas.SolrTestCaseJ4.setUp ###Starting testUpdate
>   [junit4]   2> 84666 T140 oas.SolrTestCaseJ4.tearDown ###Ending testUpdate
>   [junit4]   2> 84679 T140 oas.SolrTestCaseJ4.setUp ###Starting testQuery
>   [junit4]   2> 84738 T140 oas.SolrTestCaseJ4.tearDown ###Ending testQuery
>   [junit4]   2> 84747 T140 oas.SolrTestCaseJ4.setUp ###Starting testSolrExceptionCodeNotFromSolr
>   [junit4]   2> 84800 T140 oas.SolrTestCaseJ4.tearDown ###Ending testSolrExceptionCodeNotFromSolr
>   [junit4]   1> org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
>   [junit4]   1> <head>
>   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
>   [junit4]   1> <title>Error 527 527</title>
>   [junit4]   1> </head>
>   [junit4]   1> <body>
>   [junit4]   1> <h2>HTTP ERROR: 527</h2>
>   [junit4]   1> <p>Problem accessing /solr/debug/foo/select. Reason:
>   [junit4]   1> <pre>    527</pre></p>
>   [junit4]   1> <hr /><i><small>Powered by Jetty://</small></i>
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1> </body>
>   [junit4]   1> </html>
>   [junit4]   1> 
>   [junit4]   2> 84812 T140 oas.SolrTestCaseJ4.setUp ###Starting testSetParametersExternalClient
>   [junit4]   2> 84817 T140 oas.SolrTestCaseJ4.tearDown ###Ending testSetParametersExternalClient
>   [junit4]   2> 84830 T140 oas.SolrTestCaseJ4.setUp ###Starting testTimeout
>   [junit4]   2> 86728 T140 oas.SolrTestCaseJ4.tearDown ###Ending testTimeout
>   [junit4]   2> 86747 T140 oas.SolrTestCaseJ4.setUp ###Starting testCompression
>   [junit4]   2> ASYNC  NEW_CORE C86 name=collection1 org.apache.solr.core.SolrCore@3da9cc12
>   [junit4]   2> 86876 T146 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=xml&q=foo} hits=0 status=0 QTime=1 
>   [junit4]   2> 86930 T145 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=foo&version=2} hits=0 status=0 QTime=0 
>   [junit4]   2> 86938 T140 oas.SolrTestCaseJ4.tearDown ###Ending testCompression
>   [junit4]   2> 86948 T140 oas.SolrTestCaseJ4.setUp ###Starting testExampleKeystorePath
>   [junit4]   2> 86949 T140 oas.SolrTestCaseJ4.tearDown ###Ending testExampleKeystorePath
>   [junit4]   2> 86961 T140 oas.SolrTestCaseJ4.setUp ###Starting testGetRawStream
>   [junit4]   2> 86992 T144 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={} hits=0 status=0 QTime=1 
>   [junit4]   2> 86994 T140 oas.SolrTestCaseJ4.tearDown ###Ending testGetRawStream
>   [junit4]   2> 87004 T140 oas.SolrTestCaseJ4.setUp ###Starting testDelete
>   [junit4]   2> 87040 T140 oas.SolrTestCaseJ4.tearDown ###Ending testDelete
>   [junit4]   2> 87051 T140 oas.SolrTestCaseJ4.setUp ###Starting testConnectionRefused
>   [junit4]   2> 87511 T140 oas.SolrTestCaseJ4.tearDown ###Ending testConnectionRefused
>   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicHttpSolrServerTest -Dtests.method=testConnectionRefused -Dtests.seed=34D7B74EB30FBF7E -Dtests.slow=true -Dtests.locale=ga_IE -Dtests.timezone=Africa/Asmara -Dtests.file.encoding=ISO-8859-1
>   [junit4] FAILURE 0.53s | BasicHttpSolrServerTest.testConnectionRefused <<<
>   [junit4]    > Throwable #1: java.lang.AssertionError
>   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([34D7B74EB30FBF7E:1B7E135F6480F07A]:0)
>   [junit4]    > 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
>   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 87579 T140 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1230126684
>   [junit4]   2> 87580 T140 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3da9cc12
>   [junit4]   2> 87580 T140 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>   [junit4]   2> 87580 T140 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
>   [junit4]   2> 87581 T140 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
>   [junit4]   2> 87581 T140 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
>   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now flush at close waitForMerges=true
>   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   start flush: applyAllDeletes=true
>   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index before flush 
>   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker startFullFlush
>   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker finishFullFlush success=true
>   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: apply all deletes during flush
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now merge
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index: 
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   no more merges pending; now return
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: waitForMerges
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: waitForMerges done
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now call final commit()
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: start
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: enter lock
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: now prepare
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prepareCommit: flush
>   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index before flush 
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker startFullFlush
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: apply all deletes during flush
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker finishFullFlush success=true
>   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: startCommit(): start
>   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   skip startCommit(): no changes pending
>   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: pendingCommit == null; skip
>   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: done
>   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: at close: 
>   [junit4]   2> 87592 T140 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
>   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
>   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\;done=false>>]
>   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
>   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index;done=false>>]
>   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index
>   [junit4]   2> 87593 T140 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
>   [junit4]   2> 87646 T140 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ga_IE, timezone=Africa/Asmara
>   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=6529928,total=68829184
>   [junit4]   2> NOTE: All tests run in this JVM: [TermsResponseTest, QueryResponseTest, AnlysisResponseBaseTest, SolrExampleEmbeddedTest, TestHash, TestSolrProperties, SolrExampleStreamingBinaryTest, SolrDocumentTest, TestBatchUpdate, DocumentAnalysisResponseTest, MultiCoreEmbeddedTest, ContentStreamTest, SolrExampleBinaryTest, SolrQueryTest, SolrExceptionTest, BasicHttpSolrServerTest]
>   [junit4] Completed in 5.06s, 11 tests, 1 failure <<< FAILURES!
> 
> [...truncated 99 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:202: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 48 suites, 280 tests, 1 failure
> 
> Total time: 89 minutes 43 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_51) - Build # 3798 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3798/
Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([34D7B74EB30FBF7E:1B7E135F6480F07A]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 11443 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest
   [junit4]   2> 82704 T140 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 82705 T140 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\.\solrtest-BasicHttpSolrServerTest-1392853661222
   [junit4]   2> 82705 T140 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 82708 T140 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 82724 T140 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 82735 T140 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56002
   [junit4]   2> 82739 T140 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 82739 T140 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\'
   [junit4]   2> 82776 T140 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\solr.xml
   [junit4]   2> 82892 T140 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 82893 T140 oasc.CoreContainer.<init> New CoreContainer 1230126684
   [junit4]   2> 82893 T140 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\]
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 82897 T140 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 82898 T140 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 82911 T140 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 82911 T140 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 82912 T140 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 82919 T140 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 82934 T140 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\
   [junit4]   2> 82935 T140 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 82937 T150 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1
   [junit4]   2> 82943 T150 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\'
   [junit4]   2> 82990 T150 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/extraction/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\extraction\lib).
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/clustering/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\clustering\lib).
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/langid/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\langid\lib).
   [junit4]   2> 82993 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 82997 T150 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/velocity/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\velocity\lib).
   [junit4]   2> 82997 T150 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 83065 T150 oasu.SolrIndexConfig.<init> IndexWriter infoStream solr logging is enabled
   [junit4]   2> 83069 T150 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 83199 T150 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 83200 T150 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 83224 T150 oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 84267 T150 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 84292 T150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 84314 T150 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 84348 T150 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 84349 T150 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
   [junit4]   2> 84349 T150 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 84349 T150 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   2> 84349 T150 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
   [junit4]   2> 84350 T150 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
   [junit4]   2> 84350 T150 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index/
   [junit4]   2> 84350 T150 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index' doesn't exist. Creating new index...
   [junit4]   2> 84354 T150 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index
   [junit4]   2> 84357 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: current segments file is "null"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@70760c9f
   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: init: create=true
   [junit4]   2> 84358 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index)
   [junit4]   2> 	index=
   [junit4]   2> 	version=5.0-SNAPSHOT
   [junit4]   2> 	matchVersion=LUCENE_50
   [junit4]   2> 	analyzer=null
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=CREATE
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene46
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@5636d467
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	
   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: now flush at close waitForMerges=true
   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   start flush: applyAllDeletes=true
   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   index before flush 
   [junit4]   2> 84359 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
   [junit4]   2> 84360 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@29b2e269 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]: now merge
   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]:   index: 
   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-83-thread-1]:   no more merges pending; now return
   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: waitForMerges
   [junit4]   2> 84361 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: waitForMerges done
   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: now call final commit()
   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: start
   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: enter lock
   [junit4]   2> 84362 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: now prepare
   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: prepareCommit: flush
   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]:   index before flush 
   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 84363 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@29b2e269 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: startCommit(): start
   [junit4]   2> 84364 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: startCommit index= changeCount=1
   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: done all syncs: []
   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: pendingCommit != null
   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: wrote segments file "segments_1"
   [junit4]   2> 84365 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = true]
   [junit4]   2> 84365 T150 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index),segFN=segments_1,generation=1}
   [junit4]   2> 84366 T150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: commit: done
   [junit4]   2> 84366 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: at close: 
   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
   [junit4]   2> 84368 T150 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
   [junit4]   2> 84368 T150 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 84371 T150 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 84371 T150 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/json: solr.UpdateRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: solr.UpdateRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /update/extract: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 84372 T150 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 84373 T150 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /suggest: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 84374 T150 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
   [junit4]   2> 84386 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84386 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84389 T150 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 84400 T150 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 84400 T150 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: current segments file is "segments_1"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@70760c9f
   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: init: load commit "segments_1"
   [junit4]   2> 84401 T150 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index),segFN=segments_1,generation=1}
   [junit4]   2> 84401 T150 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 84401 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-83-thread-1]: 0 msec to checkpoint
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: init: create=false
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@6c63f864 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index)
   [junit4]   2> 	index=
   [junit4]   2> 	version=5.0-SNAPSHOT
   [junit4]   2> 	matchVersion=LUCENE_50
   [junit4]   2> 	analyzer=null
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=APPEND
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene46
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@3ef2f9ff
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: flush at getReader
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 startFullFlush
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 84402 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: apply all deletes during flush
   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-83-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: return reader version=1 reader=StandardDirectoryReader(segments_1:1:nrt)
   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-83-thread-1]: coreLoadExecutor-83-thread-1 finishFullFlush success=true
   [junit4]   2> 84404 T150 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-83-thread-1]: getReader took 2 msec
   [junit4]   2> 84404 T150 oass.SolrIndexSearcher.<init> Opening Searcher@20c6cd09[collection1] main
   [junit4]   2> 84404 T150 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 84406 T150 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 84406 T150 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
   [junit4]   2> 84406 T150 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 84406 T150 oasss.SolrSuggester.init init: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
   [junit4]   2> 84407 T150 oasss.SolrSuggester.init Dictionary loaded with params: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
   [junit4]   2> 84408 T150 oashc.QueryElevationComponent.inform Loading QueryElevation from: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\conf\elevate.xml
   [junit4]   2> 84443 T150 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 84443 T150 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 84444 T140 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 84444 T140 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 84444 T140 oas.SolrJettyTestBase.createJetty Jetty Assigned Port#56002
   [junit4]   2> 84451 T151 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@20c6cd09[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> ASYNC  NEW_CORE C85 name=collection1 org.apache.solr.core.SolrCore@3da9cc12
   [junit4]   2> 84453 T151 C85 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=static+firstSearcher+warming+in+solrconfig.xml&distrib=false&event=firstSearcher} hits=0 status=0 QTime=2 
   [junit4]   2> 84453 T151 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 84453 T151 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 84453 T151 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 84453 T151 oashc.SuggestComponent$SuggesterListener.newSearcher Loading suggester index for: mySuggester
   [junit4]   2> 84453 T151 oasss.SolrSuggester.reload reload()
   [junit4]   2> 84454 T151 oasss.SolrSuggester.build build()
   [junit4]   2> 84459 T151 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@20c6cd09[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 84467 T140 oas.SolrTestCaseJ4.setUp ###Starting testRedirect
   [junit4]   2> 84577 T147 C85 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=1 
   [junit4]   2> 84581 T140 oas.SolrTestCaseJ4.tearDown ###Ending testRedirect
   [junit4]   2> 84597 T140 oas.SolrTestCaseJ4.setUp ###Starting testUpdate
   [junit4]   2> 84666 T140 oas.SolrTestCaseJ4.tearDown ###Ending testUpdate
   [junit4]   2> 84679 T140 oas.SolrTestCaseJ4.setUp ###Starting testQuery
   [junit4]   2> 84738 T140 oas.SolrTestCaseJ4.tearDown ###Ending testQuery
   [junit4]   2> 84747 T140 oas.SolrTestCaseJ4.setUp ###Starting testSolrExceptionCodeNotFromSolr
   [junit4]   2> 84800 T140 oas.SolrTestCaseJ4.tearDown ###Ending testSolrExceptionCodeNotFromSolr
   [junit4]   1> org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]   1> <title>Error 527 527</title>
   [junit4]   1> </head>
   [junit4]   1> <body>
   [junit4]   1> <h2>HTTP ERROR: 527</h2>
   [junit4]   1> <p>Problem accessing /solr/debug/foo/select. Reason:
   [junit4]   1> <pre>    527</pre></p>
   [junit4]   1> <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> 
   [junit4]   2> 84812 T140 oas.SolrTestCaseJ4.setUp ###Starting testSetParametersExternalClient
   [junit4]   2> 84817 T140 oas.SolrTestCaseJ4.tearDown ###Ending testSetParametersExternalClient
   [junit4]   2> 84830 T140 oas.SolrTestCaseJ4.setUp ###Starting testTimeout
   [junit4]   2> 86728 T140 oas.SolrTestCaseJ4.tearDown ###Ending testTimeout
   [junit4]   2> 86747 T140 oas.SolrTestCaseJ4.setUp ###Starting testCompression
   [junit4]   2> ASYNC  NEW_CORE C86 name=collection1 org.apache.solr.core.SolrCore@3da9cc12
   [junit4]   2> 86876 T146 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=xml&q=foo} hits=0 status=0 QTime=1 
   [junit4]   2> 86930 T145 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=foo&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 86938 T140 oas.SolrTestCaseJ4.tearDown ###Ending testCompression
   [junit4]   2> 86948 T140 oas.SolrTestCaseJ4.setUp ###Starting testExampleKeystorePath
   [junit4]   2> 86949 T140 oas.SolrTestCaseJ4.tearDown ###Ending testExampleKeystorePath
   [junit4]   2> 86961 T140 oas.SolrTestCaseJ4.setUp ###Starting testGetRawStream
   [junit4]   2> 86992 T144 C86 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={} hits=0 status=0 QTime=1 
   [junit4]   2> 86994 T140 oas.SolrTestCaseJ4.tearDown ###Ending testGetRawStream
   [junit4]   2> 87004 T140 oas.SolrTestCaseJ4.setUp ###Starting testDelete
   [junit4]   2> 87040 T140 oas.SolrTestCaseJ4.tearDown ###Ending testDelete
   [junit4]   2> 87051 T140 oas.SolrTestCaseJ4.setUp ###Starting testConnectionRefused
   [junit4]   2> 87511 T140 oas.SolrTestCaseJ4.tearDown ###Ending testConnectionRefused
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicHttpSolrServerTest -Dtests.method=testConnectionRefused -Dtests.seed=34D7B74EB30FBF7E -Dtests.slow=true -Dtests.locale=ga_IE -Dtests.timezone=Africa/Asmara -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.53s | BasicHttpSolrServerTest.testConnectionRefused <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([34D7B74EB30FBF7E:1B7E135F6480F07A]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 87579 T140 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1230126684
   [junit4]   2> 87580 T140 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3da9cc12
   [junit4]   2> 87580 T140 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 87580 T140 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 87581 T140 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 87581 T140 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now flush at close waitForMerges=true
   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   start flush: applyAllDeletes=true
   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index before flush 
   [junit4]   2> 87582 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker startFullFlush
   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker finishFullFlush success=true
   [junit4]   2> 87583 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: apply all deletes during flush
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now merge
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index: 
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   no more merges pending; now return
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: waitForMerges
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: waitForMerges done
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: now call final commit()
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: start
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: enter lock
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: now prepare
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prepareCommit: flush
   [junit4]   2> 87584 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   index before flush 
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker startFullFlush
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: apply all deletes during flush
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@41faf4a2 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker finishFullFlush success=true
   [junit4]   2> 87587 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: startCommit(): start
   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]:   skip startCommit(): no changes pending
   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: pendingCommit == null; skip
   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: commit: done
   [junit4]   2> 87588 T140 C86 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[34D7B74EB30FBF7E]-worker]: at close: 
   [junit4]   2> 87592 T140 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\;done=false>>]
   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\
   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index;done=false>>]
   [junit4]   2> 87593 T140 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392853661222\index
   [junit4]   2> 87593 T140 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 87646 T140 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting, sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ga_IE, timezone=Africa/Asmara
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=6529928,total=68829184
   [junit4]   2> NOTE: All tests run in this JVM: [TermsResponseTest, QueryResponseTest, AnlysisResponseBaseTest, SolrExampleEmbeddedTest, TestHash, TestSolrProperties, SolrExampleStreamingBinaryTest, SolrDocumentTest, TestBatchUpdate, DocumentAnalysisResponseTest, MultiCoreEmbeddedTest, ContentStreamTest, SolrExampleBinaryTest, SolrQueryTest, SolrExceptionTest, BasicHttpSolrServerTest]
   [junit4] Completed in 5.06s, 11 tests, 1 failure <<< FAILURES!

[...truncated 99 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:202: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 48 suites, 280 tests, 1 failure

Total time: 89 minutes 43 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3797 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
I’ll likely end up disabling a few more tests from randomly using SSL before long.

- Mark

http://about.me/markrmiller

On Feb 19, 2014, at 1:15 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3797/
> Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
> 
> 1 tests failed.
> FAILED:  org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused
> 
> Error Message:
> 
> 
> Stack Trace:
> java.lang.AssertionError
> 	at __randomizedtesting.SeedInfo.seed([D9FFBFD4C53F521B:F6561BC512B01D1F]:0)
> 	at org.junit.Assert.fail(Assert.java:92)
> 	at org.junit.Assert.assertTrue(Assert.java:43)
> 	at org.junit.Assert.assertTrue(Assert.java:54)
> 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> 
> 
> 
> Build Log:
> [...truncated 11456 lines...]
>   [junit4] Suite: org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest
>   [junit4]   2> 101563 T328 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
>   [junit4]   2> 101564 T328 oas.SolrTestCaseJ4.initCore ####initCore
>   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\.\solrtest-BasicHttpSolrServerTest-1392833586585
>   [junit4]   2> 101565 T328 oas.SolrTestCaseJ4.initCore ####initCore end
>   [junit4]   2> 101565 T328 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 101574 T328 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 101585 T328 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64114
>   [junit4]   2> 101588 T328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\'
>   [junit4]   2> 101627 T328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\solr.xml
>   [junit4]   2> 101697 T328 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 101697 T328 oasc.CoreContainer.<init> New CoreContainer 433941539
>   [junit4]   2> 101697 T328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\]
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 101716 T328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 101716 T328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 101716 T328 oasc.CoreContainer.load Host Name: 
>   [junit4]   2> 101757 T328 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
>   [junit4]   2> 101769 T328 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\
>   [junit4]   2> 101772 T328 oasc.CorePropertiesLocator.discover Found 1 core definitions
>   [junit4]   2> 101773 T338 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1
>   [junit4]   2> 101774 T338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\'
>   [junit4]   2> 101865 T338 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
>   [junit4]   2> 101866 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/extraction/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\extraction\lib).
>   [junit4]   2> 101866 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 101868 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/clustering/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\clustering\lib).
>   [junit4]   2> 101868 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/langid/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\langid\lib).
>   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/velocity/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\velocity\lib).
>   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
>   [junit4]   2> 101919 T338 oasu.SolrIndexConfig.<init> IndexWriter infoStream solr logging is enabled
>   [junit4]   2> 101922 T338 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 102000 T338 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 102000 T338 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 102025 T338 oass.IndexSchema.readSchema [collection1] Schema name=example
>   [junit4]   2> 102798 T338 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 102824 T338 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 102829 T338 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 102891 T338 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
>   [junit4]   2> 102891 T338 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
>   [junit4]   2> 102891 T338 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71c26dad
>   [junit4]   2> 102892 T338 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
>   [junit4]   2> 102892 T338 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
>   [junit4]   2> 102892 T338 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
>   [junit4]   2> 102892 T338 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index/
>   [junit4]   2> 102892 T338 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index' doesn't exist. Creating new index...
>   [junit4]   2> 102894 T338 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index
>   [junit4]   2> 102895 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: current segments file is "null"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@5b00667d
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: init: create=true
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: 
>   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index)
>   [junit4]   2> 	index=
>   [junit4]   2> 	version=5.0-SNAPSHOT
>   [junit4]   2> 	matchVersion=LUCENE_50
>   [junit4]   2> 	analyzer=null
>   [junit4]   2> 	ramBufferSizeMB=100.0
>   [junit4]   2> 	maxBufferedDocs=-1
>   [junit4]   2> 	maxBufferedDeleteTerms=-1
>   [junit4]   2> 	mergedSegmentWarmer=null
>   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
>   [junit4]   2> 	commit=null
>   [junit4]   2> 	openMode=CREATE
>   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
>   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
>   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
>   [junit4]   2> 	writeLockTimeout=1000
>   [junit4]   2> 	codec=Lucene46
>   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
>   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@7748c737
>   [junit4]   2> 	readerPooling=false
>   [junit4]   2> 	perThreadHardLimitMB=1945
>   [junit4]   2> 	useCompoundFile=false
>   [junit4]   2> 	
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: now flush at close waitForMerges=true
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   start flush: applyAllDeletes=true
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   index before flush 
>   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
>   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
>   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
>   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@4b0f290f minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]: now merge
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]:   index: 
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]:   no more merges pending; now return
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: waitForMerges
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: waitForMerges done
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: now call final commit()
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: start
>   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: enter lock
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: now prepare
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: prepareCommit: flush
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   index before flush 
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@4b0f290f minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: startCommit(): start
>   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: startCommit index= changeCount=1
>   [junit4]   2> 102900 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: done all syncs: []
>   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: pendingCommit != null
>   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: wrote segments file "segments_1"
>   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = true]
>   [junit4]   2> 102901 T338 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index),segFN=segments_1,generation=1}
>   [junit4]   2> 102901 T338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: done
>   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: at close: 
>   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
>   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
>   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
>   [junit4]   2> 102904 T338 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
>   [junit4]   2> 102904 T338 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
>   [junit4]   2> 102908 T338 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 102909 T338 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
>   [junit4]   2> 102909 T338 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
>   [junit4]   2> 102910 T338 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 102910 T338 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/json: solr.UpdateRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: solr.UpdateRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/extract: solr.extraction.ExtractingRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
>   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
>   [junit4]   2> 102914 T338 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
>   [junit4]   2> 102914 T338 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
>   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
>   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
>   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig created /suggest: solr.SearchHandler
>   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
>   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
>   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
>   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
>   [junit4]   2> 102928 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 102930 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 102932 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 102941 T338 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
>   [junit4]   2> 102942 T338 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 102943 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: current segments file is "segments_1"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@5b00667d
>   [junit4]   2> 102944 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: load commit "segments_1"
>   [junit4]   2> 102944 T338 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index),segFN=segments_1,generation=1}
>   [junit4]   2> 102944 T338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 102944 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
>   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
>   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: init: create=false
>   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: 
>   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index)
>   [junit4]   2> 	index=
>   [junit4]   2> 	version=5.0-SNAPSHOT
>   [junit4]   2> 	matchVersion=LUCENE_50
>   [junit4]   2> 	analyzer=null
>   [junit4]   2> 	ramBufferSizeMB=100.0
>   [junit4]   2> 	maxBufferedDocs=-1
>   [junit4]   2> 	maxBufferedDeleteTerms=-1
>   [junit4]   2> 	mergedSegmentWarmer=null
>   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
>   [junit4]   2> 	commit=null
>   [junit4]   2> 	openMode=APPEND
>   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
>   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
>   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
>   [junit4]   2> 	writeLockTimeout=1000
>   [junit4]   2> 	codec=Lucene46
>   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
>   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
>   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@23103e48
>   [junit4]   2> 	readerPooling=false
>   [junit4]   2> 	perThreadHardLimitMB=1945
>   [junit4]   2> 	useCompoundFile=false
>   [junit4]   2> 	
>   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: flush at getReader
>   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
>   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
>   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: return reader version=1 reader=StandardDirectoryReader(segments_1:1:nrt)
>   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
>   [junit4]   2> 102947 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: getReader took 2 msec
>   [junit4]   2> 102947 T338 oass.SolrIndexSearcher.<init> Opening Searcher@4293aa50[collection1] main
>   [junit4]   2> 102947 T338 oashc.SpellCheckComponent.inform Initializing spell checkers
>   [junit4]   2> 102947 T338 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
>   [junit4]   2> 102948 T338 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
>   [junit4]   2> 102948 T338 oashc.SuggestComponent.inform Initializing SuggestComponent
>   [junit4]   2> 102948 T338 oasss.SolrSuggester.init init: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
>   [junit4]   2> 102948 T338 oasss.SolrSuggester.init Dictionary loaded with params: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
>   [junit4]   2> 102950 T338 oashc.QueryElevationComponent.inform Loading QueryElevation from: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\conf\elevate.xml
>   [junit4]   2> 102984 T338 oash.ReplicationHandler.inform Commits will be reserved for  10000
>   [junit4]   2> 102985 T339 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@4293aa50[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> ASYNC  NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@26896b32
>   [junit4]   2> 102986 T339 C127 oasc.SolrCore.execute [collection1] webapp=null path=null params={event=firstSearcher&distrib=false&q=static+firstSearcher+warming+in+solrconfig.xml} hits=0 status=0 QTime=1 
>   [junit4]   2> 102986 T339 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
>   [junit4]   2> 102986 T339 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
>   [junit4]   2> 102986 T339 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
>   [junit4]   2> 102986 T339 oashc.SuggestComponent$SuggesterListener.newSearcher Loading suggester index for: mySuggester
>   [junit4]   2> 102986 T339 oasss.SolrSuggester.reload reload()
>   [junit4]   2> 102986 T339 oasss.SolrSuggester.build build()
>   [junit4]   2> 102993 T339 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4293aa50[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 102995 T338 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 102996 T328 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
>   [junit4]   2> 102996 T328 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 102996 T328 oas.SolrJettyTestBase.createJetty Jetty Assigned Port#64114
>   [junit4]   2> 103009 T328 oas.SolrTestCaseJ4.setUp ###Starting testQuery
>   [junit4]   2> 103138 T328 oas.SolrTestCaseJ4.tearDown ###Ending testQuery
>   [junit4]   2> 103147 T328 oas.SolrTestCaseJ4.setUp ###Starting testUpdate
>   [junit4]   2> 103223 T328 oas.SolrTestCaseJ4.tearDown ###Ending testUpdate
>   [junit4]   2> 103231 T328 oas.SolrTestCaseJ4.setUp ###Starting testTimeout
>   [junit4]   2> 105308 T328 oas.SolrTestCaseJ4.tearDown ###Ending testTimeout
>   [junit4]   2> 105318 T328 oas.SolrTestCaseJ4.setUp ###Starting testRedirect
>   [junit4]   2> ASYNC  NEW_CORE C128 name=collection1 org.apache.solr.core.SolrCore@26896b32
>   [junit4]   2> 105384 T335 C128 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=0 
>   [junit4]   2> 105396 T328 oas.SolrTestCaseJ4.tearDown ###Ending testRedirect
>   [junit4]   2> 105404 T328 oas.SolrTestCaseJ4.setUp ###Starting testDelete
>   [junit4]   2> 105469 T328 oas.SolrTestCaseJ4.tearDown ###Ending testDelete
>   [junit4]   2> 105478 T328 oas.SolrTestCaseJ4.setUp ###Starting testGetRawStream
>   [junit4]   2> 105525 T335 C128 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={} hits=0 status=0 QTime=0 
>   [junit4]   2> 105527 T328 oas.SolrTestCaseJ4.tearDown ###Ending testGetRawStream
>   [junit4]   2> 105535 T328 oas.SolrTestCaseJ4.setUp ###Starting testConnectionRefused
>   [junit4]   2> 106048 T328 oas.SolrTestCaseJ4.tearDown ###Ending testConnectionRefused
>   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicHttpSolrServerTest -Dtests.method=testConnectionRefused -Dtests.seed=D9FFBFD4C53F521B -Dtests.slow=true -Dtests.locale=en_SG -Dtests.timezone=Europe/Guernsey -Dtests.file.encoding=Cp1252
>   [junit4] FAILURE 0.58s | BasicHttpSolrServerTest.testConnectionRefused <<<
>   [junit4]    > Throwable #1: java.lang.AssertionError
>   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D9FFBFD4C53F521B:F6561BC512B01D1F]:0)
>   [junit4]    > 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
>   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 106110 T328 oas.SolrTestCaseJ4.setUp ###Starting testSolrExceptionCodeNotFromSolr
>   [junit4]   2> 106164 T328 oas.SolrTestCaseJ4.tearDown ###Ending testSolrExceptionCodeNotFromSolr
>   [junit4]   1> org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
>   [junit4]   1> <head>
>   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
>   [junit4]   1> <title>Error 527 527</title>
>   [junit4]   1> </head>
>   [junit4]   1> <body>
>   [junit4]   1> <h2>HTTP ERROR: 527</h2>
>   [junit4]   1> <p>Problem accessing /solr/debug/foo/select. Reason:
>   [junit4]   1> <pre>    527</pre></p>
>   [junit4]   1> <hr /><i><small>Powered by Jetty://</small></i>
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1>                                                 
>   [junit4]   1> </body>
>   [junit4]   1> </html>
>   [junit4]   1> 
>   [junit4]   2> 106171 T328 oas.SolrTestCaseJ4.setUp ###Starting testExampleKeystorePath
>   [junit4]   2> 106171 T328 oas.SolrTestCaseJ4.tearDown ###Ending testExampleKeystorePath
>   [junit4]   2> 106181 T328 oas.SolrTestCaseJ4.setUp ###Starting testSetParametersExternalClient
>   [junit4]   2> 106184 T328 oas.SolrTestCaseJ4.tearDown ###Ending testSetParametersExternalClient
>   [junit4]   2> 106193 T328 oas.SolrTestCaseJ4.setUp ###Starting testCompression
>   [junit4]   2> ASYNC  NEW_CORE C129 name=collection1 org.apache.solr.core.SolrCore@26896b32
>   [junit4]   2> 106347 T337 C129 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=xml&q=foo} hits=0 status=0 QTime=1 
>   [junit4]   2> 106471 T335 C129 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=foo&version=2} hits=0 status=0 QTime=0 
>   [junit4]   2> 106478 T328 oas.SolrTestCaseJ4.tearDown ###Ending testCompression
>   [junit4]   2> 106493 T328 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=433941539
>   [junit4]   2> 106493 T328 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@26896b32
>   [junit4]   2> 106515 T328 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>   [junit4]   2> 106515 T328 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
>   [junit4]   2> 106515 T328 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
>   [junit4]   2> 106517 T328 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
>   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now flush at close waitForMerges=true
>   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   start flush: applyAllDeletes=true
>   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index before flush 
>   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker startFullFlush
>   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker finishFullFlush success=true
>   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: apply all deletes during flush
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now merge
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index: 
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   no more merges pending; now return
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: waitForMerges
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: waitForMerges done
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now call final commit()
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: start
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: enter lock
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: now prepare
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prepareCommit: flush
>   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index before flush 
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker startFullFlush
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: apply all deletes during flush
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker finishFullFlush success=true
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: startCommit(): start
>   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   skip startCommit(): no changes pending
>   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: pendingCommit == null; skip
>   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: done
>   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: at close: 
>   [junit4]   2> 106528 T328 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
>   [junit4]   2> 106528 T328 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
>   [junit4]   2> 106528 T328 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\;done=false>>]
>   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
>   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index;done=false>>]
>   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index
>   [junit4]   2> 106530 T328 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
>   [junit4]   2> 106584 T328 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_SG, timezone=Europe/Guernsey
>   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=1,free=18549168,total=62844928
>   [junit4]   2> NOTE: All tests run in this JVM: [CloudSolrServerTest, TestXMLEscaping, ModifiableSolrParamsTest, MultiCoreExampleJettyTest, IteratorChainTest, FieldAnalysisResponseTest, SolrExampleStreamingTest, SolrQueryTest, TestHash, MergeIndexesEmbeddedTest, DocumentAnalysisResponseTest, QueryResponseTest, SolrExampleJettyTest, SolrExceptionTest, SolrExampleEmbeddedTest, ClientUtilsTest, TestNamedListCodec, SolrExampleBinaryTest, TestJavaBinCodec, MultiCoreEmbeddedTest, AnlysisResponseBaseTest, BasicHttpSolrServerTest]
>   [junit4] Completed in 5.08s, 11 tests, 1 failure <<< FAILURES!
> 
> [...truncated 84 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:202: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 48 suites, 280 tests, 1 failure
> 
> Total time: 83 minutes 47 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3797 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3797/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([D9FFBFD4C53F521B:F6561BC512B01D1F]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 11456 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest
   [junit4]   2> 101563 T328 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 101564 T328 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\.\solrtest-BasicHttpSolrServerTest-1392833586585
   [junit4]   2> 101565 T328 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 101565 T328 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 101574 T328 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 101585 T328 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:64114
   [junit4]   2> 101588 T328 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 101588 T328 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\'
   [junit4]   2> 101627 T328 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\solr.xml
   [junit4]   2> 101697 T328 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 101697 T328 oasc.CoreContainer.<init> New CoreContainer 433941539
   [junit4]   2> 101697 T328 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\]
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 101700 T328 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 101716 T328 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 101716 T328 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 101716 T328 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 101757 T328 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr
   [junit4]   2> 101769 T328 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\
   [junit4]   2> 101772 T328 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 101773 T338 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1
   [junit4]   2> 101774 T338 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\'
   [junit4]   2> 101865 T338 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 101866 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/extraction/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\extraction\lib).
   [junit4]   2> 101866 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 101868 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/clustering/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\clustering\lib).
   [junit4]   2> 101868 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/langid/lib/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\langid\lib).
   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN No files added to classloader from lib: ../../../contrib/velocity/lib (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\contrib\velocity\lib).
   [junit4]   2> 101870 T338 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../dist/ (resolved as: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\..\..\..\dist).
   [junit4]   2> 101919 T338 oasu.SolrIndexConfig.<init> IndexWriter infoStream solr logging is enabled
   [junit4]   2> 101922 T338 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 102000 T338 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 102000 T338 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 102025 T338 oass.IndexSchema.readSchema [collection1] Schema name=example
   [junit4]   2> 102798 T338 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 102824 T338 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 102829 T338 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 102891 T338 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 102891 T338 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
   [junit4]   2> 102891 T338 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@71c26dad
   [junit4]   2> 102892 T338 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   2> 102892 T338 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}
   [junit4]   2> 102892 T338 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
   [junit4]   2> 102892 T338 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index/
   [junit4]   2> 102892 T338 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index' doesn't exist. Creating new index...
   [junit4]   2> 102894 T338 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index
   [junit4]   2> 102895 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: current segments file is "null"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@5b00667d
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: init: create=true
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index)
   [junit4]   2> 	index=
   [junit4]   2> 	version=5.0-SNAPSHOT
   [junit4]   2> 	matchVersion=LUCENE_50
   [junit4]   2> 	analyzer=null
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=CREATE
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene46
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@7748c737
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: now flush at close waitForMerges=true
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   start flush: applyAllDeletes=true
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   index before flush 
   [junit4]   2> 102896 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
   [junit4]   2> 102897 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@4b0f290f minGen=9223372036854775807 packetCount=0
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]: now merge
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]:   index: 
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [CMS][coreLoadExecutor-155-thread-1]:   no more merges pending; now return
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: waitForMerges
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: waitForMerges done
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: now call final commit()
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: start
   [junit4]   2> 102898 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: enter lock
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: now prepare
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: prepareCommit: flush
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]:   index before flush 
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@4b0f290f minGen=9223372036854775807 packetCount=0
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: startCommit(): start
   [junit4]   2> 102899 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: startCommit index= changeCount=1
   [junit4]   2> 102900 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: done all syncs: []
   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: pendingCommit != null
   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: wrote segments file "segments_1"
   [junit4]   2> 102901 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = true]
   [junit4]   2> 102901 T338 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index),segFN=segments_1,generation=1}
   [junit4]   2> 102901 T338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: commit: done
   [junit4]   2> 102902 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: at close: 
   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
   [junit4]   2> 102903 T338 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
   [junit4]   2> 102904 T338 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
   [junit4]   2> 102904 T338 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 102908 T338 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 102909 T338 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 102909 T338 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
   [junit4]   2> 102910 T338 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 102910 T338 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/json: solr.UpdateRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: solr.UpdateRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /update/extract: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 102911 T338 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 102914 T338 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
   [junit4]   2> 102914 T338 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 102915 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig created /suggest: solr.SearchHandler
   [junit4]   2> 102916 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 102917 T338 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
   [junit4]   2> 102928 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 102930 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 102932 T338 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 102941 T338 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 102942 T338 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 102943 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: current segments file is "segments_1"; deletionPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper@5b00667d
   [junit4]   2> 102944 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: init: load commit "segments_1"
   [junit4]   2> 102944 T338 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index),segFN=segments_1,generation=1}
   [junit4]   2> 102944 T338 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 102944 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: now checkpoint "" [0 segments ; isCommit = false]
   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IFD][coreLoadExecutor-155-thread-1]: 0 msec to checkpoint
   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: init: create=false
   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: 
   [junit4]   2> 	dir=MockDirectoryWrapper(RAMDirectory@7398b4c1 lockFactory=NativeFSLockFactory@C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index)
   [junit4]   2> 	index=
   [junit4]   2> 	version=5.0-SNAPSHOT
   [junit4]   2> 	matchVersion=LUCENE_50
   [junit4]   2> 	analyzer=null
   [junit4]   2> 	ramBufferSizeMB=100.0
   [junit4]   2> 	maxBufferedDocs=-1
   [junit4]   2> 	maxBufferedDeleteTerms=-1
   [junit4]   2> 	mergedSegmentWarmer=null
   [junit4]   2> 	delPolicy=org.apache.solr.core.IndexDeletionPolicyWrapper
   [junit4]   2> 	commit=null
   [junit4]   2> 	openMode=APPEND
   [junit4]   2> 	similarity=org.apache.lucene.search.similarities.DefaultSimilarity
   [junit4]   2> 	mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=1, maxMergeCount=2, mergeThreadPriority=-1
   [junit4]   2> 	default WRITE_LOCK_TIMEOUT=1000
   [junit4]   2> 	writeLockTimeout=1000
   [junit4]   2> 	codec=Lucene46
   [junit4]   2> 	infoStream=org.apache.solr.update.LoggingInfoStream
   [junit4]   2> 	mergePolicy=[TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 	indexerThreadPool=org.apache.lucene.index.ThreadAffinityDocumentsWriterThreadPool@23103e48
   [junit4]   2> 	readerPooling=false
   [junit4]   2> 	perThreadHardLimitMB=1945
   [junit4]   2> 	useCompoundFile=false
   [junit4]   2> 	
   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: flush at getReader
   [junit4]   2> 102945 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 startFullFlush
   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: apply all deletes during flush
   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [BD][coreLoadExecutor-155-thread-1]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: return reader version=1 reader=StandardDirectoryReader(segments_1:1:nrt)
   [junit4]   2> 102946 T338 oasu.LoggingInfoStream.message [DW][coreLoadExecutor-155-thread-1]: coreLoadExecutor-155-thread-1 finishFullFlush success=true
   [junit4]   2> 102947 T338 oasu.LoggingInfoStream.message [IW][coreLoadExecutor-155-thread-1]: getReader took 2 msec
   [junit4]   2> 102947 T338 oass.SolrIndexSearcher.<init> Opening Searcher@4293aa50[collection1] main
   [junit4]   2> 102947 T338 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 102947 T338 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 102948 T338 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
   [junit4]   2> 102948 T338 oashc.SuggestComponent.inform Initializing SuggestComponent
   [junit4]   2> 102948 T338 oasss.SolrSuggester.init init: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
   [junit4]   2> 102948 T338 oasss.SolrSuggester.init Dictionary loaded with params: {name=mySuggester,lookupImpl=FuzzyLookupFactory,dictionaryImpl=DocumentDictionaryFactory,field=cat,weightField=price,suggestAnalyzerFieldType=string}
   [junit4]   2> 102950 T338 oashc.QueryElevationComponent.inform Loading QueryElevation from: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\example\solr\collection1\conf\elevate.xml
   [junit4]   2> 102984 T338 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 102985 T339 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@4293aa50[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> ASYNC  NEW_CORE C127 name=collection1 org.apache.solr.core.SolrCore@26896b32
   [junit4]   2> 102986 T339 C127 oasc.SolrCore.execute [collection1] webapp=null path=null params={event=firstSearcher&distrib=false&q=static+firstSearcher+warming+in+solrconfig.xml} hits=0 status=0 QTime=1 
   [junit4]   2> 102986 T339 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 102986 T339 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 102986 T339 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 102986 T339 oashc.SuggestComponent$SuggesterListener.newSearcher Loading suggester index for: mySuggester
   [junit4]   2> 102986 T339 oasss.SolrSuggester.reload reload()
   [junit4]   2> 102986 T339 oasss.SolrSuggester.build build()
   [junit4]   2> 102993 T339 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4293aa50[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 102995 T338 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 102996 T328 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0
   [junit4]   2> 102996 T328 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 102996 T328 oas.SolrJettyTestBase.createJetty Jetty Assigned Port#64114
   [junit4]   2> 103009 T328 oas.SolrTestCaseJ4.setUp ###Starting testQuery
   [junit4]   2> 103138 T328 oas.SolrTestCaseJ4.tearDown ###Ending testQuery
   [junit4]   2> 103147 T328 oas.SolrTestCaseJ4.setUp ###Starting testUpdate
   [junit4]   2> 103223 T328 oas.SolrTestCaseJ4.tearDown ###Ending testUpdate
   [junit4]   2> 103231 T328 oas.SolrTestCaseJ4.setUp ###Starting testTimeout
   [junit4]   2> 105308 T328 oas.SolrTestCaseJ4.tearDown ###Ending testTimeout
   [junit4]   2> 105318 T328 oas.SolrTestCaseJ4.setUp ###Starting testRedirect
   [junit4]   2> ASYNC  NEW_CORE C128 name=collection1 org.apache.solr.core.SolrCore@26896b32
   [junit4]   2> 105384 T335 C128 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=*:*&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 105396 T328 oas.SolrTestCaseJ4.tearDown ###Ending testRedirect
   [junit4]   2> 105404 T328 oas.SolrTestCaseJ4.setUp ###Starting testDelete
   [junit4]   2> 105469 T328 oas.SolrTestCaseJ4.tearDown ###Ending testDelete
   [junit4]   2> 105478 T328 oas.SolrTestCaseJ4.setUp ###Starting testGetRawStream
   [junit4]   2> 105525 T335 C128 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={} hits=0 status=0 QTime=0 
   [junit4]   2> 105527 T328 oas.SolrTestCaseJ4.tearDown ###Ending testGetRawStream
   [junit4]   2> 105535 T328 oas.SolrTestCaseJ4.setUp ###Starting testConnectionRefused
   [junit4]   2> 106048 T328 oas.SolrTestCaseJ4.tearDown ###Ending testConnectionRefused
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicHttpSolrServerTest -Dtests.method=testConnectionRefused -Dtests.seed=D9FFBFD4C53F521B -Dtests.slow=true -Dtests.locale=en_SG -Dtests.timezone=Europe/Guernsey -Dtests.file.encoding=Cp1252
   [junit4] FAILURE 0.58s | BasicHttpSolrServerTest.testConnectionRefused <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D9FFBFD4C53F521B:F6561BC512B01D1F]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.BasicHttpSolrServerTest.testConnectionRefused(BasicHttpSolrServerTest.java:158)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 106110 T328 oas.SolrTestCaseJ4.setUp ###Starting testSolrExceptionCodeNotFromSolr
   [junit4]   2> 106164 T328 oas.SolrTestCaseJ4.tearDown ###Ending testSolrExceptionCodeNotFromSolr
   [junit4]   1> org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   1> <head>
   [junit4]   1> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]   1> <title>Error 527 527</title>
   [junit4]   1> </head>
   [junit4]   1> <body>
   [junit4]   1> <h2>HTTP ERROR: 527</h2>
   [junit4]   1> <p>Problem accessing /solr/debug/foo/select. Reason:
   [junit4]   1> <pre>    527</pre></p>
   [junit4]   1> <hr /><i><small>Powered by Jetty://</small></i>
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1>                                                 
   [junit4]   1> </body>
   [junit4]   1> </html>
   [junit4]   1> 
   [junit4]   2> 106171 T328 oas.SolrTestCaseJ4.setUp ###Starting testExampleKeystorePath
   [junit4]   2> 106171 T328 oas.SolrTestCaseJ4.tearDown ###Ending testExampleKeystorePath
   [junit4]   2> 106181 T328 oas.SolrTestCaseJ4.setUp ###Starting testSetParametersExternalClient
   [junit4]   2> 106184 T328 oas.SolrTestCaseJ4.tearDown ###Ending testSetParametersExternalClient
   [junit4]   2> 106193 T328 oas.SolrTestCaseJ4.setUp ###Starting testCompression
   [junit4]   2> ASYNC  NEW_CORE C129 name=collection1 org.apache.solr.core.SolrCore@26896b32
   [junit4]   2> 106347 T337 C129 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=xml&q=foo} hits=0 status=0 QTime=1 
   [junit4]   2> 106471 T335 C129 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={wt=javabin&q=foo&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 106478 T328 oas.SolrTestCaseJ4.tearDown ###Ending testCompression
   [junit4]   2> 106493 T328 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=433941539
   [junit4]   2> 106493 T328 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@26896b32
   [junit4]   2> 106515 T328 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 106515 T328 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 106515 T328 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 106517 T328 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now flush at close waitForMerges=true
   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   start flush: applyAllDeletes=true
   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index before flush 
   [junit4]   2> 106518 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker startFullFlush
   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker finishFullFlush success=true
   [junit4]   2> 106519 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: apply all deletes during flush
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now merge
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index: 
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [CMS][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   no more merges pending; now return
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: waitForMerges
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: waitForMerges done
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: now call final commit()
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: start
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: enter lock
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: now prepare
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prepareCommit: flush
   [junit4]   2> 106520 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   index before flush 
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker startFullFlush
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: anyChanges? numDocsInRam=0 deletes=false hasTickets:false pendingChangesInFullFlush: false
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: apply all deletes during flush
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [BD][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: prune sis=org.apache.lucene.index.SegmentInfos@7f68faf3 minGen=9223372036854775807 packetCount=0
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [DW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker finishFullFlush success=true
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: startCommit(): start
   [junit4]   2> 106522 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]:   skip startCommit(): no changes pending
   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: pendingCommit == null; skip
   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: commit: done
   [junit4]   2> 106524 T328 C129 oasu.LoggingInfoStream.message [IW][SUITE-BasicHttpSolrServerTest-seed#[D9FFBFD4C53F521B]-worker]: at close: 
   [junit4]   2> 106528 T328 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 106528 T328 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 106528 T328 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\;done=false>>]
   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\
   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index;done=false>>]
   [junit4]   2> 106529 T328 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-solrj\test\J0\solrtest-BasicHttpSolrServerTest-1392833586585\index
   [junit4]   2> 106530 T328 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 106584 T328 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=en_SG, timezone=Europe/Guernsey
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=1,free=18549168,total=62844928
   [junit4]   2> NOTE: All tests run in this JVM: [CloudSolrServerTest, TestXMLEscaping, ModifiableSolrParamsTest, MultiCoreExampleJettyTest, IteratorChainTest, FieldAnalysisResponseTest, SolrExampleStreamingTest, SolrQueryTest, TestHash, MergeIndexesEmbeddedTest, DocumentAnalysisResponseTest, QueryResponseTest, SolrExampleJettyTest, SolrExceptionTest, SolrExampleEmbeddedTest, ClientUtilsTest, TestNamedListCodec, SolrExampleBinaryTest, TestJavaBinCodec, MultiCoreEmbeddedTest, AnlysisResponseBaseTest, BasicHttpSolrServerTest]
   [junit4] Completed in 5.08s, 11 tests, 1 failure <<< FAILURES!

[...truncated 84 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:202: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 48 suites, 280 tests, 1 failure

Total time: 83 minutes 47 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3796 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3796/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch

Error Message:
Timeout occured while waiting response from server at: https://127.0.0.1:57915/ea_tcq/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: Timeout occured while waiting response from server at: https://127.0.0.1:57915/ea_tcq/collection1
	at __randomizedtesting.SeedInfo.seed([F6C55C4DD347FB43:7723D255A4189B7F]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:503)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1654)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexQueryDeleteHierarchical(FullSolrCloudDistribCmdsTest.java:270)
	at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:130)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.GeneratedMethodAccessor56.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)
Caused by: java.net.SocketTimeoutException: Read timed out
	at java.net.SocketInputStream.socketRead0(Native Method)
	at java.net.SocketInputStream.read(SocketInputStream.java:152)
	at java.net.SocketInputStream.read(SocketInputStream.java:122)
	at sun.security.ssl.InputRecord.readFully(InputRecord.java:442)
	at sun.security.ssl.InputRecord.read(InputRecord.java:480)
	at sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:927)
	at sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:884)
	at sun.security.ssl.AppInputStream.read(AppInputStream.java:102)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.fillBuffer(AbstractSessionInputBuffer.java:160)
	at org.apache.http.impl.io.SocketInputBuffer.fillBuffer(SocketInputBuffer.java:84)
	at org.apache.http.impl.io.AbstractSessionInputBuffer.readLine(AbstractSessionInputBuffer.java:273)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:140)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
	... 47 more




Build Log:
[...truncated 10510 lines...]
   [junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
   [junit4]   2> 1815602 T7178 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1815603 T7178 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ea_tcq/
   [junit4]   2> 1815605 T7178 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-FullSolrCloudDistribCmdsTest-1392816735223
   [junit4]   2> 1815607 T7178 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1815607 T7179 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1815679 T7178 oasc.ZkTestServer.run start zk server on port:57905
   [junit4]   2> 1815682 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1815689 T7185 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@764562e4 name:ZooKeeperConnection Watcher:127.0.0.1:57905 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1815690 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1815691 T7178 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1815698 T7180 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444a58c4000000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1815700 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1815705 T7187 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7415d7a8 name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1815705 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1815705 T7178 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1815712 T7178 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1815718 T7178 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1815723 T7178 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1815732 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1815733 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1815743 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 1815743 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1815750 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1815750 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1815757 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1815757 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1815764 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1815764 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1815772 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1815773 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1815780 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1815780 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1815788 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1815789 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1815795 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1815795 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1815800 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1815800 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1815807 T7178 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1815807 T7178 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1815817 T7180 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444a58c4000001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1815819 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1815824 T7189 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41f8a673 name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1815824 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1816184 T7178 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1816190 T7178 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1816192 T7178 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57915
   [junit4]   2> 1816197 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1816197 T7178 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1816197 T7178 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445
   [junit4]   2> 1816197 T7178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\'
   [junit4]   2> 1816222 T7178 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\solr.xml
   [junit4]   2> 1816262 T7178 oasc.CoreContainer.<init> New CoreContainer 2008031637
   [junit4]   2> 1816262 T7178 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\]
   [junit4]   2> 1816264 T7178 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1816265 T7178 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1816265 T7178 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1816265 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1816265 T7178 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1816265 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1816266 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1816266 T7178 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1816266 T7178 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1816273 T7178 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1816273 T7178 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1816273 T7178 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1816274 T7178 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57905/solr
   [junit4]   2> 1816274 T7178 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1816275 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1816283 T7200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70bb9f85 name:ZooKeeperConnection Watcher:127.0.0.1:57905 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1816283 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1816286 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1816289 T7202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f44ba9c name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1816289 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1816291 T7178 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1816297 T7178 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1816302 T7178 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1816304 T7178 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57915_ea_tcq
   [junit4]   2> 1816306 T7178 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57915_ea_tcq
   [junit4]   2> 1816309 T7178 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1816312 T7178 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1816316 T7178 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:57915_ea_tcq
   [junit4]   2> 1816316 T7178 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1816319 T7178 oasc.Overseer.start Overseer (id=91279637560164356-127.0.0.1:57915_ea_tcq-n_0000000000) starting
   [junit4]   2> 1816323 T7178 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1816327 T7204 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1816328 T7178 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1816328 T7204 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1816330 T7178 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1816333 T7178 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1816336 T7203 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1816340 T7205 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1816340 T7205 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1816341 T7205 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1816341 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1816342 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1816343 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57915/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57915_ea_tcq",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1816343 T7203 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1816343 T7203 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1816346 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1816347 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1817058 T7205 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1817058 T7205 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\collection1
   [junit4]   2> 1817058 T7205 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1817060 T7205 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1817060 T7205 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1817063 T7205 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1817063 T7205 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\collection1\'
   [junit4]   2> 1817065 T7205 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445/collection1/lib/classes/' to classloader
   [junit4]   2> 1817065 T7205 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445/collection1/lib/README' to classloader
   [junit4]   2> 1817112 T7205 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1817140 T7205 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1817142 T7205 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1817148 T7205 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1817422 T7205 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1817425 T7205 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1817426 T7205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1817431 T7205 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1817457 T7205 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1817457 T7205 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-controljetty-1392816735445\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/control/data\
   [junit4]   2> 1817457 T7205 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f12d71
   [junit4]   2> 1817458 T7205 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/control/data\
   [junit4]   2> 1817458 T7205 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/control/data\index/
   [junit4]   2> 1817458 T7205 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1817458 T7205 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/control/data\index
   [junit4]   2> 1817459 T7205 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=60.29296875, floorSegmentMB=0.2197265625, forceMergeDeletesPctAllowed=19.07722615559962, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1817459 T7205 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1e536960 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a0ae59c),segFN=segments_1,generation=1}
   [junit4]   2> 1817459 T7205 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1817461 T7205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1817461 T7205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1817461 T7205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1817461 T7205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1817462 T7205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1817462 T7205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1817462 T7205 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1817463 T7205 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1817463 T7205 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1817463 T7205 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1817463 T7205 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1817463 T7205 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1817463 T7205 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1817463 T7205 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1817464 T7205 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1817464 T7205 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1817464 T7205 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1817470 T7205 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1817473 T7205 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1817474 T7205 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1817474 T7205 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=14.7587890625, floorSegmentMB=1.0791015625, forceMergeDeletesPctAllowed=29.02075003098731, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5532243669126932
   [junit4]   2> 1817475 T7205 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1e536960 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a0ae59c),segFN=segments_1,generation=1}
   [junit4]   2> 1817475 T7205 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1817475 T7205 oass.SolrIndexSearcher.<init> Opening Searcher@3a10d262[collection1] main
   [junit4]   2> 1817477 T7206 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3a10d262[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1817479 T7205 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1817480 T7178 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1817480 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1817480 T7209 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:57915/ea_tcq collection:control_collection shard:shard1
   [junit4]   2> 1817481 T7209 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1817487 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1817490 T7211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75194d51 name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1817491 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1817491 T7209 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1817492 T7178 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1817494 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817494 T7209 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1817494 T7209 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3497 name=collection1 org.apache.solr.core.SolrCore@46874932 url=https://127.0.0.1:57915/ea_tcq/collection1 node=127.0.0.1:57915_ea_tcq C3497_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:57915/ea_tcq, core=collection1, node_name=127.0.0.1:57915_ea_tcq}
   [junit4]   2> 1817494 T7209 C3497 P57915 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:57915/ea_tcq/collection1/
   [junit4]   2> 1817494 T7209 C3497 P57915 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1817495 T7209 C3497 P57915 oasc.SyncStrategy.syncToMe https://127.0.0.1:57915/ea_tcq/collection1/ has no replicas
   [junit4]   2> 1817495 T7209 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:57915/ea_tcq/collection1/ shard1
   [junit4]   2> 1817495 T7209 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1817496 T7178 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1817496 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1817502 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817505 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817510 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817585 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1817585 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1817616 T7209 oasc.ZkController.register We are https://127.0.0.1:57915/ea_tcq/collection1/ and leader is https://127.0.0.1:57915/ea_tcq/collection1/
   [junit4]   2> 1817616 T7209 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:57915/ea_tcq
   [junit4]   2> 1817616 T7209 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1817616 T7209 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1817616 T7209 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1817618 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817618 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817618 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817619 T7209 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1817620 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1817621 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57915/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57915_ea_tcq",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1817625 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1817700 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1817700 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1817849 T7178 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1817849 T7178 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1817855 T7178 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1817856 T7178 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57927
   [junit4]   2> 1817861 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1817861 T7178 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1817861 T7178 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113
   [junit4]   2> 1817861 T7178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\'
   [junit4]   2> 1817889 T7178 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\solr.xml
   [junit4]   2> 1817927 T7178 oasc.CoreContainer.<init> New CoreContainer 1551627068
   [junit4]   2> 1817928 T7178 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\]
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1817929 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1817930 T7178 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1817930 T7178 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1817936 T7178 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1817936 T7178 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1817937 T7178 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1817937 T7178 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57905/solr
   [junit4]   2> 1817937 T7178 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1817939 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1817946 T7222 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@41932dba name:ZooKeeperConnection Watcher:127.0.0.1:57905 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1817946 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1817949 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1817952 T7224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c8921b3 name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1817952 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1817957 T7178 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1818677 T7178 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57927_ea_tcq
   [junit4]   2> 1818681 T7178 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57927_ea_tcq
   [junit4]   2> 1818686 T7211 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1818686 T7224 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1818688 T7202 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1818702 T7225 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1818702 T7225 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1818704 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1818704 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1818704 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1818705 T7225 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1818709 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1818709 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57927/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57927_ea_tcq",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1818709 T7203 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 1818709 T7203 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 1818716 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1818792 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1818792 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1818792 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819358 T7225 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1819358 T7225 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\collection1
   [junit4]   2> 1819359 T7225 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1819360 T7225 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1819360 T7225 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1819362 T7225 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1819362 T7225 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\collection1\'
   [junit4]   2> 1819362 T7225 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113/collection1/lib/classes/' to classloader
   [junit4]   2> 1819362 T7225 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113/collection1/lib/README' to classloader
   [junit4]   2> 1819405 T7225 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1819432 T7225 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1819434 T7225 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1819441 T7225 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1819681 T7225 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1819683 T7225 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1819684 T7225 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1819688 T7225 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1819709 T7225 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1819709 T7225 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty1-1392816737113\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty1\
   [junit4]   2> 1819710 T7225 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f12d71
   [junit4]   2> 1819710 T7225 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty1\
   [junit4]   2> 1819710 T7225 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty1\index/
   [junit4]   2> 1819710 T7225 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 1819710 T7225 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty1\index
   [junit4]   2> 1819710 T7225 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=60.29296875, floorSegmentMB=0.2197265625, forceMergeDeletesPctAllowed=19.07722615559962, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1819711 T7225 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1c00bd59 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ba00953),segFN=segments_1,generation=1}
   [junit4]   2> 1819711 T7225 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1819714 T7225 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1819715 T7225 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1819715 T7225 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1819715 T7225 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1819715 T7225 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1819715 T7225 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1819715 T7225 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1819716 T7225 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1819716 T7225 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1819716 T7225 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1819717 T7225 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1819722 T7225 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1819725 T7225 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1819725 T7225 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1819726 T7225 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=14.7587890625, floorSegmentMB=1.0791015625, forceMergeDeletesPctAllowed=29.02075003098731, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5532243669126932
   [junit4]   2> 1819726 T7225 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1c00bd59 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ba00953),segFN=segments_1,generation=1}
   [junit4]   2> 1819726 T7225 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1819726 T7225 oass.SolrIndexSearcher.<init> Opening Searcher@66bdd15e[collection1] main
   [junit4]   2> 1819730 T7226 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@66bdd15e[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1819732 T7225 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1819733 T7178 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1819734 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1819734 T7229 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:57927/ea_tcq collection:collection1 shard:shard3
   [junit4]   2> 1819736 T7229 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 1819744 T7229 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 1819748 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819748 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819748 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819749 T7229 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1819749 T7229 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3498 name=collection1 org.apache.solr.core.SolrCore@4463ef74 url=https://127.0.0.1:57927/ea_tcq/collection1 node=127.0.0.1:57927_ea_tcq C3498_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:57927/ea_tcq, core=collection1, node_name=127.0.0.1:57927_ea_tcq}
   [junit4]   2> 1819749 T7229 C3498 P57927 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:57927/ea_tcq/collection1/
   [junit4]   2> 1819749 T7229 C3498 P57927 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1819749 T7229 C3498 P57927 oasc.SyncStrategy.syncToMe https://127.0.0.1:57927/ea_tcq/collection1/ has no replicas
   [junit4]   2> 1819749 T7229 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:57927/ea_tcq/collection1/ shard3
   [junit4]   2> 1819749 T7229 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 1819751 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1819755 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819760 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819764 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819832 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819832 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819832 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819859 T7229 oasc.ZkController.register We are https://127.0.0.1:57927/ea_tcq/collection1/ and leader is https://127.0.0.1:57927/ea_tcq/collection1/
   [junit4]   2> 1819859 T7229 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:57927/ea_tcq
   [junit4]   2> 1819859 T7229 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1819859 T7229 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1819859 T7229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1819860 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819860 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819860 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819861 T7229 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1819862 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1819863 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57927/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57927_ea_tcq",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 1819866 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1819934 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819934 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1819934 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1820065 T7178 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1820066 T7178 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1820071 T7178 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1820072 T7178 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57936
   [junit4]   2> 1820077 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1820077 T7178 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1820077 T7178 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353
   [junit4]   2> 1820077 T7178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\'
   [junit4]   2> 1820097 T7178 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\solr.xml
   [junit4]   2> 1820128 T7178 oasc.CoreContainer.<init> New CoreContainer 4949698
   [junit4]   2> 1820128 T7178 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\]
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1820130 T7178 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1820136 T7178 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1820136 T7178 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1820136 T7178 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1820136 T7178 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57905/solr
   [junit4]   2> 1820136 T7178 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1820138 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1820141 T7240 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76f95970 name:ZooKeeperConnection Watcher:127.0.0.1:57905 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1820142 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1820143 T7180 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444a58c4000008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1820144 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1820146 T7242 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4180189b name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1820146 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1820151 T7178 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1820799 T7178 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57936_ea_tcq
   [junit4]   2> 1820802 T7178 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57936_ea_tcq
   [junit4]   2> 1820817 T7224 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1820820 T7242 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1820820 T7211 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1820820 T7202 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1820827 T7243 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1820827 T7243 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1820828 T7243 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1820828 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1820828 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1820828 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1820830 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1820830 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57936/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57936_ea_tcq",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1820830 T7203 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 1820830 T7203 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1820834 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1820901 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1820902 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1820902 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1820903 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1821474 T7243 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1821474 T7243 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\collection1
   [junit4]   2> 1821474 T7243 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1821475 T7243 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1821475 T7243 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1821477 T7243 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1821477 T7243 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\collection1\'
   [junit4]   2> 1821478 T7243 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353/collection1/lib/classes/' to classloader
   [junit4]   2> 1821478 T7243 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353/collection1/lib/README' to classloader
   [junit4]   2> 1821516 T7243 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1821548 T7243 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1821550 T7243 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1821554 T7243 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1821795 T7243 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1821796 T7243 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1821796 T7243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1821800 T7243 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1821820 T7243 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1821821 T7243 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty2-1392816739353\collection1\, dataDir=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty2\
   [junit4]   2> 1821821 T7243 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@25f12d71
   [junit4]   2> 1821821 T7243 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty2\
   [junit4]   2> 1821821 T7243 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty2\index/
   [junit4]   2> 1821821 T7243 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 1821822 T7243 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-1392816735222/jetty2\index
   [junit4]   2> 1821822 T7243 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=60.29296875, floorSegmentMB=0.2197265625, forceMergeDeletesPctAllowed=19.07722615559962, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1821823 T7243 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7b45d7e7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e897d0e),segFN=segments_1,generation=1}
   [junit4]   2> 1821823 T7243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1821825 T7243 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1821825 T7243 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1821826 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1821826 T7243 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1821826 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1821826 T7243 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1821827 T7243 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1821827 T7243 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1821827 T7243 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1821827 T7243 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1821827 T7243 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1821827 T7243 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1821827 T7243 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1821829 T7243 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1821829 T7243 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1821829 T7243 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1821829 T7243 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1821835 T7243 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1821838 T7243 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1821838 T7243 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1821838 T7243 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=47, maxMergeAtOnceExplicit=47, maxMergedSegmentMB=14.7587890625, floorSegmentMB=1.0791015625, forceMergeDeletesPctAllowed=29.02075003098731, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5532243669126932
   [junit4]   2> 1821839 T7243 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7b45d7e7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3e897d0e),segFN=segments_1,generation=1}
   [junit4]   2> 1821839 T7243 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1821839 T7243 oass.SolrIndexSearcher.<init> Opening Searcher@69e83427[collection1] main
   [junit4]   2> 1821842 T7244 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69e83427[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1821843 T7243 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1821844 T7178 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1821844 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1821844 T7247 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:57936/ea_tcq collection:collection1 shard:shard2
   [junit4]   2> 1821846 T7247 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1821853 T7247 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1821855 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821856 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821856 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821857 T7247 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1821857 T7247 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3499 name=collection1 org.apache.solr.core.SolrCore@435bd85f url=https://127.0.0.1:57936/ea_tcq/collection1 node=127.0.0.1:57936_ea_tcq C3499_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:57936/ea_tcq, core=collection1, node_name=127.0.0.1:57936_ea_tcq}
   [junit4]   2> 1821857 T7247 C3499 P57936 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:57936/ea_tcq/collection1/
   [junit4]   2> 1821857 T7247 C3499 P57936 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1821857 T7247 C3499 P57936 oasc.SyncStrategy.syncToMe https://127.0.0.1:57936/ea_tcq/collection1/ has no replicas
   [junit4]   2> 1821857 T7247 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:57936/ea_tcq/collection1/ shard2
   [junit4]   2> 1821857 T7247 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1821860 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1821868 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821870 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821874 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821941 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1821941 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1821941 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1821942 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1821969 T7247 oasc.ZkController.register We are https://127.0.0.1:57936/ea_tcq/collection1/ and leader is https://127.0.0.1:57936/ea_tcq/collection1/
   [junit4]   2> 1821969 T7247 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:57936/ea_tcq
   [junit4]   2> 1821969 T7247 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1821969 T7247 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 1821969 T7247 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1821971 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821971 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821971 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1821972 T7247 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1821974 T7203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1821974 T7203 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:57936/ea_tcq",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:57936_ea_tcq",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 1821977 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1822045 T7224 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1822046 T7202 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1822046 T7242 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1822046 T7211 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 1822171 T7178 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1822172 T7178 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1822177 T7178 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1822178 T7178 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57945
   [junit4]   2> 1822182 T7178 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1822182 T7178 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1822182 T7178 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1392816741465
   [junit4]   2> 1822182 T7178 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1392816741465\'
   [junit4]   2> 1822203 T7178 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1392816741465\solr.xml
   [junit4]   2> 1822235 T7178 oasc.CoreContainer.<init> New CoreContainer 585033207
   [junit4]   2> 1822235 T7178 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.FullSolrCloudDistribCmdsTest-jetty3-1392816741465\]
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1822236 T7178 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1822242 T7178 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1822242 T7178 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1822242 T7178 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1822242 T7178 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:57905/solr
   [junit4]   2> 1822242 T7178 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1822245 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1822249 T7258 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e6f4deb name:ZooKeeperConnection Watcher:127.0.0.1:57905 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1822249 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1822250 T7180 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1444a58c400000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1822251 T7178 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1822252 T7260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bc61285 name:ZooKeeperConnection Watcher:127.0.0.1:57905/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1822253 T7178 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1822256 T7178 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1822904 T7178 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57945_ea_tcq
   [junit4]   2> 1822907 T7178 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57945_ea_tcq
   [junit4]   2> 1822913 T7224 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1822913 T7260 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1822913 T7242 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1822914 T7211 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1822914 T7202 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1822927 T7261 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 1822928 T7261 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1822930 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1822930 T7202 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fire

[...truncated too long message...]

rand7_s=PostingsFormat(name=NestedPulsing), 7grand3_s=PostingsFormat(name=MockSep), text_t=PostingsFormat(name=MockSep), 12parent_f1_s=PostingsFormat(name=Memory doPackFST= false), 9grand5_s=PostingsFormat(name=MockSep), 8grand1_s=PostingsFormat(name=FSTOrdPulsing41), 7grand1_s=PostingsFormat(name=NestedPulsing), 0parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 2parent_f1_s=PostingsFormat(name=MockSep), 3child1_s=PostingsFormat(name=NestedPulsing), 8grand3_s=PostingsFormat(name=Memory doPackFST= false), a_t=PostingsFormat(name=MockSep), 7parent_f2_s=PostingsFormat(name=MockSep), 5child3_s=PostingsFormat(name=NestedPulsing), 7grand4_s=PostingsFormat(name=FSTOrdPulsing41), 3grand0_s=PostingsFormat(name=FSTOrdPulsing41), 6grand1_s=PostingsFormat(name=Memory doPackFST= false), 9grand3_s=PostingsFormat(name=NestedPulsing), 2parent_f2_s=PostingsFormat(name=FSTOrdPulsing41), 7grand5_s=PostingsFormat(name=NestedPulsing), 0parent_f1_s=PostingsFormat(name=NestedPulsing), 10parent_f2_s=PostingsFormat(name=MockSep), 8parent_f1_s=PostingsFormat(name=NestedPulsing), 4parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 6grand5_s=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Memory doPackFST= false), 8parent_f2_s=PostingsFormat(name=Memory doPackFST= false), 3grand1_s=PostingsFormat(name=NestedPulsing), 4child3_s=PostingsFormat(name=FSTOrdPulsing41), 4grand0_s=PostingsFormat(name=NestedPulsing), 10parent_f1_s=PostingsFormat(name=FSTOrdPulsing41), 9parent_f1_s=PostingsFormat(name=FSTOrdPulsing41), 4child2_s=PostingsFormat(name=MockSep), 6grand3_s=PostingsFormat(name=FSTOrdPulsing41), 6grand2_s=PostingsFormat(name=NestedPulsing), 8grand2_s=PostingsFormat(name=MockSep), 5grand4_s=PostingsFormat(name=Memory doPackFST= false), 11parent_f2_s=PostingsFormat(name=FSTOrdPulsing41), 6parent_f2_s=PostingsFormat(name=FSTOrdPulsing41), 9grand4_s=PostingsFormat(name=FSTOrdPulsing41), 5grand1_s=PostingsFormat(name=MockSep), 7grand0_s=PostingsFormat(name=FSTOrdPulsing41), 4grand1_s=PostingsFormat(name=FSTOrdPulsing41), 2child0_s=PostingsFormat(name=MockSep), 3grand2_s=PostingsFormat(name=Memory doPackFST= false), 9parent_f2_s=PostingsFormat(name=NestedPulsing), 7grand6_s=PostingsFormat(name=Memory doPackFST= false), 5grand2_s=PostingsFormat(name=FSTOrdPulsing41), 12parent_f2_s=PostingsFormat(name=NestedPulsing), 3child2_s=PostingsFormat(name=Memory doPackFST= false), 5child2_s=PostingsFormat(name=Memory doPackFST= false), 5child4_s=PostingsFormat(name=FSTOrdPulsing41), _root_=PostingsFormat(name=MockSep), 8grand6_s=PostingsFormat(name=MockSep), 7parent_f1_s=PostingsFormat(name=Memory doPackFST= false), _version_=PostingsFormat(name=MockSep), 9grand1_s=PostingsFormat(name=MockSep), 6grand4_s=PostingsFormat(name=MockSep), 8grand0_s=PostingsFormat(name=NestedPulsing), 8grand5_s=PostingsFormat(name=FSTOrdPulsing41), 5parent_f1_s=PostingsFormat(name=FSTOrdPulsing41), 8grand4_s=PostingsFormat(name=NestedPulsing), 1parent_f1_s=PostingsFormat(name=FSTOrdPulsing41), 1child0_s=PostingsFormat(name=Memory doPackFST= false), 5parent_f2_s=PostingsFormat(name=NestedPulsing), 9grand0_s=PostingsFormat(name=FSTOrdPulsing41), 4child0_s=PostingsFormat(name=NestedPulsing), 9grand2_s=PostingsFormat(name=Memory doPackFST= false), 9grand8_s=PostingsFormat(name=FSTOrdPulsing41), 9grand6_s=PostingsFormat(name=Memory doPackFST= false), 6grand0_s=PostingsFormat(name=MockSep), 1parent_f2_s=PostingsFormat(name=NestedPulsing), 4child1_s=PostingsFormat(name=Memory doPackFST= false), 5grand3_s=PostingsFormat(name=NestedPulsing), 5grand0_s=PostingsFormat(name=Memory doPackFST= false), 7grand2_s=PostingsFormat(name=Memory doPackFST= false), rnd_b=PostingsFormat(name=Memory doPackFST= false), 4grand3_s=PostingsFormat(name=Memory doPackFST= false), 5child0_s=PostingsFormat(name=FSTOrdPulsing41), 4grand2_s=PostingsFormat(name=MockSep), 11parent_f1_s=PostingsFormat(name=NestedPulsing), 6parent_f1_s=PostingsFormat(name=MockSep), 3child0_s=PostingsFormat(name=FSTOrdPulsing41)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=iw_IL, timezone=Australia/Hobart
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=1,free=105000352,total=443797504
   [junit4]   2> NOTE: All tests run in this JVM: [SolrCmdDistributorTest, SyncSliceTest, TestRemoteStreaming, TestSolrQueryParserDefaultOperatorResource, TestQueryUtils, QueryEqualityTest, TestHighlightDedupGrouping, TestFieldCollectionResource, TestStressVersions, TestQueryTypes, TestDistributedGrouping, CacheHeaderTest, LeaderElectionIntegrationTest, TestPHPSerializedResponseWriter, DOMUtilTest, TestQuerySenderNoQuery, TestSolrXmlPersistence, AssignTest, RangeFacetTest, PeerSyncTest, TestCollationField, TestOverriddenPrefixQueryForCustomFieldType, TestLuceneMatchVersion, StandardRequestHandlerTest, IndexBasedSpellCheckerTest, HdfsLockFactoryTest, FunctionTest, TestLMJelinekMercerSimilarityFactory, ShardSplitTest, TestRandomMergePolicy, UniqFieldsUpdateProcessorFactoryTest, TestFiltering, CopyFieldTest, TestRecovery, TestFaceting, TestHashPartitioner, LegacyHTMLStripCharFilterTest, CurrencyFieldOpenExchangeTest, DisMaxRequestHandlerTest, TestFreeTextSuggestions, OverseerCollectionProcessorTest, TestSchemaVersionResource, TestQuerySenderListener, TestFunctionQuery, RAMDirectoryFactoryTest, BadIndexSchemaTest, XmlUpdateRequestHandlerTest, StressHdfsTest, TestFoldingMultitermQuery, DocumentAnalysisRequestHandlerTest, SolrIndexConfigTest, DocValuesMultiTest, TestIBSimilarityFactory, AliasIntegrationTest, MoreLikeThisHandlerTest, TestCoreContainer, TestRecoveryHdfs, TestInfoStreamLogging, UpdateRequestProcessorFactoryTest, SpellingQueryConverterTest, ShardRoutingCustomTest, UUIDFieldTest, TestStandardQParsers, DistributedSpellCheckComponentTest, DefaultValueUpdateProcessorTest, SuggesterFSTTest, FileUtilsTest, TestCoreDiscovery, SOLR749Test, ExternalFileFieldSortTest, DistributedDebugComponentTest, TestMaxScoreQueryParser, BadComponentTest, BasicDistributedZk2Test, TestJmxMonitoredMap, DebugComponentTest, TestRangeQuery, SynonymTokenizerTest, EchoParamsTest, NoCacheHeaderTest, ParsingFieldUpdateProcessorsTest, ZkNodePropsTest, DateMathParserTest, TestDocBasedVersionConstraints, PingRequestHandlerTest, XsltUpdateRequestHandlerTest, StatelessScriptUpdateProcessorFactoryTest, TestUtils, TestSystemIdResolver, JsonLoaderTest, HdfsSyncSliceTest, CurrencyFieldXmlFileTest, TestPhraseSuggestions, TestSolrCoreProperties, HighlighterConfigTest, AnalysisAfterCoreReloadTest, UnloadDistributedZkTest, RequestHandlersTest, OpenCloseCoreStressTest, TestRandomDVFaceting, TestJmxIntegration, PolyFieldTest, SpellCheckComponentTest, TestDistribDocBasedVersion, PreAnalyzedUpdateProcessorTest, MultiTermTest, QueryResultKeyTest, SystemInfoHandlerTest, HdfsBasicDistributedZk2Test, HardAutoCommitTest, HdfsUnloadDistributedZkTest, LoggingHandlerTest, TestNumberUtils, TestFieldTypeCollectionResource, TestFuzzyAnalyzedSuggestions, SolrCoreTest, SolrInfoMBeanTest, ResponseLogComponentTest, BasicDistributedZkTest, SearchHandlerTest, TestHighFrequencyDictionaryFactory, SimpleFacetsTest, TestSolrJ, TestSort, TestRTGBase, TestNRTOpen, TestReloadAndDeleteDocs, CursorMarkTest, DocValuesMissingTest, ResourceLoaderTest, QueryFacetTest, OpenExchangeRatesOrgProviderTest, TestCollationFieldDocValues, TestAnalyzeInfixSuggestions, TestSolrXmlPersistor, TestDynamicFieldResource, QueryElevationComponentTest, TestAnalyzedSuggestions, TestNonNRTOpen, TestSurroundQueryParser, SchemaVersionSpecificBehaviorTest, TestArbitraryIndexDir, TriLevelCompositeIdRoutingTest, TestImplicitCoreProperties, SimplePostToolTest, CircularListTest, FieldFacetExtrasTest, TestSolrXml, TestBM25SimilarityFactory, TestLMDirichletSimilarityFactory, PrimUtilsTest, ScriptEngineTest, BasicFunctionalityTest, TestTrie, TestGroupingSearch, HighlighterTest, BlockDirectoryTest, TermVectorComponentTest, TestSolr4Spatial, DeleteReplicaTest, AbstractAnalyticsStatsTest, IndexSchemaRuntimeFieldTest, CSVRequestHandlerTest, TestManagedSchema, TestReload, AnalysisErrorHandlingTest, TestIndexSearcher, ClusterStateUpdateTest, OverseerRolesTest, TestDocumentBuilder, TestXIncludeConfig, TestReplicationHandler, SolrIndexSplitterTest, ExpressionTest, TestPseudoReturnFields, TestDocSet, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, OverseerTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, FullSolrCloudDistribCmdsTest]
   [junit4] Completed in 74.87s, 1 test, 1 error <<< FAILURES!

[...truncated 562 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:453: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:433: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:491: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1268: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:901: There were test failures: 372 suites, 1604 tests, 1 error, 40 ignored (12 assumptions)

Total time: 74 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure