You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/24 19:03:54 UTC

[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_51) - Build # 3814 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3814/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseG1GC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Could not find collection:addReplicaColl

Stack Trace:
java.lang.AssertionError: Could not find collection:addReplicaColl
	at __randomizedtesting.SeedInfo.seed([A3633D73815EAB74:2285B36BF601CB48]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:147)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:724)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:1193)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:213)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)


REGRESSION:  org.apache.solr.handler.TestReplicationHandler.doTestBackup

Error Message:
Backup success not detected:<?xml version="1.0" encoding="UTF-8"?> <response> <lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><lst name="details"><str name="indexSize">17.12 KB</str><str name="indexPath">C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261733946\master\collection1\data\index/</str><arr name="commits"><lst><long name="indexVersion">1393261736035</long><long name="generation">2</long><arr name="filelist"><str>_0.cfe</str><str>_0.cfs</str><str>_0.si</str><str>segments_2</str></arr></lst></arr><str name="isMaster">true</str><str name="isSlave">false</str><long name="indexVersion">1393261736035</long><long name="generation">2</long><lst name="master"><str name="confFiles">schema-replication2.xml:schema.xml</str><arr name="replicateAfter"><str>commit</str></arr><str name="replicationEnabled">true</str><long name="replicableVersion">1393261736035</long><long name="replicableGeneration">2</long></lst><lst name="backup"><str name="startTime">Mon Feb 24 11:08:56 CST 2014</str><int name="fileCount">4</int><str name="status">success</str><str name="snapshotCompletedAt">Mon Feb 24 11:08:56 CST 2014</str></lst></lst><str name="WARNING">This response format is experimental.  It is likely to change in the future.</str> </response> 

Stack Trace:
java.lang.AssertionError: Backup success not detected:<?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">0</int></lst><lst name="details"><str name="indexSize">17.12 KB</str><str name="indexPath">C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261733946\master\collection1\data\index/</str><arr name="commits"><lst><long name="indexVersion">1393261736035</long><long name="generation">2</long><arr name="filelist"><str>_0.cfe</str><str>_0.cfs</str><str>_0.si</str><str>segments_2</str></arr></lst></arr><str name="isMaster">true</str><str name="isSlave">false</str><long name="indexVersion">1393261736035</long><long name="generation">2</long><lst name="master"><str name="confFiles">schema-replication2.xml:schema.xml</str><arr name="replicateAfter"><str>commit</str></arr><str name="replicationEnabled">true</str><long name="replicableVersion">1393261736035</long><long name="replicableGeneration">2</long></lst><lst name="backup"><str name="startTime">Mon Feb 24 11:08:56 CST 2014</str><int name="fileCount">4</int><str name="status">success</str><str name="snapshotCompletedAt">Mon Feb 24 11:08:56 CST 2014</str></lst></lst><str name="WARNING">This response format is experimental.  It is likely to change in the future.</str>
</response>

	at __randomizedtesting.SeedInfo.seed([A3633D73815EAB74:E2E81D16A6E0583B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestReplicationHandler.doTestBackup(TestReplicationHandler.java:1411)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10245 lines...]
   [junit4] Suite: org.apache.solr.handler.TestReplicationHandler
   [junit4]   2> 1271128 T3446 oas.SolrTestCaseJ4.setUp ###Starting doTestRepeater
   [junit4]   2> 1271146 T3446 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1271151 T3446 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59109
   [junit4]   2> 1271152 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1271153 T3446 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1271153 T3446 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master
   [junit4]   2> 1271153 T3446 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\'
   [junit4]   2> 1271198 T3446 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\solr.xml
   [junit4]   2> 1271291 T3446 oasc.CoreContainer.<init> New CoreContainer 13000592
   [junit4]   2> 1271292 T3446 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\]
   [junit4]   2> 1271293 T3446 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1271294 T3446 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1271294 T3446 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1271295 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1271295 T3446 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1271295 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1271295 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1271295 T3446 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1271296 T3446 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1271300 T3446 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1271300 T3446 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1271300 T3446 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1271306 T3456 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1
   [junit4]   2> 1271307 T3456 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\'
   [junit4]   2> 1271374 T3456 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1271442 T3456 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1271442 T3456 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1271450 T3456 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1271478 T3456 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1271480 T3456 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1271481 T3456 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\data\
   [junit4]   2> 1271481 T3456 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1271481 T3456 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\data\
   [junit4]   2> 1271481 T3456 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\data\index/
   [junit4]   2> 1271481 T3456 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1271483 T3456 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728002\master\collection1\data\index
   [junit4]   2> 1271483 T3456 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1718153384, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1271484 T3456 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ea4d74 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@159973d),segFN=segments_1,generation=1}
   [junit4]   2> 1271484 T3456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271486 T3456 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1271486 T3456 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1271487 T3456 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1271487 T3456 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1271487 T3456 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1271487 T3456 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1271488 T3456 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1271497 T3456 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1271501 T3456 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1271501 T3456 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1271502 T3456 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1994141218, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1271502 T3456 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ea4d74 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@159973d),segFN=segments_1,generation=1}
   [junit4]   2> 1271502 T3456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271502 T3456 oass.SolrIndexSearcher.<init> Opening Searcher@70f085[collection1] main
   [junit4]   2> 1271504 T3456 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml,xslt/dummy.xsl
   [junit4]   2> 1271504 T3456 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1271505 T3456 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1271505 T3457 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@70f085[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1271505 T3446 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1271505 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1271520 T3446 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1271527 T3446 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59112
   [junit4]   2> 1271528 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1271528 T3446 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1271528 T3446 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave
   [junit4]   2> 1271528 T3446 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\'
   [junit4]   2> 1271551 T3446 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\solr.xml
   [junit4]   2> 1271633 T3446 oasc.CoreContainer.<init> New CoreContainer 26150923
   [junit4]   2> 1271633 T3446 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\]
   [junit4]   2> 1271635 T3446 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1271635 T3446 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1271635 T3446 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1271635 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1271637 T3446 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1271637 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1271637 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1271637 T3446 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1271637 T3446 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1271641 T3446 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1271642 T3446 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1271642 T3446 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1271650 T3468 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1
   [junit4]   2> 1271651 T3468 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\'
   [junit4]   2> 1271704 T3468 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1271784 T3468 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1271785 T3468 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1271793 T3468 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1271818 T3468 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1271820 T3468 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1271821 T3468 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\
   [junit4]   2> 1271821 T3468 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1271821 T3468 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\
   [junit4]   2> 1271822 T3468 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index/
   [junit4]   2> 1271822 T3468 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1271823 T3468 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index
   [junit4]   2> 1271824 T3468 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1718153384, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1271825 T3468 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6fa9d8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@58e9f6),segFN=segments_1,generation=1}
   [junit4]   2> 1271825 T3468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271827 T3468 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1271827 T3468 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1271827 T3468 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1271827 T3468 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1271828 T3468 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1271828 T3468 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1271829 T3468 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1271831 T3468 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1271836 T3468 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1271836 T3468 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1271836 T3468 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1994141218, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1271837 T3468 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6fa9d8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@58e9f6),segFN=segments_1,generation=1}
   [junit4]   2> 1271837 T3468 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1271838 T3468 oass.SolrIndexSearcher.<init> Opening Searcher@ba860c[collection1] main
   [junit4]   2> 1271843 T3468 oash.SnapPuller.startExecutorService Poll Scheduled at an interval of 1000ms
   [junit4]   2> 1271843 T3468 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1271843 T3469 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ba860c[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1271844 T3446 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1271844 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1271854 T3446 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=26150923
   [junit4]   2> 1271855 T3446 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@c835dc
   [junit4]   2> 1271856 T3446 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 1271856 T3446 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 1271857 T3446 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 1271857 T3446 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 1271858 T3446 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 1271858 T3446 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 1271858 T3446 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\;done=false>>]
   [junit4]   2> 1271858 T3446 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\
   [junit4]   2> 1271858 T3446 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index;done=false>>]
   [junit4]   2> 1271858 T3446 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index
   [junit4]   2> 1271858 T3446 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 1271912 T3446 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1271916 T3446 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59115
   [junit4]   2> 1271917 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1271917 T3446 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1271918 T3446 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave
   [junit4]   2> 1271918 T3446 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\'
   [junit4]   2> 1271941 T3446 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\solr.xml
   [junit4]   2> 1272063 T3446 oasc.CoreContainer.<init> New CoreContainer 21884248
   [junit4]   2> 1272063 T3446 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\]
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1272066 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1272067 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1272067 T3446 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1272067 T3446 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1272072 T3446 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1272072 T3446 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1272072 T3446 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1272082 T3481 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1
   [junit4]   2> 1272083 T3481 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\'
   [junit4]   2> 1272153 T3481 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1272215 T3481 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1272216 T3481 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1272221 T3481 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1272239 T3481 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1272241 T3481 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1272241 T3481 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\
   [junit4]   2> 1272241 T3481 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1272242 T3481 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\
   [junit4]   2> 1272242 T3481 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index/
   [junit4]   2> 1272242 T3481 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1272242 T3481 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index
   [junit4]   2> 1272243 T3481 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1718153384, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1272244 T3481 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18965d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1369191),segFN=segments_1,generation=1}
   [junit4]   2> 1272244 T3481 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1272246 T3481 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1272246 T3481 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1272246 T3481 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1272246 T3481 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1272246 T3481 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1272247 T3481 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1272247 T3481 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1272249 T3481 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1272253 T3481 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1272253 T3481 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1272254 T3481 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1994141218, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1272254 T3481 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18965d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1369191),segFN=segments_1,generation=1}
   [junit4]   2> 1272254 T3481 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1272254 T3481 oass.SolrIndexSearcher.<init> Opening Searcher@196556[collection1] main
   [junit4]   2> 1272254 T3481 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1272255 T3481 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1272255 T3482 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@196556[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1272256 T3446 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1272256 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1272273 T3446 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1272278 T3446 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59118
   [junit4]   2> 1272279 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1272279 T3446 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1272281 T3446 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater
   [junit4]   2> 1272281 T3446 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\'
   [junit4]   2> 1272309 T3446 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\solr.xml
   [junit4]   2> 1272386 T3446 oasc.CoreContainer.<init> New CoreContainer 10675394
   [junit4]   2> 1272386 T3446 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\]
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1272389 T3446 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1272391 T3446 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1272391 T3446 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1272392 T3446 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1272394 T3446 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1272394 T3446 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1272399 T3493 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1
   [junit4]   2> 1272400 T3493 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\'
   [junit4]   2> 1272461 T3493 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1272522 T3493 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1272523 T3493 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1272529 T3493 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1272550 T3493 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1272551 T3493 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1272552 T3493 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\
   [junit4]   2> 1272552 T3493 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 1272553 T3493 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\
   [junit4]   2> 1272553 T3493 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index/
   [junit4]   2> 1272553 T3493 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1272554 T3493 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index
   [junit4]   2> 1272554 T3493 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1718153384, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1272555 T3493 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_1,generation=1}
   [junit4]   2> 1272555 T3493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1272556 T3493 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1272556 T3493 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1272556 T3493 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
   [junit4]   2> 1272556 T3493 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
   [junit4]   2> 1272556 T3493 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
   [junit4]   2> 1272557 T3493 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1272557 T3493 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1272563 T3493 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1272567 T3493 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1272567 T3493 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1272567 T3493 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1994141218, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1272567 T3493 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_1,generation=1}
   [junit4]   2> 1272568 T3493 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1272568 T3493 oass.SolrIndexSearcher.<init> Opening Searcher@f0861a[collection1] main
   [junit4]   2> 1272568 T3493 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1272568 T3493 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 1272568 T3493 oash.ReplicationHandler.inform Replication enabled for following config files: schema.xml
   [junit4]   2> 1272568 T3493 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 1272569 T3493 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1272569 T3494 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f0861a[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1272570 T3446 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1272570 T3446 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> ASYNC  NEW_CORE C790 name=collection1 org.apache.solr.core.SolrCore@888db5
   [junit4]   2> 1272572 T3452 C790 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[0]} 0 1
   [junit4]   2> 1272574 T3453 C790 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[1]} 0 1
   [junit4]   2> 1272575 T3454 C790 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[2]} 0 0
   [junit4]   2> 1272577 T3455 C790 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1272579 T3455 C790 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ea4d74 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@159973d),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@ea4d74 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@159973d),segFN=segments_2,generation=2}
   [junit4]   2> 1272579 T3455 C790 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1272613 T3455 C790 oass.SolrIndexSearcher.<init> Opening Searcher@f6e76a[collection1] main
   [junit4]   2> 1272613 T3455 C790 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1272613 T3457 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f6e76a[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c3)}
   [junit4]   2> 1272614 T3455 C790 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 37
   [junit4]   2> 1272618 T3496 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1272618 T3496 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 1272620 T3451 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272620 T3496 oash.SnapPuller.fetchLatestIndex Master's generation: 2
   [junit4]   2> 1272621 T3496 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
   [junit4]   2> 1272621 T3496 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 1272628 T3452 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&generation=2&command=filelist&qt=/replication} status=0 QTime=6 
   [junit4]   2> 1272629 T3496 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
   [junit4]   2> 1272629 T3496 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110849502
   [junit4]   2> 1272629 T3496 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 1272629 T3496 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 1272629 T3496 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 1272629 T3496 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@632e96 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@e96b) fullCopy=false
   [junit4]   2> 1272630 T3453 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfs&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272633 T3454 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=segments_2&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272635 T3455 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfe&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272637 T3450 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.si&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272637 T3496 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 1272638 T3496 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 1272640 T3496 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1272640 T3496 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_2,generation=2}
   [junit4]   2> 1272640 T3496 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1272640 T3496 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 1272640 T3496 oass.SolrIndexSearcher.<init> Opening Searcher@14813bb[collection1] main
   [junit4]   2> 1272641 T3494 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14813bb[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c3)}
   [junit4]   2> 1272642 T3496 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110849502 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110849502;done=true>>]
   [junit4]   2> 1272642 T3496 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110849502
   [junit4]   2> ASYNC  NEW_CORE C791 name=collection1 org.apache.solr.core.SolrCore@9cd470
   [junit4]   2> 1272642 T3489 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:59109/solr/replication&command=fetchindex&wait=true} status=0 QTime=25 
   [junit4]   2> 1272660 T3488 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=*:*} hits=3 status=0 QTime=1 
   [junit4]   2> 1272662 T3499 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1272662 T3499 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 1272664 T3490 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272665 T3499 oash.SnapPuller.fetchLatestIndex Master's generation: 2
   [junit4]   2> 1272665 T3499 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
   [junit4]   2> 1272665 T3499 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 1272667 T3491 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&generation=2&command=filelist&qt=/replication} status=0 QTime=1 
   [junit4]   2> 1272668 T3499 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
   [junit4]   2> 1272669 T3499 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index.20140224110849541
   [junit4]   2> 1272669 T3499 oasu.DefaultSolrCoreState.closeIndexWriter Closing IndexWriter...
   [junit4]   2> 1272669 T3499 oasu.DefaultSolrCoreState.closeIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 1272669 T3499 oasu.DefaultSolrCoreState.closeIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 1272670 T3499 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@1328df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12af32c) fullCopy=false
   [junit4]   2> 1272671 T3492 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfs&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272678 T3487 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=segments_2&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272680 T3488 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfe&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272682 T3490 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.si&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1272683 T3499 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 1272686 T3499 oasu.DefaultSolrCoreState.openIndexWriter Creating new IndexWriter...
   [junit4]   2> 1272686 T3499 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1272686 T3499 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18965d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1369191),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@18965d7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1369191),segFN=segments_2,generation=2}
   [junit4]   2> 1272686 T3499 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1272688 T3499 oasu.DefaultSolrCoreState.openIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 1272688 T3499 oass.SolrIndexSearcher.<init> Opening Searcher@10a37b4[collection1] main
   [junit4]   2> 1272689 T3482 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@10a37b4[collection1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c3)}
   [junit4]   2> 1272689 T3499 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index.20140224110849541 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index.20140224110849541;done=true>>]
   [junit4]   2> 1272689 T3499 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261728379\slave\collection1\data\index.20140224110849541
   [junit4]   2> ASYNC  NEW_CORE C792 name=collection1 org.apache.solr.core.SolrCore@941c61
   [junit4]   2> 1272690 T3476 C792 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={masterUrl=http://127.0.0.1:59118/solr/replication&command=fetchindex&wait=true} status=0 QTime=29 
   [junit4]   2> 1272692 T3477 C792 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={version=2&wt=javabin&sort=id+desc&q=*:*} hits=3 status=0 QTime=0 
   [junit4]   2> 1272695 T3451 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=0 
   [junit4]   2> 1272697 T3452 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=0 
   [junit4]   2> 1273344 T3491 C791 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master  org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:502)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]   2> 	at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1644)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:642)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:259)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1917)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:780)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused: connect
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:85)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
   [junit4]   2> 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
   [junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
   [junit4]   2> 	... 34 more
   [junit4]   2> 
   [junit4]   2> 1273345 T3491 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=645 
   [junit4]   2> 1273347 T3454 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication&_trace=assertVersions} status=0 QTime=0 
   [junit4]   2> 1273349 T3487 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication&_trace=assertVersions} status=0 QTime=0 
   [junit4]   2> 1273994 T3489 C791 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master  org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:502)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]   2> 	at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1644)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:642)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:259)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1917)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:780)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused: connect
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:85)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
   [junit4]   2> 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
   [junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
   [junit4]   2> 	... 34 more
   [junit4]   2> 
   [junit4]   2> 1273995 T3489 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=644 
   [junit4]   2> 1274649 T3490 C791 oash.ReplicationHandler.getReplicationDetails WARN Exception while invoking 'details' method for replication on master  org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:TEST_PORT/solr
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:502)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
   [junit4]   2> 	at org.apache.solr.handler.SnapPuller.getDetails(SnapPuller.java:1644)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.getReplicationDetails(ReplicationHandler.java:642)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.handleRequestBody(ReplicationHandler.java:259)
   [junit4]   2> 	at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
   [junit4]   2> 	at org.apache.solr.core.SolrCore.execute(SolrCore.java:1917)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:780)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:427)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:134)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1419)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:455)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:229)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:137)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.GzipHandler.handle(GzipHandler.java:301)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1077)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:384)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:193)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1009)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:135)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:116)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:368)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.handleRequest(AbstractHttpConnection.java:489)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection.headerComplete(AbstractHttpConnection.java:942)
   [junit4]   2> 	at org.eclipse.jetty.server.AbstractHttpConnection$RequestHandler.headerComplete(AbstractHttpConnection.java:1004)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseNext(HttpParser.java:640)
   [junit4]   2> 	at org.eclipse.jetty.http.HttpParser.parseAvailable(HttpParser.java:235)
   [junit4]   2> 	at org.eclipse.jetty.server.AsyncHttpConnection.handle(AsyncHttpConnection.java:82)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint.handle(SelectChannelEndPoint.java:628)
   [junit4]   2> 	at org.eclipse.jetty.io.nio.SelectChannelEndPoint$1.run(SelectChannelEndPoint.java:52)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused: connect
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.waitForConnect(Native Method)
   [junit4]   2> 	at java.net.DualStackPlainSocketImpl.socketConnect(DualStackPlainSocketImpl.java:85)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182)
   [junit4]   2> 	at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:172)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:579)
   [junit4]   2> 	at org.apache.http.conn.scheme.PlainSocketFactory.connectSocket(PlainSocketFactory.java:117)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:178)
   [junit4]   2> 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:610)
   [junit4]   2> 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:445)
   [junit4]   2> 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:395)
   [junit4]   2> 	... 34 more
   [junit4]   2> 
   [junit4]   2> 1274650 T3490 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=652 
   [junit4]   2> 1274656 T3491 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={slave=false&version=2&wt=javabin&command=details&qt=/replication} status=0 QTime=1 
   [junit4]   2> 1274658 T3476 C792 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=details&qt=/replication&_trace=getDetails} status=0 QTime=6 
   [junit4]   2> 1274660 T3487 C791 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication&_trace=assertVersions} status=0 QTime=0 
   [junit4]   2> 1274662 T3477 C792 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication&_trace=assertVersions} status=0 QTime=0 
   [junit4]   2> 1274665 T3488 C791 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[0]} 0 0
   [junit4]   2> 1274670 T3489 C791 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[1]} 0 0
   [junit4]   2> 1274671 T3492 C791 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[2]} 0 0
   [junit4]   2> 1274673 T3490 C791 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin} {add=[3]} 0 0
   [junit4]   2> 1274675 T3491 C791 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1274677 T3491 C791 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1),segFN=segments_3,generation=3}
   [junit4]   2> 1274677 T3491 C791 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 1274678 T3491 C791 oass.SolrIndexSearcher.<init> Opening Searcher@cfcf0e[collection1] main
   [junit4]   2> 1274679 T3491 C791 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 1274679 T3494 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@cfcf0e[collection1] main{StandardDirectoryReader(segments_3:7:nrt _1(5.0):c4)}
   [junit4]   2> 1274680 T3491 C791 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={version=2&wt=javabin&softCommit=false&waitSearcher=true&commit=true} {commit=} 0 5
   [junit4]   2> 1274681 T3501 oash.SnapPuller.<init> WARN 'masterUrl' must be specified without the /replication suffix
   [junit4]   2> 1274681 T3501 oash.SnapPuller.<init>  No value set for 'pollInterval'. Timer Task not started.
   [junit4]   2> 1274683 T3451 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&command=indexversion&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1274684 T3501 oash.SnapPuller.fetchLatestIndex Master's generation: 2
   [junit4]   2> 1274684 T3501 oash.SnapPuller.fetchLatestIndex Slave's generation: 3
   [junit4]   2> 1274684 T3501 oash.SnapPuller.fetchLatestIndex Starting replication process
   [junit4]   2> 1274687 T3452 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={version=2&wt=javabin&generation=2&command=filelist&qt=/replication} status=0 QTime=1 
   [junit4]   2> 1274687 T3501 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 4
   [junit4]   2> 1274688 T3501 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110851560
   [junit4]   2> 1274688 T3501 oash.SnapPuller.fetchLatestIndex Starting download to MockDirectoryWrapper(RAMDirectory@1ed6f46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1138b5a) fullCopy=true
   [junit4]   2> 1274690 T3453 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfs&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1274693 T3454 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=segments_2&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1274696 T3455 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.cfe&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1274699 T3450 C790 oasc.SolrCore.execute [collection1] webapp=/solr path=/replication params={wt=filestream&checksum=true&file=_0.si&generation=2&command=filecontent&qt=/replication} status=0 QTime=0 
   [junit4]   2> 1274700 T3501 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
   [junit4]   2> 1274702 T3501 oash.SnapPuller.modifyIndexProps New index installed. Updating index properties... index=index.20140224110851560
   [junit4]   2> 1274702 T3501 oash.SnapPuller.fetchLatestIndex removing old index directory MockDirectoryWrapper(RAMDirectory@af36fc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@15e73b1)
   [junit4]   2> 1274704 T3501 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
   [junit4]   2> 1274704 T3501 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
   [junit4]   2> 1274704 T3501 oasu.DefaultSolrCoreState.newIndexWriter Rollback old IndexWriter... core=collection1
   [junit4]   2> 1274706 T3501 oasc.SolrCore.getNewIndexDir New index directory detected: old=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index/ new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.handler.TestReplicationHandler$SolrInstance-1393261729129\repeater\collection1\data\index.20140224110851560
   [junit4]   2> 1274706 T3501 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1274706 T3501 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1ed6f46 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1138b5a),segFN=segments_2,generation=2}
   [junit4]   2> 1274706 T3501 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 1274706 T3501 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
   [junit4]   2> 1274706 T3501 oass.SolrIndexSearcher.<init> Opening Searcher@83f892[collection1] main
   [junit4]   2> 1274707 T3494 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searc

[...truncated too long message...]

ctionContext.java:112)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 3427978 T9525 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard2/election/91308930244542477-core_node4-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 3427980 T9525 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 3427980 T9525 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene42, sim=DefaultSimilarity, locale=sl, timezone=US/Central
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=1,free=114189680,total=521142272
   [junit4]   2> NOTE: All tests run in this JVM: [CustomCollectionTest, HighlighterConfigTest, TestFieldTypeResource, HdfsBasicDistributedZk2Test, DateFieldTest, LeaderElectionIntegrationTest, TestRandomDVFaceting, OutputWriterTest, MigrateRouteKeyTest, TestMultiCoreConfBootstrap, PluginInfoTest, TestReversedWildcardFilterFactory, TestQuerySenderNoQuery, MultiTermTest, SyncSliceTest, TestRealTimeGet, StatsComponentTest, TestHighlightDedupGrouping, SignatureUpdateProcessorFactoryTest, BlockDirectoryTest, TestSolr4Spatial, MinimalSchemaTest, CachingDirectoryFactoryTest, TestFastOutputStream, TestDocSet, SpellCheckCollatorTest, TestRecoveryHdfs, TestFuzzyAnalyzedSuggestions, DocumentAnalysisRequestHandlerTest, TestFiltering, RequestHandlersTest, TriLevelCompositeIdRoutingTest, TestAnalyzeInfixSuggestions, BasicDistributedZkTest, TestSerializedLuceneMatchVersion, SchemaVersionSpecificBehaviorTest, TestExtendedDismaxParser, ModifyConfFileTest, SolrPluginUtilsTest, MoreLikeThisHandlerTest, TestImplicitCoreProperties, TestNRTOpen, DistributedQueryComponentOptimizationTest, JSONWriterTest, IndexSchemaTest, QueryEqualityTest, TestSolrQueryParserDefaultOperatorResource, EnumFieldTest, AutoCommitTest, DocValuesMissingTest, CacheHeaderTest, DocValuesTest, CurrencyFieldXmlFileTest, TestCursorMarkWithoutUniqueKey, TestDynamicFieldResource, ShardRoutingTest, TestDistributedSearch, HdfsLockFactoryTest, DistributedQueryElevationComponentTest, TestHashPartitioner, ZkCLITest, TestCloudManagedSchema, QueryResultKeyTest, TestArbitraryIndexDir, BJQParserTest, NoCacheHeaderTest, TestLazyCores, TestSchemaVersionResource, OpenCloseCoreStressTest, TestNonNRTOpen, TestFastWriter, BasicFunctionalityTest, ParsingFieldUpdateProcessorsTest, SortByFunctionTest, TermVectorComponentDistributedTest, SimplePostToolTest, TestReplicationHandler, TestZkChroot, SolrIndexConfigTest, TestIndexingPerformance, DeleteInactiveReplicaTest, DistributedTermsComponentTest, TestJmxMonitoredMap, TestMergePolicyConfig, SoftAutoCommitTest, MBeansHandlerTest, ShardSplitTest, OpenExchangeRatesOrgProviderTest, ShowFileRequestHandlerTest, CoreAdminHandlerTest, RemoteQueryErrorTest, TestXIncludeConfig, LoggingHandlerTest, CircularListTest, CursorMarkTest, DistributedSpellCheckComponentTest, AliasIntegrationTest, TestIndexSearcher, UpdateRequestProcessorFactoryTest, DistributedQueryComponentCustomSortTest, FieldFacetExtrasTest, UniqFieldsUpdateProcessorFactoryTest, TestLMDirichletSimilarityFactory, SpellCheckComponentTest, TestBinaryResponseWriter, TestSolrXmlPersistence, PeerSyncTest, TestSolrQueryParser, TestSuggestSpellingConverter, CopyFieldTest, LeaderElectionTest, UUIDFieldTest, DeleteShardTest, ChaosMonkeyNothingIsSafeTest, PingRequestHandlerTest, EchoParamsTest, BlockCacheTest, StandardRequestHandlerTest, SolrInfoMBeanTest, InfoHandlerTest, FileBasedSpellCheckerTest, TestSolrQueryParserResource, OverseerRolesTest, TestDocBasedVersionConstraints, SpellingQueryConverterTest, SearchHandlerTest, DistribCursorPagingTest, BadCopyFieldTest, NumericFieldsTest, TestFunctionQuery, HdfsRecoveryZkTest, TestComponentsName, RangeFacetTest, TestSearchPerf, TestDFRSimilarityFactory, ZkControllerTest, TestWriterPerf, TestAddFieldRealTimeGet, TestStressRecovery, UnloadDistributedZkTest, TestGroupingSearch, ShardRoutingCustomTest, ConnectionManagerTest, CurrencyFieldOpenExchangeTest, XmlUpdateRequestHandlerTest, TestUpdate, TestSystemIdResolver, TestRandomFaceting, CoreAdminCreateDiscoverTest, RegexBoostProcessorTest, ExpressionTest, QueryFacetTest, TestCollationField, TestSolrXmlPersistor, DistributedDebugComponentTest, TestReload, TestSchemaSimilarityResource, ReturnFieldsTest, TestSolrXml, ResourceLoaderTest, DebugComponentTest, TestDistributedGrouping, TermVectorComponentTest, RecoveryZkTest, TestManagedSchemaFieldResource, DOMUtilTest, DirectSolrSpellCheckerTest, HdfsSyncSliceTest, TestCoreContainer, FastVectorHighlighterTest, TestSweetSpotSimilarityFactory, SolrCoreCheckLockOnStartupTest, SolrTestCaseJ4Test, TestNoOpRegenerator, CoreContainerCoreInitFailuresTest, TestWordDelimiterFilterFactory, TestDynamicFieldCollectionResource, HdfsChaosMonkeySafeLeaderTest, OverseerCollectionProcessorTest, NotRequiredUniqueKeyTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 178.92s, 1 test, 1 failure <<< FAILURES!

[...truncated 564 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 2 failures, 40 ignored (12 assumptions)

Total time: 102 minutes 7 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_60-ea-b04) - Build # 3819 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3819/
Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC

All tests passed

Build Log:
[...truncated 50551 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:404: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:87: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:187: Source checkout is dirty after running tests!!! Offending files:
* ./solr/licenses/jcl-over-slf4j-1.6.6.jar.sha1
* ./solr/licenses/jul-to-slf4j-1.6.6.jar.sha1
* ./solr/licenses/slf4j-api-1.6.6.jar.sha1
* ./solr/licenses/slf4j-log4j12-1.6.6.jar.sha1

Total time: 117 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_60-ea-b04 -client -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



Re: [JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3818 - Still Failing!

Posted by Mark Miller <ma...@gmail.com>.
I have not seen this before. If it pops up again, I’ll raise the zk timeout being used.

- Mark

http://about.me/markrmiller

On Feb 26, 2014, at 2:17 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3818/
> Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
> 
> 1 tests failed.
> REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
> 
> Error Message:
> KeeperErrorCode = Session expired for /live_nodes
> 
> Stack Trace:
> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
> 	at __randomizedtesting.SeedInfo.seed([DF1F466614BE0A92:5EF9C87E63E16AAE]:0)
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
> 	at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:404)
> 	at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:230)
> 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:730)
> 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1602)
> 	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:148)
> 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> 	at java.lang.reflect.Method.invoke(Method.java:606)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
> 	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
> 	at java.lang.Thread.run(Thread.java:744)
> 
> 
> 
> 
> Build Log:
> [...truncated 19360 lines...]
>   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
>   [junit4]   2> 699895 T1723 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
>   [junit4]   2> 699895 T1723 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /m_bk/
>   [junit4]   2> 699898 T1723 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
>   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1393439503084
>   [junit4]   2> 699899 T1723 oasc.ZkTestServer.run STARTING ZK TEST SERVER
>   [junit4]   2> 699900 T1724 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>   [junit4]   2> 699973 T1723 oasc.ZkTestServer.run start zk server on port:55587
>   [junit4]   2> 699973 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 699980 T1730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cdc87da name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 699980 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 699980 T1723 oascc.SolrZkClient.makePath makePath: /solr
>   [junit4]   2> 699985 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10000, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 699986 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 699988 T1732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3583c568 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 699988 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 699988 T1723 oascc.SolrZkClient.makePath makePath: /collections/collection1
>   [junit4]   2> 699993 T1723 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
>   [junit4]   2> 699996 T1723 oascc.SolrZkClient.makePath makePath: /collections/control_collection
>   [junit4]   2> 700000 T1723 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
>   [junit4]   2> 700003 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
>   [junit4]   2> 700003 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
>   [junit4]   2> 700009 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
>   [junit4]   2> 700010 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
>   [junit4]   2> 700013 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 700013 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>   [junit4]   2> 700017 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
>   [junit4]   2> 700017 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
>   [junit4]   2> 700021 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
>   [junit4]   2> 700021 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
>   [junit4]   2> 700024 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
>   [junit4]   2> 700024 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
>   [junit4]   2> 700028 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
>   [junit4]   2> 700028 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
>   [junit4]   2> 700031 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 700031 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
>   [junit4]   2> 700035 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 700036 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
>   [junit4]   2> 700039 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
>   [junit4]   2> 700039 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
>   [junit4]   2> 700041 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
>   [junit4]   2> 700043 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
>   [junit4]   2> 700048 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 700051 T1734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b314dd8 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 700051 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 700054 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10002, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 701313 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 701319 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 701323 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55597
>   [junit4]   2> 701326 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239
>   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\'
>   [junit4]   2> 701355 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\solr.xml
>   [junit4]   2> 701393 T1723 oasc.CoreContainer.<init> New CoreContainer 649471709
>   [junit4]   2> 701393 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\]
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 701403 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 701403 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 701403 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 701403 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
>   [junit4]   2> 701403 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 701405 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 701409 T1745 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1734851a name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 701409 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 701412 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10003, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 701413 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 701415 T1747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a9ffb81 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 701415 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 701418 T1723 oascc.SolrZkClient.makePath makePath: /overseer/queue
>   [junit4]   2> 701424 T1723 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
>   [junit4]   2> 701431 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes
>   [junit4]   2> 701434 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55597_m_bk
>   [junit4]   2> 701435 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55597_m_bk
>   [junit4]   2> 701442 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect
>   [junit4]   2> 701446 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
>   [junit4]   2> 701453 T1723 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55597_m_bk
>   [junit4]   2> 701453 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
>   [junit4]   2> 701457 T1723 oasc.Overseer.start Overseer (id=91320451274440708-127.0.0.1:55597_m_bk-n_0000000000) starting
>   [junit4]   2> 701463 T1723 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
>   [junit4]   2> 701471 T1749 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
>   [junit4]   2> 701472 T1723 oascc.SolrZkClient.makePath makePath: /clusterstate.json
>   [junit4]   2> 701473 T1749 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
>   [junit4]   2> 701477 T1723 oascc.SolrZkClient.makePath makePath: /aliases.json
>   [junit4]   2> 701480 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 701484 T1748 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
>   [junit4]   2> 701489 T1750 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 701489 T1750 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 701491 T1750 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 701491 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 701494 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55597/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55597_m_bk",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"1",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
>   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 701499 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 701499 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 702289 T1750 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 702289 T1750 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1
>   [junit4]   2> 702289 T1750 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
>   [junit4]   2> 702290 T1750 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 702290 T1750 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
>   [junit4]   2> 702292 T1750 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
>   [junit4]   2> 702292 T1750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1\'
>   [junit4]   2> 702296 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/.svn/' to classloader
>   [junit4]   2> 702297 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/classes/' to classloader
>   [junit4]   2> 702299 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/README' to classloader
>   [junit4]   2> 702340 T1750 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 702372 T1750 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 702374 T1750 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 702381 T1750 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 702645 T1750 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 702646 T1750 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 702647 T1750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 702652 T1750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 702683 T1750 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 702684 T1750 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/control/data\
>   [junit4]   2> 702684 T1750 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
>   [junit4]   2> 702684 T1750 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data
>   [junit4]   2> 702685 T1750 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/control/data\index/
>   [junit4]   2> 702686 T1750 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index' doesn't exist. Creating new index...
>   [junit4]   2> 702686 T1750 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index
>   [junit4]   2> 702686 T1750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>   [junit4]   2> 702691 T1750 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index,segFN=segments_1,generation=1}
>   [junit4]   2> 702691 T1750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 702694 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 702694 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 702695 T1750 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 702698 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
>   [junit4]   2> 702704 T1750 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 702707 T1750 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 702707 T1750 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 702707 T1750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
>   [junit4]   2> 702709 T1750 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index,segFN=segments_1,generation=1}
>   [junit4]   2> 702709 T1750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 702709 T1750 oass.SolrIndexSearcher.<init> Opening Searcher@3f73a3dd[collection1] main
>   [junit4]   2> 702712 T1751 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f73a3dd[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 702713 T1750 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 702714 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
>   [junit4]   2> 702714 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 702714 T1754 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55597/m_bk collection:control_collection shard:shard1
>   [junit4]   2> 702716 T1754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
>   [junit4]   2> 702723 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 702726 T1756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21dc2fac name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 702726 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 702727 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
>   [junit4]   2> 702730 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 702731 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702732 T1754 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 702732 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C1250 name=collection1 org.apache.solr.core.SolrCore@430e225d url=https://127.0.0.1:55597/m_bk/collection1 node=127.0.0.1:55597_m_bk C1250_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:55597/m_bk, core=collection1, node_name=127.0.0.1:55597_m_bk}
>   [junit4]   2> 702732 T1754 C1250 P55597 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55597/m_bk/collection1/
>   [junit4]   2> 702732 T1754 C1250 P55597 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 702733 T1754 C1250 P55597 oasc.SyncStrategy.syncToMe https://127.0.0.1:55597/m_bk/collection1/ has no replicas
>   [junit4]   2> 702733 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55597/m_bk/collection1/ shard1
>   [junit4]   2> 702733 T1754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
>   [junit4]   2> 702734 T1723 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
>   [junit4]   2> 702734 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 702741 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702743 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702749 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702832 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 702833 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 702865 T1754 oasc.ZkController.register We are https://127.0.0.1:55597/m_bk/collection1/ and leader is https://127.0.0.1:55597/m_bk/collection1/
>   [junit4]   2> 702865 T1754 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55597/m_bk
>   [junit4]   2> 702865 T1754 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 702865 T1754 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 702865 T1754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702869 T1754 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 702871 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 702871 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55597/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55597_m_bk",
>   [junit4]   2> 	  "shard":"shard1",
>   [junit4]   2> 	  "collection":"control_collection",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 702875 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 702959 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 702959 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>   [junit4]   2> 704071 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>   [junit4]   2> 704073 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 704080 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 704081 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55609
>   [junit4]   2> 704084 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920
>   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\'
>   [junit4]   2> 704109 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\solr.xml
>   [junit4]   2> 704152 T1723 oasc.CoreContainer.<init> New CoreContainer 701776337
>   [junit4]   2> 704153 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\]
>   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
>   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 704162 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 704162 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 704163 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 704163 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
>   [junit4]   2> 704163 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 704165 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 704187 T1767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c1fd552 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 704187 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 704208 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10006, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 704212 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 704214 T1769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b4e1a83 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 704214 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 704225 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 705028 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55609_m_bk
>   [junit4]   2> 705030 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55609_m_bk
>   [junit4]   2> 705034 T1769 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 705035 T1756 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 705035 T1747 oascc.ZkStateReader$3.process Updating live nodes... (2)
>   [junit4]   2> 705043 T1770 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 705044 T1770 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 705045 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 705046 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 705046 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 705045 T1770 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 705048 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55609/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55609_m_bk",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
>   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
>   [junit4]   2> 705054 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 705054 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 705054 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 705054 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 705844 T1770 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 705844 T1770 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1
>   [junit4]   2> 705844 T1770 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 705844 T1770 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 705844 T1770 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 705846 T1770 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
>   [junit4]   2> 705847 T1770 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1\'
>   [junit4]   2> 705848 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/.svn/' to classloader
>   [junit4]   2> 705850 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/classes/' to classloader
>   [junit4]   2> 705851 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/README' to classloader
>   [junit4]   2> 705898 T1770 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 705929 T1770 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 705931 T1770 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 705940 T1770 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 706211 T1770 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 706212 T1770 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 706213 T1770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 706219 T1770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 706255 T1770 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 706255 T1770 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty1\
>   [junit4]   2> 706255 T1770 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
>   [junit4]   2> 706255 T1770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1
>   [junit4]   2> 706257 T1770 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty1\index/
>   [junit4]   2> 706257 T1770 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index' doesn't exist. Creating new index...
>   [junit4]   2> 706257 T1770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index
>   [junit4]   2> 706258 T1770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>   [junit4]   2> 706262 T1770 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index,segFN=segments_1,generation=1}
>   [junit4]   2> 706262 T1770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 706267 T1770 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 706270 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
>   [junit4]   2> 706274 T1770 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 706278 T1770 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 706278 T1770 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 706278 T1770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
>   [junit4]   2> 706278 T1770 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index,segFN=segments_1,generation=1}
>   [junit4]   2> 706278 T1770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 706278 T1770 oass.SolrIndexSearcher.<init> Opening Searcher@5dfc64c0[collection1] main
>   [junit4]   2> 706283 T1771 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5dfc64c0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 706285 T1770 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 706285 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
>   [junit4]   2> 706285 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 706285 T1774 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55609/m_bk collection:collection1 shard:shard1
>   [junit4]   2> 706288 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
>   [junit4]   2> 706299 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
>   [junit4]   2> 706303 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C1251 name=collection1 org.apache.solr.core.SolrCore@8a87040 url=https://127.0.0.1:55609/m_bk/collection1 node=127.0.0.1:55609_m_bk C1251_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55609/m_bk, core=collection1, node_name=127.0.0.1:55609_m_bk}
>   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55609/m_bk/collection1/
>   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.syncToMe https://127.0.0.1:55609/m_bk/collection1/ has no replicas
>   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55609/m_bk/collection1/ shard1
>   [junit4]   2> 706304 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
>   [junit4]   2> 706308 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 706315 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706318 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706324 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706408 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 706408 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 706409 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 706442 T1774 oasc.ZkController.register We are https://127.0.0.1:55609/m_bk/collection1/ and leader is https://127.0.0.1:55609/m_bk/collection1/
>   [junit4]   2> 706442 T1774 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55609/m_bk
>   [junit4]   2> 706442 T1774 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 706442 T1774 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 706442 T1774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706447 T1774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 706448 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 706448 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55609/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55609_m_bk",
>   [junit4]   2> 	  "shard":"shard1",
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":"core_node1"}
>   [junit4]   2> 706453 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 706537 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 706537 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 706537 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
>   [junit4]   2> 707611 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>   [junit4]   2> 707611 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 707617 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 707619 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55618
>   [junit4]   2> 707622 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474
>   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\'
>   [junit4]   2> 707643 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\solr.xml
>   [junit4]   2> 707691 T1723 oasc.CoreContainer.<init> New CoreContainer 1544127607
>   [junit4]   2> 707691 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\]
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 707699 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 707699 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 707699 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 707699 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
>   [junit4]   2> 707699 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 707703 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 707715 T1785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32562365 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 707716 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 707719 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 707721 T1787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@261b5054 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 707721 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 707727 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 708530 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55618_m_bk
>   [junit4]   2> 708532 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55618_m_bk
>   [junit4]   2> 708536 T1769 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 708537 T1747 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 708537 T1756 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 708539 T1787 oascc.ZkStateReader$3.process Updating live nodes... (3)
>   [junit4]   2> 708550 T1788 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 708550 T1788 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 708553 T1788 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 708555 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55618/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55618_m_bk",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
>   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
>   [junit4]   2> 708561 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 708563 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 708563 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 708563 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 708563 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 709414 T1788 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
>   [junit4]   2> 709414 T1788 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1
>   [junit4]   2> 709414 T1788 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
>   [junit4]   2> 709414 T1788 oasc.ZkController.createCollectionZkNode Collection zkNode exists
>   [junit4]   2> 709415 T1788 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
>   [junit4]   2> 709417 T1788 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
>   [junit4]   2> 709417 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1\'
>   [junit4]   2> 709420 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/.svn/' to classloader
>   [junit4]   2> 709420 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/classes/' to classloader
>   [junit4]   2> 709421 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/README' to classloader
>   [junit4]   2> 709463 T1788 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
>   [junit4]   2> 709499 T1788 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
>   [junit4]   2> 709502 T1788 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
>   [junit4]   2> 709509 T1788 oass.IndexSchema.readSchema [collection1] Schema name=test
>   [junit4]   2> 709811 T1788 oass.IndexSchema.readSchema default search field in schema is text
>   [junit4]   2> 709813 T1788 oass.IndexSchema.readSchema unique key field: id
>   [junit4]   2> 709815 T1788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 709819 T1788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
>   [junit4]   2> 709858 T1788 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
>   [junit4]   2> 709859 T1788 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty2\
>   [junit4]   2> 709859 T1788 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
>   [junit4]   2> 709860 T1788 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2
>   [junit4]   2> 709861 T1788 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty2\index/
>   [junit4]   2> 709862 T1788 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index' doesn't exist. Creating new index...
>   [junit4]   2> 709862 T1788 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index
>   [junit4]   2> 709863 T1788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>   [junit4]   2> 709868 T1788 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index,segFN=segments_1,generation=1}
>   [junit4]   2> 709868 T1788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
>   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
>   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
>   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
>   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>   [junit4]   2> 709873 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 709873 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>   [junit4]   2> 709873 T1788 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
>   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
>   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
>   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
>   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
>   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
>   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
>   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
>   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
>   [junit4]   2> 709882 T1788 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
>   [junit4]   2> 709886 T1788 oasu.CommitTracker.<init> Hard AutoCommit: disabled
>   [junit4]   2> 709886 T1788 oasu.CommitTracker.<init> Soft AutoCommit: disabled
>   [junit4]   2> 709887 T1788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
>   [junit4]   2> 709887 T1788 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
>   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index,segFN=segments_1,generation=1}
>   [junit4]   2> 709887 T1788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
>   [junit4]   2> 709887 T1788 oass.SolrIndexSearcher.<init> Opening Searcher@366b827b[collection1] main
>   [junit4]   2> 709891 T1789 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@366b827b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
>   [junit4]   2> 709893 T1788 oasc.CoreContainer.registerCore registering core: collection1
>   [junit4]   2> 709894 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
>   [junit4]   2> 709894 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
>   [junit4]   2> 709895 T1792 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55618/m_bk collection:collection1 shard:shard3
>   [junit4]   2> 709898 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
>   [junit4]   2> 709907 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
>   [junit4]   2> 709911 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
>   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
>   [junit4]   2> ASYNC  NEW_CORE C1252 name=collection1 org.apache.solr.core.SolrCore@153326ab url=https://127.0.0.1:55618/m_bk/collection1 node=127.0.0.1:55618_m_bk C1252_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55618/m_bk, core=collection1, node_name=127.0.0.1:55618_m_bk}
>   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55618/m_bk/collection1/
>   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
>   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.syncToMe https://127.0.0.1:55618/m_bk/collection1/ has no replicas
>   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55618/m_bk/collection1/ shard3
>   [junit4]   2> 709914 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
>   [junit4]   2> 709917 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 709925 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 709929 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 709936 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 710027 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710028 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710028 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710029 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710065 T1792 oasc.ZkController.register We are https://127.0.0.1:55618/m_bk/collection1/ and leader is https://127.0.0.1:55618/m_bk/collection1/
>   [junit4]   2> 710065 T1792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55618/m_bk
>   [junit4]   2> 710065 T1792 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
>   [junit4]   2> 710065 T1792 oasc.ZkController.publish publishing core=collection1 state=active
>   [junit4]   2> 710065 T1792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 710068 T1792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 710070 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 710071 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"active",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55618/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55618_m_bk",
>   [junit4]   2> 	  "shard":"shard3",
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":"core_node2"}
>   [junit4]   2> 710076 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 710168 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710169 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710169 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 710169 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
>   [junit4]   2> 711301 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
>   [junit4]   2> 711301 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
>   [junit4]   2> 711307 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
>   [junit4]   2> 711310 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55627
>   [junit4]   2> 711315 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
>   [junit4]   2> 711315 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
>   [junit4]   2> 711316 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085
>   [junit4]   2> 711316 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\'
>   [junit4]   2> 711341 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\solr.xml
>   [junit4]   2> 711384 T1723 oasc.CoreContainer.<init> New CoreContainer 1098395650
>   [junit4]   2> 711384 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\]
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
>   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
>   [junit4]   2> 711392 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
>   [junit4]   2> 711392 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>   [junit4]   2> 711392 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
>   [junit4]   2> 711392 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
>   [junit4]   2> 711392 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
>   [junit4]   2> 711396 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 711405 T1803 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49d1664 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 711405 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 711408 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f1000a, likely client has closed socket
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
>   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
>   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
>   [junit4]   2> 
>   [junit4]   2> 711409 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
>   [junit4]   2> 711412 T1805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff94051 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
>   [junit4]   2> 711412 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
>   [junit4]   2> 711419 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
>   [junit4]   2> 712301 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55627_m_bk
>   [junit4]   2> 712303 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55627_m_bk
>   [junit4]   2> 712308 T1747 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 712309 T1756 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 712309 T1805 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 712309 T1769 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 712309 T1787 oascc.ZkStateReader$3.process Updating live nodes... (4)
>   [junit4]   2> 712320 T1806 oasc.ZkController.publish publishing core=collection1 state=down
>   [junit4]   2> 712320 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
>   [junit4]   2> 712322 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 712323 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 712323 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 712322 T1806 oasc.ZkController.waitForCoreNodeName look for our core node name
>   [junit4]   2> 712325 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
>   [junit4]   2> 712325 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
>   [junit4]   2> 	  "operation":"state",
>   [junit4]   2> 	  "state":"down",
>   [junit4]   2> 	  "base_url":"https://127.0.0.1:55627/m_bk",
>   [junit4]   2> 	  "core":"collection1",
>   [junit4]   2> 	  "roles":null,
>   [junit4]   2> 	  "node_name":"127.0.0.1:55627_m_bk",
>   [junit4]   2> 	  "shard":null,
>   [junit4]   2> 	  "collection":"collection1",
>   [junit4]   2> 	  "numShards":"3",
>   [junit4]   2> 	  "core_node_name":null}
>   [junit4]   2> 712326 T1748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
>   [junit4]   2> 712326 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
>   [junit4]   2> 712330 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
>   [junit4]   2> 712331 T1787 oas
> 
> [...truncated too long message...]
> 
> insSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9;done=false>>]
>   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9
>   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index;done=false>>]
>   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index
>   [junit4]   2> 818244 T1922 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
>   [junit4]   2> 818244 T1922 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
>   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
>   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
>   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
>   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>   [junit4]   2> 
>   [junit4]   2> 818248 T1962 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
>   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
>   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index;done=false>>]
>   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index
>   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11;done=false>>]
>   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11
>   [junit4]   2> 818345 T1962 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
>   [junit4]   2> 818345 T1962 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
>   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
>   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
>   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
>   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
>   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
>   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
>   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
>   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
>   [junit4]   2> 
>   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_IQ, timezone=America/El_Salvador
>   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=1,free=60375552,total=270503936
>   [junit4]   2> NOTE: All tests run in this JVM: [ConnectionManagerTest, PrimitiveFieldTypeTest, TestCollationField, TestNonDefinedSimilarityFactory, TestNoOpRegenerator, DistributedSpellCheckComponentTest, SolrPluginUtilsTest, TestSolrQueryParser, IndexBasedSpellCheckerTest, PathHierarchyTokenizerFactoryTest, HdfsBasicDistributedZk2Test, DocValuesMultiTest, TestFunctionQuery, CSVRequestHandlerTest, BadComponentTest, DistributedDebugComponentTest, DirectUpdateHandlerOptimizeTest, HdfsSyncSliceTest, DirectSolrSpellCheckerTest, TestRandomDVFaceting, URLClassifyProcessorTest, SoftAutoCommitTest, QueryElevationComponentTest, LegacyHTMLStripCharFilterTest, FileBasedSpellCheckerTest, ConvertedLegacyTest, QueryFacetTest, SyncSliceTest, TestQuerySenderListener, DocValuesTest, FieldAnalysisRequestHandlerTest, DisMaxRequestHandlerTest, TestManagedSchema, FileUtilsTest, TestPHPSerializedResponseWriter, HdfsLockFactoryTest, OpenCloseCoreStressTest, TestBinaryResponseWriter, BadIndexSchemaTest, HdfsBasicDistributedZkTest, SuggesterWFSTTest, TestUtils, TestDFRSimilarityFactory, OverseerCollectionProcessorTest, UpdateRequestProcessorFactoryTest, TestAnalyzeInfixSuggestions, TimeZoneUtilsTest, HdfsRecoveryZkTest, PluginInfoTest, RequestHandlersTest, TestFieldTypeResource, TestValueSourceCache, TestCollapseQParserPlugin, SOLR749Test, RecoveryZkTest, TestRandomMergePolicy, PreAnalyzedFieldTest, TestExtendedDismaxParser, JSONWriterTest, TestSuggestSpellingConverter, SimpleFacetsTest, TestOverriddenPrefixQueryForCustomFieldType, HighlighterTest, ScriptEngineTest, ClusterStateTest, ZkControllerTest, BinaryUpdateRequestHandlerTest, TestSolrXmlPersistence, PingRequestHandlerTest, TestRemoteStreaming, DistributedSuggestComponentTest, TestReversedWildcardFilterFactory, TestFoldingMultitermQuery, SortByFunctionTest, TermsComponentTest, DocumentAnalysisRequestHandlerTest, SynonymTokenizerTest, TestDynamicFieldCollectionResource, RegexBoostProcessorTest, TestRandomFaceting, AddSchemaFieldsUpdateProcessorFactoryTest, TestManagedSchemaFieldResource, TestDefaultSimilarityFactory, TestSolrXmlPersistor, SliceStateTest, AbstractAnalyticsStatsTest, EnumFieldTest, IndexSchemaTest, TestInfoStreamLogging, AbstractAnalyticsFacetTest, DistribCursorPagingTest, SolrCoreTest, DistributedQueryElevationComponentTest, EchoParamsTest, ChaosMonkeySafeLeaderTest]
>   [junit4] Completed in 118.97s, 1 test, 1 error <<< FAILURES!
> 
> [...truncated 864 lines...]
> BUILD FAILED
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
> C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 1 error, 52 ignored (24 assumptions)
> 
> Total time: 87 minutes 42 seconds
> Build step 'Invoke Ant' marked build as failure
> Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure
> Sending email for trigger: Failure
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_60-ea-b04) - Build # 3818 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3818/
Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch

Error Message:
KeeperErrorCode = Session expired for /live_nodes

Stack Trace:
org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes
	at __randomizedtesting.SeedInfo.seed([DF1F466614BE0A92:5EF9C87E63E16AAE]:0)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
	at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:404)
	at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:230)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:144)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:730)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForThingsToLevelOut(AbstractFullDistribZkTestBase.java:1602)
	at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:148)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 19360 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> 699895 T1723 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 699895 T1723 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /m_bk/
   [junit4]   2> 699898 T1723 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-ChaosMonkeySafeLeaderTest-1393439503084
   [junit4]   2> 699899 T1723 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 699900 T1724 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 699973 T1723 oasc.ZkTestServer.run start zk server on port:55587
   [junit4]   2> 699973 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 699980 T1730 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5cdc87da name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 699980 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 699980 T1723 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 699985 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 699986 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 699988 T1732 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3583c568 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 699988 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 699988 T1723 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 699993 T1723 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 699996 T1723 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 700000 T1723 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 700003 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 700003 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 700009 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 700010 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 700013 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 700013 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 700017 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 700017 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 700021 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 700021 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 700024 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 700024 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 700028 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 700028 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 700031 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 700031 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 700035 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 700036 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 700039 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 700039 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 700041 T1723 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 700043 T1723 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 700048 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 700051 T1734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7b314dd8 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 700051 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 700054 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 701313 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 701319 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 701323 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55597
   [junit4]   2> 701326 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239
   [junit4]   2> 701326 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\'
   [junit4]   2> 701355 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\solr.xml
   [junit4]   2> 701393 T1723 oasc.CoreContainer.<init> New CoreContainer 649471709
   [junit4]   2> 701393 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\]
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 701395 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 701403 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 701403 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 701403 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 701403 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
   [junit4]   2> 701403 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 701405 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 701409 T1745 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1734851a name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 701409 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 701412 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 701413 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 701415 T1747 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5a9ffb81 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 701415 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 701418 T1723 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 701424 T1723 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 701431 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 701434 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55597_m_bk
   [junit4]   2> 701435 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55597_m_bk
   [junit4]   2> 701442 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 701446 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 701453 T1723 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55597_m_bk
   [junit4]   2> 701453 T1723 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 701457 T1723 oasc.Overseer.start Overseer (id=91320451274440708-127.0.0.1:55597_m_bk-n_0000000000) starting
   [junit4]   2> 701463 T1723 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 701471 T1749 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 701472 T1723 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 701473 T1749 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 701477 T1723 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 701480 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 701484 T1748 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 701489 T1750 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 701489 T1750 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 701491 T1750 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 701491 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 701494 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55597/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55597_m_bk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 701495 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 701499 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 701499 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 702289 T1750 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 702289 T1750 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1
   [junit4]   2> 702289 T1750 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 702290 T1750 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 702290 T1750 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 702292 T1750 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 702292 T1750 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1\'
   [junit4]   2> 702296 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/.svn/' to classloader
   [junit4]   2> 702297 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/classes/' to classloader
   [junit4]   2> 702299 T1750 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239/collection1/lib/README' to classloader
   [junit4]   2> 702340 T1750 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 702372 T1750 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 702374 T1750 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 702381 T1750 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 702645 T1750 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 702646 T1750 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 702647 T1750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 702652 T1750 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 702683 T1750 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 702684 T1750 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1393439503239\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/control/data\
   [junit4]   2> 702684 T1750 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
   [junit4]   2> 702684 T1750 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data
   [junit4]   2> 702685 T1750 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/control/data\index/
   [junit4]   2> 702686 T1750 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index' doesn't exist. Creating new index...
   [junit4]   2> 702686 T1750 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index
   [junit4]   2> 702686 T1750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 702691 T1750 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 702691 T1750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 702694 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 702694 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 702695 T1750 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 702695 T1750 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 702696 T1750 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 702697 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 702698 T1750 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 702704 T1750 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 702707 T1750 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 702707 T1750 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 702707 T1750 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 702709 T1750 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\control\data\index,segFN=segments_1,generation=1}
   [junit4]   2> 702709 T1750 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 702709 T1750 oass.SolrIndexSearcher.<init> Opening Searcher@3f73a3dd[collection1] main
   [junit4]   2> 702712 T1751 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3f73a3dd[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 702713 T1750 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 702714 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 702714 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 702714 T1754 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55597/m_bk collection:control_collection shard:shard1
   [junit4]   2> 702716 T1754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 702723 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 702726 T1756 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@21dc2fac name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 702726 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 702727 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 702730 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 702731 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702732 T1754 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 702732 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1250 name=collection1 org.apache.solr.core.SolrCore@430e225d url=https://127.0.0.1:55597/m_bk/collection1 node=127.0.0.1:55597_m_bk C1250_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:55597/m_bk, core=collection1, node_name=127.0.0.1:55597_m_bk}
   [junit4]   2> 702732 T1754 C1250 P55597 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55597/m_bk/collection1/
   [junit4]   2> 702732 T1754 C1250 P55597 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 702733 T1754 C1250 P55597 oasc.SyncStrategy.syncToMe https://127.0.0.1:55597/m_bk/collection1/ has no replicas
   [junit4]   2> 702733 T1754 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55597/m_bk/collection1/ shard1
   [junit4]   2> 702733 T1754 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 702734 T1723 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 702734 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 702741 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702743 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702749 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702832 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 702833 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 702865 T1754 oasc.ZkController.register We are https://127.0.0.1:55597/m_bk/collection1/ and leader is https://127.0.0.1:55597/m_bk/collection1/
   [junit4]   2> 702865 T1754 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55597/m_bk
   [junit4]   2> 702865 T1754 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 702865 T1754 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 702865 T1754 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702867 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702869 T1754 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 702871 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 702871 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55597/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55597_m_bk",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 702875 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 702959 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 702959 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 704071 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 704073 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 704080 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 704081 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55609
   [junit4]   2> 704084 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920
   [junit4]   2> 704084 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\'
   [junit4]   2> 704109 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\solr.xml
   [junit4]   2> 704152 T1723 oasc.CoreContainer.<init> New CoreContainer 701776337
   [junit4]   2> 704153 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\]
   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 704154 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 704155 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 704162 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 704162 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 704163 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 704163 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
   [junit4]   2> 704163 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 704165 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 704187 T1767 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c1fd552 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 704187 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 704208 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f10006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 704212 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 704214 T1769 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b4e1a83 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 704214 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 704225 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 705028 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55609_m_bk
   [junit4]   2> 705030 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55609_m_bk
   [junit4]   2> 705034 T1769 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 705035 T1756 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 705035 T1747 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 705043 T1770 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 705044 T1770 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 705045 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 705046 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 705046 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 705045 T1770 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 705048 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55609/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55609_m_bk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
   [junit4]   2> 705049 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 705054 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 705054 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 705054 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 705054 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 705844 T1770 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 705844 T1770 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1
   [junit4]   2> 705844 T1770 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 705844 T1770 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 705844 T1770 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 705846 T1770 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 705847 T1770 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1\'
   [junit4]   2> 705848 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/.svn/' to classloader
   [junit4]   2> 705850 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/classes/' to classloader
   [junit4]   2> 705851 T1770 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920/collection1/lib/README' to classloader
   [junit4]   2> 705898 T1770 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 705929 T1770 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 705931 T1770 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 705940 T1770 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 706211 T1770 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 706212 T1770 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 706213 T1770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 706219 T1770 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 706255 T1770 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 706255 T1770 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1393439505920\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty1\
   [junit4]   2> 706255 T1770 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
   [junit4]   2> 706255 T1770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1
   [junit4]   2> 706257 T1770 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty1\index/
   [junit4]   2> 706257 T1770 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index' doesn't exist. Creating new index...
   [junit4]   2> 706257 T1770 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index
   [junit4]   2> 706258 T1770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 706262 T1770 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 706262 T1770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 706266 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 706267 T1770 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 706267 T1770 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 706267 T1770 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 706269 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 706270 T1770 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 706274 T1770 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 706278 T1770 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 706278 T1770 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 706278 T1770 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 706278 T1770 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty1\index,segFN=segments_1,generation=1}
   [junit4]   2> 706278 T1770 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 706278 T1770 oass.SolrIndexSearcher.<init> Opening Searcher@5dfc64c0[collection1] main
   [junit4]   2> 706283 T1771 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5dfc64c0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 706285 T1770 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 706285 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 706285 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 706285 T1774 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55609/m_bk collection:collection1 shard:shard1
   [junit4]   2> 706288 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 706299 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 706303 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1251 name=collection1 org.apache.solr.core.SolrCore@8a87040 url=https://127.0.0.1:55609/m_bk/collection1 node=127.0.0.1:55609_m_bk C1251_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55609/m_bk, core=collection1, node_name=127.0.0.1:55609_m_bk}
   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55609/m_bk/collection1/
   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 706304 T1774 C1251 P55609 oasc.SyncStrategy.syncToMe https://127.0.0.1:55609/m_bk/collection1/ has no replicas
   [junit4]   2> 706304 T1774 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55609/m_bk/collection1/ shard1
   [junit4]   2> 706304 T1774 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 706308 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 706315 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706318 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706324 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706408 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 706408 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 706409 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 706442 T1774 oasc.ZkController.register We are https://127.0.0.1:55609/m_bk/collection1/ and leader is https://127.0.0.1:55609/m_bk/collection1/
   [junit4]   2> 706442 T1774 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55609/m_bk
   [junit4]   2> 706442 T1774 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 706442 T1774 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 706442 T1774 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706445 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706447 T1774 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 706448 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 706448 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55609/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55609_m_bk",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node1"}
   [junit4]   2> 706453 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 706537 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 706537 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 706537 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 707611 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 707611 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 707617 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 707619 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55618
   [junit4]   2> 707622 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474
   [junit4]   2> 707622 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\'
   [junit4]   2> 707643 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\solr.xml
   [junit4]   2> 707691 T1723 oasc.CoreContainer.<init> New CoreContainer 1544127607
   [junit4]   2> 707691 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\]
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 707692 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 707699 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 707699 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 707699 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 707699 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
   [junit4]   2> 707699 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 707703 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 707715 T1785 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32562365 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 707716 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 707719 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 707721 T1787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@261b5054 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 707721 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 707727 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 708530 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55618_m_bk
   [junit4]   2> 708532 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55618_m_bk
   [junit4]   2> 708536 T1769 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 708537 T1747 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 708537 T1756 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 708539 T1787 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 708550 T1788 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 708550 T1788 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 708553 T1788 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 708553 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 708555 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55618/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55618_m_bk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 708556 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
   [junit4]   2> 708561 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 708563 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 708563 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 708563 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 708563 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 709414 T1788 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 709414 T1788 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1
   [junit4]   2> 709414 T1788 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 709414 T1788 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 709415 T1788 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 709417 T1788 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 709417 T1788 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1\'
   [junit4]   2> 709420 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/.svn/' to classloader
   [junit4]   2> 709420 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/classes/' to classloader
   [junit4]   2> 709421 T1788 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474/collection1/lib/README' to classloader
   [junit4]   2> 709463 T1788 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 709499 T1788 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 709502 T1788 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 709509 T1788 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 709811 T1788 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 709813 T1788 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 709815 T1788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 709819 T1788 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 709858 T1788 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
   [junit4]   2> 709859 T1788 oasc.SolrCore.<init> [collection1] Opening new SolrCore at .\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1393439509474\collection1\, dataDir=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty2\
   [junit4]   2> 709859 T1788 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@79d7c4fb
   [junit4]   2> 709860 T1788 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2
   [junit4]   2> 709861 T1788 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084/jetty2\index/
   [junit4]   2> 709862 T1788 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index' doesn't exist. Creating new index...
   [junit4]   2> 709862 T1788 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index
   [junit4]   2> 709863 T1788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 709868 T1788 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 709868 T1788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 709871 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 709872 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 709873 T1788 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 709873 T1788 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 709873 T1788 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 709874 T1788 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 709875 T1788 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 709882 T1788 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 709886 T1788 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 709886 T1788 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 709887 T1788 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1854487036, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 709887 T1788 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty2\index,segFN=segments_1,generation=1}
   [junit4]   2> 709887 T1788 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 709887 T1788 oass.SolrIndexSearcher.<init> Opening Searcher@366b827b[collection1] main
   [junit4]   2> 709891 T1789 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@366b827b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 709893 T1788 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 709894 T1723 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 709894 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 709895 T1792 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:55618/m_bk collection:collection1 shard:shard3
   [junit4]   2> 709898 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
   [junit4]   2> 709907 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
   [junit4]   2> 709911 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1252 name=collection1 org.apache.solr.core.SolrCore@153326ab url=https://127.0.0.1:55618/m_bk/collection1 node=127.0.0.1:55618_m_bk C1252_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:55618/m_bk, core=collection1, node_name=127.0.0.1:55618_m_bk}
   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:55618/m_bk/collection1/
   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 709913 T1792 C1252 P55618 oasc.SyncStrategy.syncToMe https://127.0.0.1:55618/m_bk/collection1/ has no replicas
   [junit4]   2> 709913 T1792 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:55618/m_bk/collection1/ shard3
   [junit4]   2> 709914 T1792 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
   [junit4]   2> 709917 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 709925 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 709929 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 709936 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 710027 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710028 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710028 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710029 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710065 T1792 oasc.ZkController.register We are https://127.0.0.1:55618/m_bk/collection1/ and leader is https://127.0.0.1:55618/m_bk/collection1/
   [junit4]   2> 710065 T1792 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55618/m_bk
   [junit4]   2> 710065 T1792 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 710065 T1792 oasc.ZkController.publish publishing core=collection1 state=active
   [junit4]   2> 710065 T1792 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 710067 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 710068 T1792 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 710070 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 710071 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55618/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55618_m_bk",
   [junit4]   2> 	  "shard":"shard3",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":"core_node2"}
   [junit4]   2> 710076 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 710168 T1769 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710169 T1756 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710169 T1787 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 710169 T1747 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 711301 T1723 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 711301 T1723 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 711307 T1723 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 711310 T1723 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:55627
   [junit4]   2> 711315 T1723 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 711315 T1723 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 711316 T1723 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085
   [junit4]   2> 711316 T1723 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\'
   [junit4]   2> 711341 T1723 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\solr.xml
   [junit4]   2> 711384 T1723 oasc.CoreContainer.<init> New CoreContainer 1098395650
   [junit4]   2> 711384 T1723 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1393439513085\]
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 711384 T1723 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 711392 T1723 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 711392 T1723 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 711392 T1723 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 711392 T1723 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55587/solr
   [junit4]   2> 711392 T1723 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 711396 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 711405 T1803 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49d1664 name:ZooKeeperConnection Watcher:127.0.0.1:55587 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 711405 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 711408 T1725 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1446f7772f1000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 711409 T1723 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 711412 T1805 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ff94051 name:ZooKeeperConnection Watcher:127.0.0.1:55587/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 711412 T1723 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 711419 T1723 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 712301 T1723 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55627_m_bk
   [junit4]   2> 712303 T1723 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55627_m_bk
   [junit4]   2> 712308 T1747 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 712309 T1756 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 712309 T1805 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 712309 T1769 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 712309 T1787 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 712320 T1806 oasc.ZkController.publish publishing core=collection1 state=down
   [junit4]   2> 712320 T1806 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 712322 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 712323 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 712323 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 712322 T1806 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 712325 T1748 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 712325 T1748 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:55627/m_bk",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55627_m_bk",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "numShards":"3",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 712326 T1748 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
   [junit4]   2> 712326 T1748 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 712330 T1747 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 712331 T1787 oas

[...truncated too long message...]

insSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9;done=false>>]
   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9
   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index;done=false>>]
   [junit4]   2> 818244 T1922 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty9\index
   [junit4]   2> 818244 T1922 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 818244 T1922 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 818248 T1962 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index;done=false>>]
   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11\index
   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11 [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11;done=false>>]
   [junit4]   2> 818345 T1962 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1393439503084\jetty11
   [junit4]   2> 818345 T1962 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 818345 T1962 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ar_IQ, timezone=America/El_Salvador
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_60-ea (64-bit)/cpus=2,threads=1,free=60375552,total=270503936
   [junit4]   2> NOTE: All tests run in this JVM: [ConnectionManagerTest, PrimitiveFieldTypeTest, TestCollationField, TestNonDefinedSimilarityFactory, TestNoOpRegenerator, DistributedSpellCheckComponentTest, SolrPluginUtilsTest, TestSolrQueryParser, IndexBasedSpellCheckerTest, PathHierarchyTokenizerFactoryTest, HdfsBasicDistributedZk2Test, DocValuesMultiTest, TestFunctionQuery, CSVRequestHandlerTest, BadComponentTest, DistributedDebugComponentTest, DirectUpdateHandlerOptimizeTest, HdfsSyncSliceTest, DirectSolrSpellCheckerTest, TestRandomDVFaceting, URLClassifyProcessorTest, SoftAutoCommitTest, QueryElevationComponentTest, LegacyHTMLStripCharFilterTest, FileBasedSpellCheckerTest, ConvertedLegacyTest, QueryFacetTest, SyncSliceTest, TestQuerySenderListener, DocValuesTest, FieldAnalysisRequestHandlerTest, DisMaxRequestHandlerTest, TestManagedSchema, FileUtilsTest, TestPHPSerializedResponseWriter, HdfsLockFactoryTest, OpenCloseCoreStressTest, TestBinaryResponseWriter, BadIndexSchemaTest, HdfsBasicDistributedZkTest, SuggesterWFSTTest, TestUtils, TestDFRSimilarityFactory, OverseerCollectionProcessorTest, UpdateRequestProcessorFactoryTest, TestAnalyzeInfixSuggestions, TimeZoneUtilsTest, HdfsRecoveryZkTest, PluginInfoTest, RequestHandlersTest, TestFieldTypeResource, TestValueSourceCache, TestCollapseQParserPlugin, SOLR749Test, RecoveryZkTest, TestRandomMergePolicy, PreAnalyzedFieldTest, TestExtendedDismaxParser, JSONWriterTest, TestSuggestSpellingConverter, SimpleFacetsTest, TestOverriddenPrefixQueryForCustomFieldType, HighlighterTest, ScriptEngineTest, ClusterStateTest, ZkControllerTest, BinaryUpdateRequestHandlerTest, TestSolrXmlPersistence, PingRequestHandlerTest, TestRemoteStreaming, DistributedSuggestComponentTest, TestReversedWildcardFilterFactory, TestFoldingMultitermQuery, SortByFunctionTest, TermsComponentTest, DocumentAnalysisRequestHandlerTest, SynonymTokenizerTest, TestDynamicFieldCollectionResource, RegexBoostProcessorTest, TestRandomFaceting, AddSchemaFieldsUpdateProcessorFactoryTest, TestManagedSchemaFieldResource, TestDefaultSimilarityFactory, TestSolrXmlPersistor, SliceStateTest, AbstractAnalyticsStatsTest, EnumFieldTest, IndexSchemaTest, TestInfoStreamLogging, AbstractAnalyticsFacetTest, DistribCursorPagingTest, SolrCoreTest, DistributedQueryElevationComponentTest, EchoParamsTest, ChaosMonkeySafeLeaderTest]
   [junit4] Completed in 118.97s, 1 test, 1 error <<< FAILURES!

[...truncated 864 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 1 error, 52 ignored (24 assumptions)

Total time: 87 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_60-ea-b04 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.8.0-fcs-b129) - Build # 3817 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3817/
Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
REGRESSION:  org.apache.solr.core.TestLazyCores.testLazyLoad

Error Message:
Test abandoned because suite timeout was reached.

Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
	at __randomizedtesting.SeedInfo.seed([1E468F4F611387A5]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.core.TestLazyCores

Error Message:
Suite timeout exceeded (>= 7200000 msec).

Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
	at __randomizedtesting.SeedInfo.seed([1E468F4F611387A5]:0)




Build Log:
[...truncated 10682 lines...]
   [junit4] Suite: org.apache.solr.core.TestLazyCores
   [junit4]   2> 2647583 T9805 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 2647583 T9805 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495
   [junit4]   2> 2647585 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\'
   [junit4]   2> 2647587 T9805 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 2647588 T9805 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 2647588 T9805 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 2647625 T9805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2647633 T9805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 2647633 T9805 oass.IndexSchema.readSchema Reading Solr Schema from schema-tiny.xml
   [junit4]   2> 2647636 T9805 oass.IndexSchema.readSchema [null] Schema name=tiny
   [junit4]   2> 2647641 T9805 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2647641 T9805 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2647641 T9805 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr
   [junit4]   2> 2647641 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\'
   [junit4]   2> 2647660 T9805 oasc.CoreContainer.<init> New CoreContainer 341627132
   [junit4]   2> 2647660 T9805 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\]
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2647662 T9805 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2647666 T9805 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2647667 T9805 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2647667 T9805 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 2647670 T9806 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1
   [junit4]   2> 2647670 T9806 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\'
   [junit4]   2> 2647670 T9806 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
   [junit4]   2> 2647670 T9806 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
   [junit4]   2> 2647670 T9806 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/C:/Users/JenkinsSlave/workspace/Lucene-Solr-trunk-Windows/solr/core/src/test-files/solr/collection1/lib/README' to classloader
   [junit4]   2> 2647695 T9806 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2647702 T9806 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig-minimal.xml
   [junit4]   2> 2647702 T9806 oass.IndexSchema.readSchema Reading Solr Schema from schema-tiny.xml
   [junit4]   2> 2647706 T9806 oass.IndexSchema.readSchema [collection1] Schema name=tiny
   [junit4]   2> 2647708 T9806 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2647708 T9806 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2647711 T9806 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495\
   [junit4]   2> 2647711 T9806 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 2647714 T9806 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495\
   [junit4]   2> 2647714 T9806 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495\index/
   [junit4]   2> 2647715 T9806 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495\index' doesn't exist. Creating new index...
   [junit4]   2> 2647716 T9806 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-TestLazyCores-1393351351495\index
   [junit4]   2> 2647716 T9806 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2647717 T9806 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2cef803f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324d079f),segFN=segments_1,generation=1}
   [junit4]   2> 2647717 T9806 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647718 T9806 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2647718 T9806 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2647719 T9806 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2647719 T9806 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2647724 T9806 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2647725 T9806 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2647725 T9806 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2647725 T9806 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2647725 T9806 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2cef803f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@324d079f),segFN=segments_1,generation=1}
   [junit4]   2> 2647725 T9806 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647725 T9806 oass.SolrIndexSearcher.<init> Opening Searcher@5d3a45c7[collection1] main
   [junit4]   2> 2647727 T9806 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2647727 T9807 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5d3a45c7[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2647729 T9805 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 2647735 T9805 oas.SolrTestCaseJ4.setUp ###Starting testRace
   [junit4]   2> 2647801 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\'
   [junit4]   2> 2647827 T9805 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\solr.xml
   [junit4]   2> 2647836 T9805 oasc.CoreContainer.<init> New CoreContainer 1629219968
   [junit4]   2> 2647836 T9805 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\]
   [junit4]   2> 2647837 T9805 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 2647837 T9805 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 2647837 T9805 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 2647837 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2647838 T9805 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2647838 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2647838 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2647838 T9805 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2647838 T9805 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2647840 T9805 oasc.SolrCores.allocateLazyCores Allocating transient cache for 4 transient cores
   [junit4]   2> 2647840 T9805 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2647840 T9805 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2647840 T9805 oasc.CoreContainer.load Host Name: null
   [junit4]   2> 2647852 T9809 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1
   [junit4]   2> 2647852 T9809 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\'
   [junit4]   2> 2647876 T9809 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2647882 T9809 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2647882 T9809 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2647887 T9809 oass.IndexSchema.readSchema [collection1] Schema name=tiny
   [junit4]   2> 2647891 T9809 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2647891 T9809 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2647893 T9809 oasc.SolrCore.<init> [collection1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\
   [junit4]   2> 2647893 T9809 oasc.SolrCore.<init> JMX monitoring not detected for core: collection1
   [junit4]   2> 2647894 T9809 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\
   [junit4]   2> 2647894 T9809 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index/
   [junit4]   2> 2647894 T9809 oasc.SolrCore.initIndex WARN [collection1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2647895 T9809 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index
   [junit4]   2> 2647895 T9809 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2647912 T9809 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5119a4c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@41a987fe),segFN=segments_1,generation=1}
   [junit4]   2> 2647912 T9809 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647914 T9809 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2647914 T9809 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2647914 T9809 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2647915 T9809 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2647920 T9809 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2647921 T9809 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2647921 T9809 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2647921 T9809 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2647922 T9809 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@5119a4c lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@41a987fe),segFN=segments_1,generation=1}
   [junit4]   2> 2647922 T9809 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647922 T9809 oass.SolrIndexSearcher.<init> Opening Searcher@554ec5bd[collection1] main
   [junit4]   2> 2647923 T9809 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2647923 T9810 oasc.CoreContainer.create Creating SolrCore 'collectionLazy2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2
   [junit4]   2> 2647923 T9810 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\'
   [junit4]   2> 2647942 T9810 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2647947 T9810 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2647949 T9810 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2647953 T9810 oass.IndexSchema.readSchema [collectionLazy2] Schema name=tiny
   [junit4]   2> 2647955 T9810 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2647955 T9810 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2647957 T9810 oasc.SolrCore.<init> [collectionLazy2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\
   [junit4]   2> 2647957 T9810 oasc.SolrCore.<init> JMX monitoring not detected for core: collectionLazy2
   [junit4]   2> 2647957 T9811 oasc.CoreContainer.create Creating SolrCore 'collectionLazy5' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5
   [junit4]   2> 2647957 T9811 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\'
   [junit4]   2> 2647977 T9811 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2647983 T9811 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2647983 T9811 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2647986 T9811 oass.IndexSchema.readSchema [collectionLazy5] Schema name=tiny
   [junit4]   2> 2647989 T9811 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2647989 T9811 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2647989 T9811 oasc.SolrCore.<init> [collectionLazy5] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\
   [junit4]   2> 2647989 T9811 oasc.SolrCore.<init> JMX monitoring not detected for core: collectionLazy5
   [junit4]   2> 2647990 T9810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\
   [junit4]   2> 2647990 T9810 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index/
   [junit4]   2> 2647990 T9810 oasc.SolrCore.initIndex WARN [collectionLazy2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2647991 T9811 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\
   [junit4]   2> 2647991 T9811 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index/
   [junit4]   2> 2647991 T9811 oasc.SolrCore.initIndex WARN [collectionLazy5] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2647992 T9810 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index
   [junit4]   2> 2647992 T9810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2647993 T9811 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index
   [junit4]   2> 2647993 T9811 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2647994 T9810 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@59a9f1c2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a4b311),segFN=segments_1,generation=1}
   [junit4]   2> 2647994 T9810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647994 T9811 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74f89444 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@747f5054),segFN=segments_1,generation=1}
   [junit4]   2> 2647994 T9811 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2647995 T9810 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2647995 T9810 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2647995 T9810 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2647995 T9810 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2647997 T9810 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2647998 T9811 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2647999 T9811 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2647999 T9811 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2647999 T9811 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648001 T9811 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648001 T9810 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648001 T9810 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648002 T9811 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648002 T9811 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648002 T9810 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2648002 T9811 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2648003 T9810 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@59a9f1c2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2a4b311),segFN=segments_1,generation=1}
   [junit4]   2> 2648003 T9810 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648003 T9810 oass.SolrIndexSearcher.<init> Opening Searcher@30f4cc78[collectionLazy2] main
   [junit4]   2> 2648004 T9811 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@74f89444 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@747f5054),segFN=segments_1,generation=1}
   [junit4]   2> 2648005 T9811 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648005 T9811 oass.SolrIndexSearcher.<init> Opening Searcher@796e5c82[collectionLazy5] main
   [junit4]   2> 2648006 T9813 oasc.SolrCore.registerSearcher [collectionLazy2] Registered new searcher Searcher@30f4cc78[collectionLazy2] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648005 T9810 oasc.SolrCores.putTransientCore Opening transient core collectionLazy2
   [junit4]   2> 2648006 T9810 oasc.CoreContainer.registerCore registering core: collectionLazy2
   [junit4]   2> 2648006 T9811 oasc.CoreContainer.registerCore registering core: collectionLazy5
   [junit4]   2> 2648008 T9812 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@554ec5bd[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648009 T9814 oasc.SolrCore.registerSearcher [collectionLazy5] Registered new searcher Searcher@796e5c82[collectionLazy5] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648011 T9816 oasc.CoreContainer.create Creating SolrCore 'collectionLazy3' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3
   [junit4]   2> 2648011 T9816 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\'
   [junit4]   2> 2648029 T9816 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648047 T9816 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648049 T9816 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648052 T9816 oass.IndexSchema.readSchema [collectionLazy3] Schema name=tiny
   [junit4]   2> 2648055 T9816 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648055 T9816 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648057 T9816 oasc.SolrCore.<init> [collectionLazy3] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\
   [junit4]   2> 2648057 T9816 oasc.SolrCore.<init> JMX monitoring not detected for core: collectionLazy3
   [junit4]   2> 2648073 T9816 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\
   [junit4]   2> 2648073 T9816 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index/
   [junit4]   2> 2648073 T9816 oasc.SolrCore.initIndex WARN [collectionLazy3] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648074 T9816 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index
   [junit4]   2> 2648075 T9816 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2648075 T9816 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@62780ff9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42b4d86b),segFN=segments_1,generation=1}
   [junit4]   2> 2648075 T9816 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648077 T9816 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648078 T9816 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648078 T9816 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648078 T9816 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648080 T9816 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648082 T9816 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648082 T9816 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648083 T9816 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2648083 T9816 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@62780ff9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42b4d86b),segFN=segments_1,generation=1}
   [junit4]   2> 2648083 T9816 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648083 T9816 oass.SolrIndexSearcher.<init> Opening Searcher@63c33ffe[collectionLazy3] main
   [junit4]   2> 2648085 T9816 oasc.SolrCores.putTransientCore Opening transient core collectionLazy3
   [junit4]   2> 2648085 T9816 oasc.CoreContainer.registerCore registering core: collectionLazy3
   [junit4]   2> 2648086 T9831 oasc.SolrCore.registerSearcher [collectionLazy3] Registered new searcher Searcher@63c33ffe[collectionLazy3] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648094 T9805 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1629219968
   [junit4]   2> 2648095 T9805 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@48a4ec42
   [junit4]   2> 2648095 T9805 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2648095 T9805 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2648095 T9805 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2648095 T9805 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2648097 T9805 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2648097 T9805 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2648097 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index;done=false>>]
   [junit4]   2> 2648097 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\index
   [junit4]   2> 2648097 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\;done=false>>]
   [junit4]   2> 2648097 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection1\data\
   [junit4]   2> 2648097 T9805 oasc.SolrCore.close [collectionLazy5]  CLOSING SolrCore org.apache.solr.core.SolrCore@58b8e950
   [junit4]   2> 2648097 T9805 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2648097 T9805 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2648097 T9805 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2648097 T9805 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2648100 T9805 oasc.SolrCore.closeSearcher [collectionLazy5] Closing main searcher on request.
   [junit4]   2> 2648100 T9805 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2648100 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index;done=false>>]
   [junit4]   2> 2648100 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\index
   [junit4]   2> 2648101 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\;done=false>>]
   [junit4]   2> 2648101 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection5\data\
   [junit4]   2> 2648101 T9805 oasc.SolrCore.close [collectionLazy2]  CLOSING SolrCore org.apache.solr.core.SolrCore@4263a25
   [junit4]   2> 2648101 T9805 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2648101 T9805 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2648101 T9805 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2648101 T9805 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2648103 T9805 oasc.SolrCore.closeSearcher [collectionLazy2] Closing main searcher on request.
   [junit4]   2> 2648103 T9805 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2648103 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index;done=false>>]
   [junit4]   2> 2648103 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\index
   [junit4]   2> 2648104 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\;done=false>>]
   [junit4]   2> 2648104 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection2\data\
   [junit4]   2> 2648104 T9805 oasc.SolrCore.close [collectionLazy3]  CLOSING SolrCore org.apache.solr.core.SolrCore@27d4931
   [junit4]   2> 2648104 T9805 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2648104 T9805 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2648104 T9805 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2648104 T9805 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2648106 T9805 oasc.SolrCore.closeSearcher [collectionLazy3] Closing main searcher on request.
   [junit4]   2> 2648106 T9805 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2648106 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index;done=false>>]
   [junit4]   2> 2648106 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\index
   [junit4]   2> 2648107 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\ [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\;done=false>>]
   [junit4]   2> 2648107 T9805 oasc.CachingDirectoryFactory.close Closing directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\collection3\data\
   [junit4]   2> 2648179 T9805 oas.SolrTestCaseJ4.tearDown ###Ending testRace
   [junit4]   2> 2648182 T9805 oas.SolrTestCaseJ4.setUp ###Starting testBadConfigsGenerateErrors
   [junit4]   2> 2648227 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\'
   [junit4]   2> 2648252 T9805 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\solr.xml
   [junit4]   2> 2648262 T9805 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores
   [junit4]   2> 2648263 T9805 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores
   [junit4]   2> 2648263 T9805 oasc.CoreContainer.<init> New CoreContainer 66674091
   [junit4]   2> 2648263 T9805 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\]
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2648264 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2648265 T9805 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2648265 T9805 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2648265 T9805 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2648269 T9805 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2648269 T9805 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2648269 T9805 oasc.CoreContainer.load Host Name: null
   [junit4]   2> 2648270 T9805 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores
   [junit4]   2> 2648273 T9805 oasc.CorePropertiesLocator.discoverUnder Found core badConfig1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\
   [junit4]   2> 2648273 T9805 oasc.CorePropertiesLocator.discoverUnder Found core badConfig2 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\
   [junit4]   2> 2648273 T9805 oasc.CorePropertiesLocator.discoverUnder Found core badSchema1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\
   [junit4]   2> 2648276 T9805 oasc.CorePropertiesLocator.discoverUnder Found core badSchema2 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\
   [junit4]   2> 2648276 T9805 oasc.CorePropertiesLocator.discoverUnder Found core core1 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\
   [junit4]   2> 2648276 T9805 oasc.CorePropertiesLocator.discoverUnder Found core core2 in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\
   [junit4]   2> 2648279 T9805 oasc.CorePropertiesLocator.discover Found 6 core definitions
   [junit4]   2> 2648281 T9833 oasc.CoreContainer.create Creating SolrCore 'badConfig1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1
   [junit4]   2> 2648281 T9833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\'
   [junit4]   2> 2648304 T9833 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648304 T9833 oasc.CoreContainer.createFromLocal ERROR Failed to load file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\solrconfig.xml
   [junit4]   2> 2648306 T9833 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: badConfig1 Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648306 T9833 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648307 T9833 oasc.CoreContainer.create Creating SolrCore 'badSchema2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2
   [junit4]   2> 2648307 T9833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\'
   [junit4]   2> 2648324 T9833 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648330 T9833 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648330 T9833 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648332 T9833 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648332 T9833 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: badSchema2 Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648336 T9833 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648336 T9833 oasc.CoreContainer.create Creating SolrCore 'core1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1
   [junit4]   2> 2648336 T9833 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\'
   [junit4]   2> 2648354 T9833 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648366 T9834 oasc.CoreContainer.create Creating SolrCore 'badConfig2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2
   [junit4]   2> 2648366 T9834 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\'
   [junit4]   2> 2648381 T9834 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648381 T9834 oasc.CoreContainer.createFromLocal ERROR Failed to load file C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\solrconfig.xml
   [junit4]   2> 2648381 T9834 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: badConfig2 Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648381 T9834 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648381 T9834 oasc.CoreContainer.create Creating SolrCore 'core2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2
   [junit4]   2> 2648381 T9834 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\'
   [junit4]   2> 2648402 T9834 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648407 T9834 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648408 T9834 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648412 T9834 oass.IndexSchema.readSchema [core2] Schema name=tiny
   [junit4]   2> 2648416 T9834 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648416 T9834 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648418 T9834 oasc.SolrCore.<init> [core2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\
   [junit4]   2> 2648418 T9834 oasc.SolrCore.<init> JMX monitoring not detected for core: core2
   [junit4]   2> 2648418 T9834 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\
   [junit4]   2> 2648418 T9834 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\index/
   [junit4]   2> 2648418 T9834 oasc.SolrCore.initIndex WARN [core2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648419 T9834 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\index
   [junit4]   2> 2648420 T9834 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2648420 T9834 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@17c4de80 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@620406bb),segFN=segments_1,generation=1}
   [junit4]   2> 2648420 T9834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648420 T9834 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648420 T9834 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648421 T9834 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648421 T9834 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648426 T9834 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648427 T9834 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648427 T9834 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648427 T9834 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2648428 T9834 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@17c4de80 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@620406bb),segFN=segments_1,generation=1}
   [junit4]   2> 2648428 T9834 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648428 T9834 oass.SolrIndexSearcher.<init> Opening Searcher@60aead98[core2] main
   [junit4]   2> 2648432 T9833 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648438 T9833 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648442 T9833 oass.IndexSchema.readSchema [core1] Schema name=tiny
   [junit4]   2> 2648444 T9833 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648444 T9833 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648445 T9833 oasc.SolrCore.<init> [core1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\data\
   [junit4]   2> 2648445 T9833 oasc.SolrCore.<init> JMX monitoring not detected for core: core1
   [junit4]   2> 2648438 T9836 oasc.SolrCore.registerSearcher [core2] Registered new searcher Searcher@60aead98[core2] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648438 T9834 oasc.CoreContainer.registerCore registering core: core2
   [junit4]   2> 2648447 T9833 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\data\
   [junit4]   2> 2648447 T9833 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\data\index/
   [junit4]   2> 2648447 T9833 oasc.SolrCore.initIndex WARN [core1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648448 T9833 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core1\data\index
   [junit4]   2> 2648448 T9833 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=39, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3628029192786042]
   [junit4]   2> 2648448 T9833 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_1,generation=1}
   [junit4]   2> 2648448 T9833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648449 T9833 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648449 T9833 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648450 T9833 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648450 T9833 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648451 T9833 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648433 T9835 oasc.CoreContainer.create Creating SolrCore 'badSchema1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1
   [junit4]   2> 2648451 T9835 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\'
   [junit4]   2> 2648469 T9835 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648475 T9835 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648475 T9835 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648478 T9835 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648478 T9835 oasc.CoreContainer.recordAndThrow ERROR Unable to create core: badSchema1 Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648480 T9835 oasc.SolrException.log Ignoring exception matching \QSAXParseException\E
   [junit4]   2> 2648480 T9833 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648480 T9833 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648481 T9833 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=43, maxMergedSegmentMB=85.0830078125, floorSegmentMB=1.7626953125, forceMergeDeletesPctAllowed=29.124094156630637, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.600800832000014
   [junit4]   2> 2648481 T9833 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_1,generation=1}
   [junit4]   2> 2648481 T9833 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648481 T9833 oass.SolrIndexSearcher.<init> Opening Searcher@220114a6[core1] main
   [junit4]   2> 2648483 T9833 oasc.CoreContainer.registerCore registering core: core1
   [junit4]   2> 2648483 T9837 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@220114a6[core1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648485 T9805 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2648485 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_2,generation=2}
   [junit4]   2> 2648487 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 2648487 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@7e5a8a94[core1] main
   [junit4]   2> 2648487 T9805 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 2648488 T9837 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@7e5a8a94[core1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c7)}
   [junit4]   2> ASYNC  NEW_CORE C4366 name=core1 org.apache.solr.core.SolrCore@75de95c1
   [junit4]   2> 2648489 T9805 C4366 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!prefix+f%3Dv_t}hel&wt=xml} hits=2 status=0 QTime=1 
   [junit4]   2> 2648491 T9805 C4366 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}hello&wt=xml} hits=2 status=0 QTime=1 
   [junit4]   2> 2648492 T9805 C4366 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}Hello&wt=xml} hits=0 status=0 QTime=1 
   [junit4]   2> 2648492 T9805 C4366 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_f}1.5&wt=xml} hits=0 status=0 QTime=0 
   [junit4]   2> 2648499 T9805 oasc.CoreContainer.create Creating SolrCore 'badConfig1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1
   [junit4]   2> 2648499 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\'
   [junit4]   2> 2648527 T9805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648534 T9805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648534 T9805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648537 T9805 oass.IndexSchema.readSchema [badConfig1] Schema name=tiny
   [junit4]   2> 2648539 T9805 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648539 T9805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648541 T9805 oasc.SolrCore.<init> [badConfig1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\data\
   [junit4]   2> 2648541 T9805 oasc.SolrCore.<init> JMX monitoring not detected for core: badConfig1
   [junit4]   2> 2648541 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\data\
   [junit4]   2> 2648541 T9805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\data\index/
   [junit4]   2> 2648541 T9805 oasc.SolrCore.initIndex WARN [badConfig1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648543 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig1\data\index
   [junit4]   2> 2648543 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3839131811998765]
   [junit4]   2> 2648543 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6156d19f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1aa126c),segFN=segments_1,generation=1}
   [junit4]   2> 2648543 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648545 T9805 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648545 T9805 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648546 T9805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648546 T9805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648547 T9805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648548 T9805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648548 T9805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648548 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1083395026, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 2648549 T9805 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6156d19f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1aa126c),segFN=segments_1,generation=1}
   [junit4]   2> 2648549 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648549 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@4d83802e[badConfig1] main
   [junit4]   2> 2648551 T9805 oasc.SolrCores.putTransientCore Opening transient core badConfig1
   [junit4]   2> 2648551 T9805 oasc.CoreContainer.registerCore registering core: badConfig1
   [junit4]   2> 2648551 T9805 oasc.CoreContainer.create Creating SolrCore 'badConfig2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2
   [junit4]   2> 2648551 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\'
   [junit4]   2> 2648570 T9805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648576 T9805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648576 T9805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648581 T9805 oass.IndexSchema.readSchema [badConfig2] Schema name=tiny
   [junit4]   2> 2648584 T9805 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648584 T9805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648586 T9805 oasc.SolrCore.<init> [badConfig2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\data\
   [junit4]   2> 2648586 T9805 oasc.SolrCore.<init> JMX monitoring not detected for core: badConfig2
   [junit4]   2> 2648587 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\data\
   [junit4]   2> 2648587 T9805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\data\index/
   [junit4]   2> 2648587 T9805 oasc.SolrCore.initIndex WARN [badConfig2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648588 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badConfig2\data\index
   [junit4]   2> 2648588 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=43, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5338438552709478]
   [junit4]   2> 2648588 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3c2f3a57 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56503283),segFN=segments_1,generation=1}
   [junit4]   2> 2648588 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648590 T9805 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648590 T9805 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648591 T9805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648591 T9805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648593 T9805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648594 T9805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648594 T9805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648594 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=92.9423828125, floorSegmentMB=1.287109375, forceMergeDeletesPctAllowed=2.6466250626050636, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2648594 T9805 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3c2f3a57 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56503283),segFN=segments_1,generation=1}
   [junit4]   2> 2648594 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648594 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@26bd726d[badConfig2] main
   [junit4]   2> 2648596 T9839 oasc.SolrCore.registerSearcher [badConfig1] Registered new searcher Searcher@4d83802e[badConfig1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648596 T9841 oasc.SolrCore.registerSearcher [badConfig2] Registered new searcher Searcher@26bd726d[badConfig2] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648596 T9805 oasc.SolrCores.putTransientCore Opening transient core badConfig2
   [junit4]   2> 2648597 T9805 oasc.CoreContainer.registerCore registering core: badConfig2
   [junit4]   2> 2648597 T9805 oasc.CoreContainer.create Creating SolrCore 'badSchema1' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1
   [junit4]   2> 2648597 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\'
   [junit4]   2> 2648616 T9805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648628 T9805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648630 T9805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648633 T9805 oass.IndexSchema.readSchema [badSchema1] Schema name=tiny
   [junit4]   2> 2648636 T9805 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648636 T9805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648637 T9805 oasc.SolrCore.<init> [badSchema1] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\data\
   [junit4]   2> 2648637 T9805 oasc.SolrCore.<init> JMX monitoring not detected for core: badSchema1
   [junit4]   2> 2648637 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\data\
   [junit4]   2> 2648637 T9805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\data\index/
   [junit4]   2> 2648637 T9805 oasc.SolrCore.initIndex WARN [badSchema1] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648638 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema1\data\index
   [junit4]   2> 2648639 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=71.4384765625, floorSegmentMB=1.9462890625, forceMergeDeletesPctAllowed=0.7048446762804661, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.816908068604344
   [junit4]   2> 2648640 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7a35da3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d3cd9d6),segFN=segments_1,generation=1}
   [junit4]   2> 2648640 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648641 T9805 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648641 T9805 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648642 T9805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648642 T9805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648643 T9805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648645 T9805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648645 T9805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648645 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=29, maxMergeAtOnceExplicit=23, maxMergedSegmentMB=14.3291015625, floorSegmentMB=1.650390625, forceMergeDeletesPctAllowed=17.97748267509841, segmentsPerTier=26.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 2648646 T9805 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7a35da3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d3cd9d6),segFN=segments_1,generation=1}
   [junit4]   2> 2648646 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648646 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@10daf675[badSchema1] main
   [junit4]   2> 2648647 T9805 oasc.SolrCores.putTransientCore Opening transient core badSchema1
   [junit4]   2> 2648647 T9805 oasc.CoreContainer.registerCore registering core: badSchema1
   [junit4]   2> 2648647 T9805 oasc.CoreContainer.create Creating SolrCore 'badSchema2' using instanceDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2
   [junit4]   2> 2648647 T9805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\'
   [junit4]   2> 2648666 T9805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 2648671 T9805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2648671 T9805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2648674 T9805 oass.IndexSchema.readSchema [badSchema2] Schema name=tiny
   [junit4]   2> 2648677 T9805 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2648677 T9805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2648678 T9805 oasc.SolrCore.<init> [badSchema2] Opening new SolrCore at C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\, dataDir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\data\
   [junit4]   2> 2648678 T9805 oasc.SolrCore.<init> JMX monitoring not detected for core: badSchema2
   [junit4]   2> 2648679 T9843 oasc.SolrCore.registerSearcher [badSchema1] Registered new searcher Searcher@10daf675[badSchema1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648682 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\data\
   [junit4]   2> 2648682 T9805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\data\index/
   [junit4]   2> 2648682 T9805 oasc.SolrCore.initIndex WARN [badSchema2] Solr index directory 'C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 2648683 T9805 oasc.CachingDirectoryFactory.get return new directory for C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\badSchema2\data\index
   [junit4]   2> 2648683 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=44, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 2648683 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3ab23bdf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67ff33d1),segFN=segments_1,generation=1}
   [junit4]   2> 2648683 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648685 T9805 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2648685 T9805 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 2648686 T9805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2648686 T9805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2648687 T9805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2648698 T9805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2648698 T9805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2648698 T9805 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.707704457859236]
   [junit4]   2> 2648699 T9805 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3ab23bdf lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67ff33d1),segFN=segments_1,generation=1}
   [junit4]   2> 2648699 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2648699 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@10731f92[badSchema2] main
   [junit4]   2> 2648700 T9805 oasc.SolrCores.putTransientCore Opening transient core badSchema2
   [junit4]   2> 2648700 T9805 oasc.CoreContainer.registerCore registering core: badSchema2
   [junit4]   2> 2648701 T9845 oasc.SolrCore.registerSearcher [badSchema2] Registered new searcher Searcher@10731f92[badSchema2] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 2648701 T9805 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2648701 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3e7bdc38 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@294cd809),segFN=segments_3,generation=3}
   [junit4]   2> 2648703 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 2648703 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@2214e552[core1] main
   [junit4]   2> 2648703 T9805 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 2648704 T9837 oasc.SolrCore.registerSearcher [core1] Registered new searcher Searcher@2214e552[core1] main{StandardDirectoryReader(segments_3:7:nrt _1(5.0):c7)}
   [junit4]   2> ASYNC  NEW_CORE C4367 name=core1 org.apache.solr.core.SolrCore@75de95c1
   [junit4]   2> 2648705 T9805 C4367 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!prefix+f%3Dv_t}hel&wt=xml} hits=2 status=0 QTime=1 
   [junit4]   2> 2648705 T9805 C4367 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}hello&wt=xml} hits=2 status=0 QTime=0 
   [junit4]   2> 2648706 T9805 C4367 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}Hello&wt=xml} hits=0 status=0 QTime=1 
   [junit4]   2> 2648706 T9805 C4367 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_f}1.5&wt=xml} hits=0 status=0 QTime=0 
   [junit4]   2> 2648706 T9805 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2648706 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6156d19f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1aa126c),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@6156d19f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1aa126c),segFN=segments_2,generation=2}
   [junit4]   2> 2648706 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 2648706 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@253c908[badConfig1] main
   [junit4]   2> 2648708 T9805 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 2648708 T9839 oasc.SolrCore.registerSearcher [badConfig1] Registered new searcher Searcher@253c908[badConfig1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c7)}
   [junit4]   2> ASYNC  NEW_CORE C4368 name=badConfig1 org.apache.solr.core.SolrCore@79a88845
   [junit4]   2> 2648708 T9805 C4368 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!prefix+f%3Dv_t}hel&wt=xml} hits=2 status=0 QTime=0 
   [junit4]   2> 2648709 T9805 C4368 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}hello&wt=xml} hits=2 status=0 QTime=1 
   [junit4]   2> 2648709 T9805 C4368 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}Hello&wt=xml} hits=0 status=0 QTime=0 
   [junit4]   2> 2648710 T9805 C4368 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_f}1.5&wt=xml} hits=0 status=0 QTime=1 
   [junit4]   2> 2648710 T9805 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2648710 T9805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7a35da3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d3cd9d6),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@7a35da3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d3cd9d6),segFN=segments_2,generation=2}
   [junit4]   2> 2648712 T9805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 2648712 T9805 oass.SolrIndexSearcher.<init> Opening Searcher@6ff3b146[badSchema1] main
   [junit4]   2> 2648712 T9805 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 2648713 T9843 oasc.SolrCore.registerSearcher [badSchema1] Registered new searcher Searcher@6ff3b146[badSchema1] main{StandardDirectoryReader(segments_2:3:nrt _0(5.0):c7)}
   [junit4]   2> ASYNC  NEW_CORE C4369 name=badSchema1 org.apache.solr.core.SolrCore@566c7bfe
   [junit4]   2> 2648713 T9805 C4369 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!prefix+f%3Dv_t}hel&wt=xml} hits=2 status=0 QTime=0 
   [junit4]   2> 2648714 T9805 C4369 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}hello&wt=xml} hits=2 status=0 QTime=1 
   [junit4]   2> 2648714 T9805 C4369 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_t}Hello&wt=xml} hits=0 status=0 QTime=0 
   [junit4]   2> 2648715 T9805 C4369 oasc.SolrCore.execute [collection1] webapp=null path=null params={q={!raw+f%3Dv_f}1.5&wt=xml} hits=0 status=0 QTime=1 
   [junit4]   2> 2648715 T9805 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=66674091
   [junit4]   2> 2648715 T9805 oasc.SolrCore.close [core2]  CLOSING SolrCore org.apache.solr.core.SolrCore@3fac45e9
   [junit4]   2> 2648715 T9805 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2648715 T9805 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2648715 T9805 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2648715 T9805 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2648718 T9805 oasc.SolrCore.closeSearcher [core2] Closing main searcher on request.
   [junit4]   2> 2648718 T9805 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2648718 T9805 oasc.CachingDirectoryFactory.closeCacheValue looking to close C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\index [CachedDir<<refCount=0;path=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\TestLazyCores\core2\data\index;done=false>>]
   [junit4]   2> 264871

[...truncated too long message...]

ldn't be terminated:
   [junit4]   2> 	   1) Thread[id=9805, name=SUITE-TestLazyCores-seed#[1E468F4F611387A5]-worker, state=TIMED_WAITING, group=TGRP-TestLazyCores]
   [junit4]   2> 	        at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 	        at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:399)
   [junit4]   2> 	        at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:174)
   [junit4]   2> 	        at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
   [junit4]   2> 	        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	        at java.lang.reflect.Method.invoke(Method.java:483)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:700)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
   [junit4]   2> 	        at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
   [junit4]   2> 	        at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	        at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
   [junit4]   2> 	        at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> NOTE: test params are: codec=Lucene45, sim=DefaultSimilarity, locale=vi, timezone=Antarctica/McMurdo
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.8.0 (64-bit)/cpus=2,threads=2,free=328515352,total=506900480
   [junit4]   2> NOTE: All tests run in this JVM: [ChangedSchemaMergeTest, TestPostingsSolrHighlighter, DistributedTermsComponentTest, DistributedQueryElevationComponentTest, CurrencyFieldOpenExchangeTest, TestComponentsName, SignatureUpdateProcessorFactoryTest, TestNonDefinedSimilarityFactory, TestStressRecovery, PathHierarchyTokenizerFactoryTest, TestSweetSpotSimilarityFactory, DOMUtilTest, SliceStateUpdateTest, TestSolrXmlPersistor, TestRecovery, HdfsUnloadDistributedZkTest, SortByFunctionTest, TestReloadAndDeleteDocs, TestStressLucene, StatelessScriptUpdateProcessorFactoryTest, TestFieldCollectionResource, TestLFUCache, TestSearchPerf, InfoHandlerTest, ShardSplitTest, TestFuzzyAnalyzedSuggestions, CopyFieldTest, TestFaceting, TermVectorComponentDistributedTest, TestQueryUtils, TestRemoteStreaming, ModifyConfFileTest, TestSchemaNameResource, TestGroupingSearch, TestManagedSchema, UnloadDistributedZkTest, CurrencyFieldXmlFileTest, TestManagedSchemaFieldResource, TestIBSimilarityFactory, TestJmxMonitoredMap, TestIndexingPerformance, TestBinaryResponseWriter, DirectUpdateHandlerOptimizeTest, DocumentBuilderTest, ShowFileRequestHandlerTest, BasicFunctionalityTest, TestRecoveryHdfs, XsltUpdateRequestHandlerTest, EchoParamsTest, ConvertedLegacyTest, TestRTGBase, TestDocBasedVersionConstraints, TestSort, HdfsChaosMonkeySafeLeaderTest, SolrCoreTest, TestFieldResource, UniqFieldsUpdateProcessorFactoryTest, DistributedSuggestComponentTest, TestSolrQueryParserResource, SearchHandlerTest, DistributedSpellCheckComponentTest, TestDFRSimilarityFactory, TestFastOutputStream, TestSchemaResource, UpdateRequestProcessorFactoryTest, DateMathParserTest, SpellCheckComponentTest, FileBasedSpellCheckerTest, TestValueSourceCache, SimplePostToolTest, LukeRequestHandlerTest, SuggestComponentTest, RequiredFieldsTest, TestQueryTypes, TestWriterPerf, TestOverriddenPrefixQueryForCustomFieldType, StressHdfsTest, XmlUpdateRequestHandlerTest, TestFreeTextSuggestions, ScriptEngineTest, TestMaxScoreQueryParser, PrimUtilsTest, SolrCoreCheckLockOnStartupTest, TestSimpleQParserPlugin, HdfsLockFactoryTest, TestNonNRTOpen, MultiTermTest, TermVectorComponentTest, TestExtendedDismaxParser, SOLR749Test, TestAnalyzeInfixSuggestions, CoreContainerCoreInitFailuresTest, TestSolrQueryParser, AnalysisAfterCoreReloadTest, ZkSolrClientTest, TestSolrIndexConfig, TestSolrCoreProperties, ReturnFieldsTest, TestZkChroot, BadComponentTest, TestCloudManagedSchemaAddField, SyncSliceTest, OutputWriterTest, TestFieldTypeResource, PluginInfoTest, CustomCollectionTest, TestCSVLoader, TestCodecSupport, TestQuerySenderNoQuery, PreAnalyzedFieldTest, FileUtilsTest, DirectSolrConnectionTest, HdfsSyncSliceTest, ClusterStateTest, FieldAnalysisRequestHandlerTest, TestSolrDeletionPolicy1, LeaderElectionIntegrationTest, TestDistributedGrouping, TestHighlightDedupGrouping, SolrIndexConfigTest, ChaosMonkeyNothingIsSafeTest, FieldFacetExtrasTest, TermsComponentTest, ChaosMonkeySafeLeaderTest, OverseerCollectionProcessorTest, TestAnalyzedSuggestions, StandardRequestHandlerTest, TestStressUserVersions, BadIndexSchemaTest, DefaultValueUpdateProcessorTest, TestStressVersions, ResponseLogComponentTest, TestPseudoReturnFields, LoggingHandlerTest, DeleteReplicaTest, TestDynamicFieldResource, TestCharFilters, MigrateRouteKeyTest, TestBinaryField, RecoveryZkTest, TestDocumentBuilder, CoreAdminHandlerTest, BasicZkTest, JSONWriterTest, QueryFacetTest, TestQuerySenderListener, TestSolrXMLSerializer, TestCoreDiscovery, NoFacetTest, TestSuggestSpellingConverter, DistanceFunctionTest, TestRangeQuery, BinaryUpdateRequestHandlerTest, OverseerRolesTest, TestIndexSearcher, RAMDirectoryFactoryTest, AlternateDirectoryTest, SliceStateTest, TestOmitPositions, TestFoldingMultitermQuery, TestXIncludeConfig, ConnectionManagerTest, TestModifyConfFiles, DistributedDebugComponentTest, ExpressionTest, SpatialFilterTest, TestCopyFieldCollectionResource, TestPerFieldSimilarity, TestSchemaVersionResource, TestInitQParser, TestCursorMarkWithoutUniqueKey, TestSolr4Spatial, DebugComponentTest, TestReplicationHandler, FullSolrCloudDistribCmdsTest, BasicDistributedZk2Test, TestStressReorder, NumericFieldsTest, HardAutoCommitTest, TestSolrJ, BasicDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedSearch, AutoCommitTest, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestJoin, TestMultiCoreConfBootstrap, TestReload, TestCoreContainer, SimpleFacetsTest, StatsComponentTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, TestFiltering, TestFunctionQuery, TestLazyCores]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestLazyCores -Dtests.seed=1E468F4F611387A5 -Dtests.slow=true -Dtests.locale=vi -Dtests.timezone=Antarctica/McMurdo -Dtests.file.encoding=Cp1252
   [junit4] ERROR   0.00s | TestLazyCores (suite) <<<
   [junit4]    > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1E468F4F611387A5]:0)
   [junit4] Completed in 7257.19s, 8 tests, 2 errors <<< FAILURES!

[...truncated 484 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 1 suite-level error, 1 error, 693 ignored (9 assumptions)

Total time: 192 minutes 50 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0-fcs-b129 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.7.0_51) - Build # 3816 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3816/
Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Could not find collection:addReplicaColl

Stack Trace:
java.lang.AssertionError: Could not find collection:addReplicaColl
	at __randomizedtesting.SeedInfo.seed([B4939A555730F6E9:3575144D206F96D5]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:147)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:724)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:1193)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:213)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10105 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 720665 T1946 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 720665 T1946 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 720670 T1946 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-CollectionsAPIDistributedZkTest-1393324267580
   [junit4]   2> 720674 T1946 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 720675 T1947 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 720787 T1946 oasc.ZkTestServer.run start zk server on port:60829
   [junit4]   2> 720788 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 720798 T1953 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@117f957 name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 720798 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 720798 T1946 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 720805 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144689918480000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 720809 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 720813 T1955 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b0d7c1 name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 720814 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 720814 T1946 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 720821 T1946 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 720825 T1946 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 720829 T1946 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 720836 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 720836 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 720847 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 720847 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 720854 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 720854 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 720862 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 720862 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 720869 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 720870 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 720875 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 720875 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 720882 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 720882 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 720887 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 720888 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 720893 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 720894 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 720899 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 720899 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 720905 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 720906 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 720912 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144689918480001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 720914 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 720918 T1957 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f7356 name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 720919 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 720926 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 720931 T1959 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e860c name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 720931 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 720931 T1946 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 720936 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144689918480003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 720938 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 720942 T1961 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75beea name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 720943 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 720945 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 720945 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 720953 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 720954 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 720960 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 720961 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 720967 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 720967 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 720972 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 720973 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 720979 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 720980 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 720985 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 720985 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 720991 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 720992 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 720997 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 720997 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 721003 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 721003 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 721008 T1946 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 721008 T1946 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 721018 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144689918480004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 723128 T1946 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 723139 T1946 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 723145 T1946 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60845
   [junit4]   2> 723149 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 723150 T1946 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 723150 T1946 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393324267926
   [junit4]   2> 723150 T1946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393324267926\'
   [junit4]   2> 723198 T1946 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393324267926\solr.xml
   [junit4]   2> 723332 T1946 oasc.CoreContainer.<init> New CoreContainer 11976585
   [junit4]   2> 723332 T1946 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393324267926\]
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 723335 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 723337 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 723337 T1946 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 723337 T1946 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 723348 T1946 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 723348 T1946 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 723348 T1946 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 723348 T1946 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60829/solr
   [junit4]   2> 723348 T1946 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 723353 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 723375 T1972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@808aea name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 723376 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 723388 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x144689918480005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 723390 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 723393 T1974 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6ad9bd name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 723394 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 723397 T1946 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 723405 T1946 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 723415 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 723419 T1946 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60845_
   [junit4]   2> 723421 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60845_
   [junit4]   2> 723429 T1946 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 723433 T1946 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 723445 T1946 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60845_
   [junit4]   2> 723445 T1946 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 723453 T1946 oasc.Overseer.start Overseer (id=91312899200909318-127.0.0.1:60845_-n_0000000000) starting
   [junit4]   2> 723460 T1946 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 723469 T1976 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 723472 T1946 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 723472 T1976 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 723476 T1946 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 723480 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 723485 T1975 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 723490 T1946 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 723490 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 723500 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 723503 T1979 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e38280 name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 723504 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 723506 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 723512 T1946 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 725606 T1946 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 725607 T1946 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 725622 T1946 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 725625 T1946 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60857
   [junit4]   2> 725634 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 725635 T1946 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 725636 T1946 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421
   [junit4]   2> 725636 T1946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\'
   [junit4]   2> 725696 T1946 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solr.xml
   [junit4]   2> 725838 T1946 oasc.CoreContainer.<init> New CoreContainer 5137675
   [junit4]   2> 725838 T1946 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\]
   [junit4]   2> 725841 T1946 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 725842 T1946 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 725855 T1946 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 725855 T1946 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 725855 T1946 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 725855 T1946 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60829/solr
   [junit4]   2> 725855 T1946 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 725860 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 725878 T1990 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e19587 name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 725879 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 725897 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 725902 T1992 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14fe360 name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 725902 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 725915 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 727134 T1946 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60857_
   [junit4]   2> 727138 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60857_
   [junit4]   2> 727147 T1979 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 727149 T1992 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 727149 T1974 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 727164 T1946 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 727164 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 730023 T1946 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 730023 T1946 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 730037 T1946 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 730041 T1946 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60866
   [junit4]   2> 730047 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 730047 T1946 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 730047 T1946 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077
   [junit4]   2> 730047 T1946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\'
   [junit4]   2> 730084 T1946 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solr.xml
   [junit4]   2> 730219 T1946 oasc.CoreContainer.<init> New CoreContainer 29561322
   [junit4]   2> 730220 T1946 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\]
   [junit4]   2> 730223 T1946 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 730224 T1946 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 730224 T1946 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 730224 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 730225 T1946 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 730225 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 730226 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 730226 T1946 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 730226 T1946 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 730241 T1946 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 730241 T1946 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 730241 T1946 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 730241 T1946 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60829/solr
   [junit4]   2> 730241 T1946 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 730246 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 730303 T2004 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c1522b name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 730304 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 730310 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14468991848000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 730312 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 730318 T2006 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@160b5b6 name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 730318 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 730344 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 731579 T1946 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60866_
   [junit4]   2> 731582 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60866_
   [junit4]   2> 731592 T1974 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 731592 T1979 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 731593 T1992 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 731594 T2006 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 731616 T1946 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 731616 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 734165 T1946 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 734166 T1946 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 734180 T1946 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 734184 T1946 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60875
   [junit4]   2> 734190 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 734191 T1946 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 734191 T1946 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532
   [junit4]   2> 734193 T1946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\'
   [junit4]   2> 734238 T1946 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solr.xml
   [junit4]   2> 734381 T1946 oasc.CoreContainer.<init> New CoreContainer 28909949
   [junit4]   2> 734382 T1946 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\]
   [junit4]   2> 734386 T1946 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 734386 T1946 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 734387 T1946 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 734387 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 734387 T1946 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 734388 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 734388 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 734389 T1946 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 734389 T1946 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 734406 T1946 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 734406 T1946 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 734407 T1946 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 734407 T1946 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60829/solr
   [junit4]   2> 734407 T1946 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 734412 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 734446 T2018 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@33c6b5 name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 734447 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 734454 T1948 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14468991848000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 734458 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 734462 T2020 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1cfe09d name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 734464 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 734479 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 735714 T1946 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60875_
   [junit4]   2> 735717 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60875_
   [junit4]   2> 735725 T2020 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 735726 T1979 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 735726 T1992 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 735726 T2006 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 735726 T1974 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 735748 T1946 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 735749 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 738088 T1946 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 738088 T1946 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 738099 T1946 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 738103 T1946 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:60884
   [junit4]   2> 738106 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 738106 T1946 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 738106 T1946 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662
   [junit4]   2> 738106 T1946 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\'
   [junit4]   2> 738147 T1946 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solr.xml
   [junit4]   2> 738268 T1946 oasc.CoreContainer.<init> New CoreContainer 3054933
   [junit4]   2> 738268 T1946 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\]
   [junit4]   2> 738272 T1946 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 738273 T1946 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 738287 T1946 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 738287 T1946 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 738287 T1946 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 738287 T1946 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:60829/solr
   [junit4]   2> 738287 T1946 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 738292 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 738317 T2032 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@af7976 name:ZooKeeperConnection Watcher:127.0.0.1:60829 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 738318 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 738327 T1946 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 738332 T2034 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@134983b name:ZooKeeperConnection Watcher:127.0.0.1:60829/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 738333 T1946 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 738344 T1946 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 739455 T1946 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60884_
   [junit4]   2> 739458 T1946 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60884_
   [junit4]   2> 739466 T1992 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739467 T1974 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739467 T2034 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739468 T2006 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739468 T2020 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739468 T1979 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 739479 T1946 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 739479 T1946 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 739587 T1983 oasha.CollectionsHandler.handleCreateAction Creating Collection : collection.configName=conf1&name=solrj_collection&wt=javabin&replicationFactor=2&router.name=compositeId&numShards=2&router.field=myOwnField&version=2&action=CREATE
   [junit4]   2> 739590 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739593 T1976 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.name":"compositeId",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 739593 T1976 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.name":"compositeId",
   [junit4]   2> 	  "router.field":"myOwnField"}
   [junit4]   2> 739598 T1976 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 739598 T1976 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 739606 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739609 T1975 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 739610 T1975 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 739610 T1975 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 739617 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739619 T2034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739619 T2020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739620 T1974 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739620 T1992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739619 T1979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739620 T2006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 739717 T1976 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
   [junit4]   2> 739717 T1976 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:60857_
   [junit4]   2> 739723 T1976 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:60866_
   [junit4]   2> 739734 T1976 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:60875_
   [junit4]   2> 739806 T1976 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:60884_
   [junit4]   2> 739831 T2001 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
   [junit4]   2> 739833 T1986 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
   [junit4]   2> 739835 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739835 T2001 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 739836 T1986 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 739910 T1975 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 739912 T2013 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
   [junit4]   2> 739913 T1975 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60866",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60866_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 739915 T2013 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 739915 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739917 T2025 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
   [junit4]   2> 739919 T2025 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 739923 T1975 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60857",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60857_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 739928 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739932 T1975 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60875",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60875_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 739937 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 739939 T1975 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"https://127.0.0.1:60884",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:60884_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 739944 T1974 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 740060 T1979 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740060 T1974 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740062 T2020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740062 T1992 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740062 T2034 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740063 T2006 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 740940 T2001 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 740941 T1986 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 740941 T2001 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solr.xml
   [junit4]   2> 740941 T2001 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2
   [junit4]   2> 740942 T2001 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 740944 T1986 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solr.xml
   [junit4]   2> 740944 T1986 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1
   [junit4]   2> 740945 T1986 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 740946 T2001 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 740946 T2001 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 740947 T1986 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 740947 T1986 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 740949 T2001 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 740950 T2001 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\'
   [junit4]   2> 740951 T1986 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 740951 T1986 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\'
   [junit4]   2> 741040 T2001 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 741051 T1986 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 741104 T2025 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 741105 T2025 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solr.xml
   [junit4]   2> 741105 T2025 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2
   [junit4]   2> 741105 T2025 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 741158 T2001 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 741160 T2013 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 741161 T2013 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solr.xml
   [junit4]   2> 741161 T2013 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solrj_collection_shard2_replica1
   [junit4]   2> 741162 T2013 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 741165 T2025 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 741165 T2025 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 741167 T2013 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 741167 T2013 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 741170 T1986 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 741171 T2001 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 741173 T2013 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 741173 T2013 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solrj_collection_shard2_replica1\'
   [junit4]   2> 741181 T1986 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 741187 T2001 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 741181 T2025 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 741194 T2025 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\'
   [junit4]   2> 741202 T1986 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 741311 T2013 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 741422 T2013 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 741426 T2013 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 741441 T2013 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 741530 T2025 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 741846 T2025 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 741894 T2025 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 741913 T2025 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 742392 T1986 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 742406 T1986 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 742412 T1986 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 743091 T2001 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 743100 T2001 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 743106 T2001 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 743286 T2025 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 743296 T2025 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 743301 T2025 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 743331 T1986 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743340 T1986 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743347 T1986 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743352 T1986 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743353 T1986 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743353 T1986 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743352 T2001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743357 T2025 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743367 T2001 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743368 T1986 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743368 T1986 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743369 T1986 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 743369 T1986 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\data\
   [junit4]   2> 743369 T1986 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e5c0c1
   [junit4]   2> 743373 T1986 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\data\
   [junit4]   2> 743373 T1986 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\data\index/
   [junit4]   2> 743373 T1986 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 743374 T1986 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393324270421\solrj_collection_shard1_replica1\data\index
   [junit4]   2> 743374 T1986 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330764527, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 743375 T1986 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@12e83dc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67907e),segFN=segments_1,generation=1}
   [junit4]   2> 743375 T1986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 743380 T1986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 743381 T1986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 743381 T1986 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 743381 T1986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743382 T1986 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743382 T1986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 743383 T1986 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743383 T1986 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743384 T1986 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 743384 T1986 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 743385 T1986 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 743386 T1986 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 743386 T1986 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 743387 T1986 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 743387 T1986 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 743388 T1986 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 743388 T1986 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 743402 T1986 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 743411 T2013 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 743411 T1986 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 743411 T1986 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 743416 T2001 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743418 T1986 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=22.6435546875, floorSegmentMB=1.6865234375, forceMergeDeletesPctAllowed=24.394509658037855, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 743419 T1986 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@12e83dc lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@67907e),segFN=segments_1,generation=1}
   [junit4]   2> 743419 T1986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 743419 T1986 oass.SolrIndexSearcher.<init> Opening Searcher@1e50565[solrj_collection_shard1_replica1] main
   [junit4]   2> 743422 T2025 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743422 T2013 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 743425 T2001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743425 T2001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743426 T2001 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743426 T2013 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 743432 T2025 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743435 T2001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743436 T2001 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743436 T2001 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 743438 T2001 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\data\
   [junit4]   2> 743438 T2001 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e5c0c1
   [junit4]   2> 743439 T2001 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\data\
   [junit4]   2> 743439 T2001 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\data\index/
   [junit4]   2> 743439 T2040 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@1e50565[solrj_collection_shard1_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 743441 T2025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743442 T2025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743443 T2025 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743445 T2001 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 743448 T1986 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
   [junit4]   2> 743450 T2025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743451 T2025 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743451 T2025 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 743452 T2025 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\data\
   [junit4]   2> 743452 T2025 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e5c0c1
   [junit4]   2> 743450 T1986 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:https://127.0.0.1:60857 collection:solrj_collection shard:shard1
   [junit4]   2> 743453 T2025 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\data\
   [junit4]   2> 743455 T2025 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\data\index/
   [junit4]   2> 743456 T2025 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 743456 T2025 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393324282662\solrj_collection_shard2_replica2\data\index
   [junit4]   2> 743451 T2001 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393324274077\solrj_collection_shard1_replica2\data\index
   [junit4]   2> 743459 T2025 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330764527, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 743457 T1986 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 743460 T2001 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=330764527, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 743461 T2025 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3f8719 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13e930e),segFN=segments_1,generation=1}
   [junit4]   2> 743462 T2025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 743464 T2001 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2314ea lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@ee5c3e),segFN=segments_1,generation=1}
   [junit4]   2> 743464 T2001 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 743467 T2025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 743468 T2025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 743468 T2025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 743469 T2001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 743469 T2025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743470 T2025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743472 T2013 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743472 T2025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 743473 T2001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 743473 T2025 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743474 T2025 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743475 T2025 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 743476 T2025 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 743478 T2025 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 743478 T2025 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 743478 T2025 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 743479 T2025 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 743479 T2025 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 743480 T2025 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 743480 T2013 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 743474 T2001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 743480 T2025 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 743483 T2001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743483 T2001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 743484 T2001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 743484 T2001 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743486 T2001 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 743487 T2001 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 743487 T2001 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 743488 T2001 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 743488 T2001 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 743488 T2001 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 743490 T2001 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 743490 T2001 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 743491 T2001 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 743491 T2001 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 743486 T2025 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 743492 T2013 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743495 T2001 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 743502 T2025 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 743502 T2025 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 743505 T2025 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=22.6435546875, floorSegmentMB=1.6865234375, forceMergeDeletesPctAllowed=24.394509658037855, segmentsPerTier=37.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 743505 T2001 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 743506 T2013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743507 T2013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743507 T2013 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 743505 T2025 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3f8719 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@13e930e),segFN=segments_1,generation=1}
   [junit4]   2> 743510 T2025 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 743510 T2013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 743511 T2013 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 743511 T1986 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 743507 T2001 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 743511 T2013 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 743514 T2013 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solrj_collection_shard2_replica1\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solrj_collection_shard2_replica1\data\
   [junit4]   2> 743514 T2013 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e5c0c1
   [junit4]   2> 743510 T2025 oass.SolrIndexSearcher.<init> Opening Searcher@1810d14[solrj_collection_shard2_replica2] main
   [junit4]   2> 743515 T2013 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\solrj_collection_shard2_replica1\data\
   [junit4]   2> 7435

[...truncated too long message...]

losing directory: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\nodes_used_collection_shard2_replica2\data\index
   [junit4]   2> 951198 T2020 oasc.CachingDirectoryFactory.closeCacheValue looking to close .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\nodes_used_collection_shard2_replica2\data\ [CachedDir<<refCount=0;path=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\nodes_used_collection_shard2_replica2\data\;done=false>>]
   [junit4]   2> 951198 T2020 oasc.CachingDirectoryFactory.close Closing directory: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393324278532\nodes_used_collection_shard2_replica2\data\
   [junit4]   2> 951198 T2020 oascc.SolrZkClient.makePath makePath: /collections/nodes_used_collection/leaders/shard2
   [junit4]   2> 951199 T2020 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 		at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 		at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:206)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:203)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:414)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:383)
   [junit4]   2> 		at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:370)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
   [junit4]   2> 		at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 		at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 		at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 	
   [junit4]   2> 951199 T2020 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/nodes_used_collection/leader_elect/shard2/election/91312899200909325-core_node4-n_0000000001
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:171)
   [junit4]   2> 	at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 951199 T2020 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 951199 T2020 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 951199 T2020 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 951199 T2020 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 951201 T2020 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 951201 T2020 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 951201 T2020 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> NOTE: test params are: codec=Lucene46: {timestamp=PostingsFormat(name=Memory doPackFST= true), range_facet_si=PostingsFormat(name=Memory doPackFST= true), other_tl1=PostingsFormat(name=Direct), a_t=PostingsFormat(name=Memory doPackFST= true), text=PostingsFormat(name=Lucene41VarGapFixedInterval), range_facet_l=PostingsFormat(name=Memory doPackFST= true), intDefault=PostingsFormat(name=Direct), a_si=PostingsFormat(name=Direct), multiDefault=PostingsFormat(name=Memory doPackFST= true), id=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), range_facet_sl=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), _version_=PostingsFormat(name=Direct)}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=ar_IQ, timezone=Africa/Monrovia
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.7.0_51 (32-bit)/cpus=2,threads=1,free=105210840,total=306446336
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedSpellCheckComponentTest, SolrInfoMBeanTest, PolyFieldTest, TestModifyConfFiles, ZkSolrClientTest, PluginInfoTest, TestCoreContainer, AddSchemaFieldsUpdateProcessorFactoryTest, TestTrie, ShardSplitTest, StatelessScriptUpdateProcessorFactoryTest, QueryEqualityTest, TestGroupingSearch, TestLuceneMatchVersion, TestMaxScoreQueryParser, LegacyHTMLStripCharFilterTest, TestSolrQueryParserDefaultOperatorResource, AutoCommitTest, HardAutoCommitTest, SuggesterFSTTest, MoreLikeThisHandlerTest, FullSolrCloudDistribCmdsTest, ScriptEngineTest, CoreMergeIndexesAdminHandlerTest, DistributedSuggestComponentTest, TestAddFieldRealTimeGet, DocValuesMultiTest, TestHighlightDedupGrouping, TestMergePolicyConfig, TestStandardQParsers, MBeansHandlerTest, SolrRequestParserTest, SolrPluginUtilsTest, SortByFunctionTest, TestStressReorder, TestManagedSchemaFieldResource, OpenCloseCoreStressTest, TestQuerySenderListener, TestNonDefinedSimilarityFactory, TestFileDictionaryLookup, TestDistribDocBasedVersion, SearchHandlerTest, SolrTestCaseJ4Test, SolrCmdDistributorTest, ExternalFileFieldSortTest, SolrIndexSplitterTest, FunctionTest, BadCopyFieldTest, ClusterStateTest, TestCopyFieldCollectionResource, StatsComponentTest, ParsingFieldUpdateProcessorsTest, DefaultValueUpdateProcessorTest, TestBinaryField, HdfsChaosMonkeySafeLeaderTest, AbstractAnalyticsStatsTest, TestSchemaResource, TestInitQParser, TestRealTimeGet, SoftAutoCommitTest, XsltUpdateRequestHandlerTest, TestSuggestSpellingConverter, DateMathParserTest, TestReload, TestCoreDiscovery, TestWriterPerf, TestIndexingPerformance, TestDefaultSimilarityFactory, PingRequestHandlerTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 230.59s, 1 test, 1 failure <<< FAILURES!

[...truncated 936 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 1 failure, 40 ignored (12 assumptions)

Total time: 96 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_51 -client -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure



[JENKINS] Lucene-Solr-trunk-Windows (32bit/jdk1.8.0-fcs-b129) - Build # 3815 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3815/
Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Could not find collection:addReplicaColl

Stack Trace:
java.lang.AssertionError: Could not find collection:addReplicaColl
	at __randomizedtesting.SeedInfo.seed([E9A042B0A982CA7F:6846CCA8DEDDAA43]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:147)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:131)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:126)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:724)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:1193)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:213)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 10329 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 923028 T2914 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 923029 T2914 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 923034 T2914 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-CollectionsAPIDistributedZkTest-1393293809528
   [junit4]   2> 923037 T2914 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 923039 T2915 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 923136 T2914 oasc.ZkTestServer.run start zk server on port:55937
   [junit4]   2> 923140 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 923152 T2921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bbec7 name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 923153 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 923153 T2914 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 923164 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 923171 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 923176 T2923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e54ab9 name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 923176 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 923177 T2914 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 923188 T2914 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 923214 T2914 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 923220 T2914 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 923225 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 923225 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 923234 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 923234 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 923242 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 923242 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 923246 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 923246 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 923252 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 923252 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 923259 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 923259 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 923266 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 923266 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 923273 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 923273 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 923281 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 923281 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 923289 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 923289 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 923298 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 923298 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using old style solr.xml
   [junit4]   2> 923311 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 923314 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 923321 T2925 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10f29fa name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 923321 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 923322 T2914 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 923332 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 923334 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 923339 T2927 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@151c22f name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 923341 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 923345 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 923346 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 923359 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 923359 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 923372 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 923373 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 923382 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 923382 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 923392 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 923392 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 923401 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 923402 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 923413 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 923415 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 923428 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 923430 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 923440 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 923440 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 923450 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 923450 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 923461 T2914 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 923461 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 923473 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 925531 T2914 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 925596 T2914 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 925598 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 925598 T2914 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 925598 T2914 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393293809965
   [junit4]   2> 925598 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393293809965\'
   [junit4]   2> 925647 T2914 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393293809965\solr.xml
   [junit4]   2> 925660 T2914 oasc.CoreContainer.<init> New CoreContainer 22775991
   [junit4]   2> 925662 T2914 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1393293809965\]
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 925663 T2914 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 925669 T2914 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 925669 T2914 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 925669 T2914 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 925669 T2914 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55937/solr
   [junit4]   2> 925671 T2914 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 925673 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 925691 T2938 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f8c372 name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 925693 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 925701 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 925704 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 925710 T2940 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d3445e name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 925712 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 925717 T2914 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 925730 T2914 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 925746 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 925753 T2914 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55950_
   [junit4]   2> 925758 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55950_
   [junit4]   2> 925769 T2914 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 925778 T2914 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 925793 T2914 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:55950_
   [junit4]   2> 925794 T2914 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 925805 T2914 oasc.Overseer.start Overseer (id=91310903102013445-127.0.0.1:55950_-n_0000000000) starting
   [junit4]   2> 925820 T2914 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 925838 T2942 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 925840 T2914 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 925841 T2942 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 925851 T2914 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 925860 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 925869 T2941 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 925878 T2914 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 925878 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 925883 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 925890 T2945 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d775f6 name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 925891 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 925895 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 925904 T2914 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 927978 T2914 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 927979 T2914 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 927985 T2914 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 927987 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 927988 T2914 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 927988 T2914 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396
   [junit4]   2> 927988 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\'
   [junit4]   2> 928026 T2914 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solr.xml
   [junit4]   2> 928038 T2914 oasc.CoreContainer.<init> New CoreContainer 19015229
   [junit4]   2> 928038 T2914 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\]
   [junit4]   2> 928040 T2914 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 928040 T2914 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 928040 T2914 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 928040 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 928040 T2914 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 928041 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 928042 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 928042 T2914 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 928042 T2914 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 928046 T2914 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 928046 T2914 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 928046 T2914 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 928046 T2914 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55937/solr
   [junit4]   2> 928046 T2914 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 928051 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 928066 T2956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1141ac5 name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 928067 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 928073 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 928076 T2958 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1427470 name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 928077 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 928084 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 929169 T2914 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55962_
   [junit4]   2> 929173 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55962_
   [junit4]   2> 929184 T2945 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 929185 T2958 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 929185 T2940 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 929201 T2914 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 929202 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 931485 T2914 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 931486 T2914 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 931491 T2914 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 931494 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 931494 T2914 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 931495 T2914 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695
   [junit4]   2> 931497 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\'
   [junit4]   2> 931540 T2914 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solr.xml
   [junit4]   2> 931554 T2914 oasc.CoreContainer.<init> New CoreContainer 30129087
   [junit4]   2> 931554 T2914 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\]
   [junit4]   2> 931555 T2914 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 931555 T2914 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 931556 T2914 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 931556 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 931557 T2914 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 931557 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 931557 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 931558 T2914 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 931558 T2914 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 931563 T2914 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 931564 T2914 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 931564 T2914 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 931565 T2914 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55937/solr
   [junit4]   2> 931565 T2914 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 931567 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 931583 T2970 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f2c0f name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 931584 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 931588 T2916 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14466c857840009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 931590 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 931593 T2972 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31fa14 name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 931594 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 931606 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 932693 T2914 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55971_
   [junit4]   2> 932699 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55971_
   [junit4]   2> 932709 T2972 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 932709 T2945 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 932711 T2958 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 932712 T2940 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 932731 T2914 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 932732 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 934662 T2914 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 934665 T2914 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 934675 T2914 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 934676 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 934676 T2914 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 934677 T2914 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224
   [junit4]   2> 934677 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\'
   [junit4]   2> 934714 T2914 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solr.xml
   [junit4]   2> 934728 T2914 oasc.CoreContainer.<init> New CoreContainer 3961966
   [junit4]   2> 934728 T2914 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\]
   [junit4]   2> 934730 T2914 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 934730 T2914 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 934731 T2914 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 934731 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 934732 T2914 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 934733 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 934733 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 934734 T2914 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 934734 T2914 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 934739 T2914 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 934739 T2914 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 934739 T2914 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 934740 T2914 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55937/solr
   [junit4]   2> 934740 T2914 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 934743 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934766 T2984 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1929b53 name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934768 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934775 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 934780 T2986 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3dfc7c name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 934780 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 934788 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 935871 T2914 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55980_
   [junit4]   2> 935875 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55980_
   [junit4]   2> 935884 T2972 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 935887 T2940 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 935888 T2945 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 935888 T2958 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 935888 T2986 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 935902 T2914 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 935903 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 938540 T2914 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 938541 T2914 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 938549 T2914 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
   [junit4]   2> 938550 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 938550 T2914 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 938550 T2914 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396
   [junit4]   2> 938550 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\'
   [junit4]   2> 938600 T2914 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solr.xml
   [junit4]   2> 938617 T2914 oasc.CoreContainer.<init> New CoreContainer 12813450
   [junit4]   2> 938618 T2914 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\]
   [junit4]   2> 938619 T2914 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
   [junit4]   2> 938619 T2914 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 938619 T2914 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 938621 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 938622 T2914 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 938623 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 938624 T2914 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 938624 T2914 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 938625 T2914 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 938631 T2914 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 938635 T2914 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 938635 T2914 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 938635 T2914 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:55937/solr
   [junit4]   2> 938635 T2914 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 938640 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 938645 T2998 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@da3420 name:ZooKeeperConnection Watcher:127.0.0.1:55937 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 938646 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 938651 T2914 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 938654 T3000 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e00e36 name:ZooKeeperConnection Watcher:127.0.0.1:55937/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 938655 T2914 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 938663 T2914 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 939856 T2914 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55989_
   [junit4]   2> 939862 T2914 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55989_
   [junit4]   2> 939875 T2972 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939876 T3000 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939878 T2940 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939879 T2986 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939879 T2958 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939881 T2945 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 939900 T2914 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 939901 T2914 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 939985 T2952 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&collection.configName=conf1&router.field=myOwnField&name=solrj_collection&router.name=compositeId&action=CREATE&numShards=2&wt=javabin&version=2
   [junit4]   2> 939987 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 939989 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 939989 T2942 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 939991 T2942 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 939996 T2942 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 939996 T2942 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 940007 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940009 T2941 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 940010 T2941 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 940010 T2941 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 940015 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940017 T2972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940017 T2945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940017 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940017 T2958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940017 T2986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940017 T2940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940126 T2942 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
   [junit4]   2> 940126 T2942 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:55962_
   [junit4]   2> 940133 T2942 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:55980_
   [junit4]   2> 940144 T2942 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:55971_
   [junit4]   2> 940153 T2953 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
   [junit4]   2> 940155 T2942 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:55989_
   [junit4]   2> 940157 T2982 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
   [junit4]   2> 940161 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940162 T2953 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 940172 T2982 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 940174 T2964 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
   [junit4]   2> 940175 T2941 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 940177 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940177 T2964 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 940178 T2994 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
   [junit4]   2> 940177 T2941 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55962",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55962_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 940181 T2994 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 940188 T2941 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55980",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55980_",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 940192 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940193 T2941 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55971",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55971_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 940198 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940200 T2941 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:55989",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:55989_",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 940204 T2940 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 940328 T2972 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940329 T2986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940329 T2940 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940332 T2958 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940332 T3000 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 940333 T2945 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 941348 T2953 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 941354 T2953 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solr.xml
   [junit4]   2> 941355 T2953 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1
   [junit4]   2> 941355 T2953 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 941358 T2982 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 941358 T2953 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 941360 T2953 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 941365 T2964 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 941369 T2953 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 941370 T2953 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\'
   [junit4]   2> 941362 T2982 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solr.xml
   [junit4]   2> 941370 T2982 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2
   [junit4]   2> 941370 T2982 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 941369 T2994 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 941378 T2994 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solr.xml
   [junit4]   2> 941378 T2994 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2
   [junit4]   2> 941378 T2994 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 941380 T2964 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solr.xml
   [junit4]   2> 941380 T2964 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1
   [junit4]   2> 941380 T2964 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 941384 T2982 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 941384 T2982 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 941384 T2994 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 941385 T2994 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 941385 T2964 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 941385 T2964 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 941390 T2982 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 941390 T2982 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\'
   [junit4]   2> 941392 T2964 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 941392 T2964 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\'
   [junit4]   2> 941393 T2994 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 941393 T2994 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\'
   [junit4]   2> 941434 T2953 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 941448 T2953 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 941454 T2953 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 941463 T2953 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 941468 T2964 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 941481 T2964 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 941488 T2982 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 941532 T2982 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 941543 T2964 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 941552 T2964 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 941653 T2953 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 941661 T2953 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 941662 T2953 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 941668 T2994 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 941703 T2994 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 941708 T2982 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 941717 T2982 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 941721 T2964 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 941728 T2964 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 941730 T2964 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 941739 T2994 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 941750 T2994 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 941886 T2982 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 941892 T2982 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 941896 T2982 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 941920 T2994 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 941928 T2994 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 941932 T2953 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941932 T2994 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 941933 T2964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941937 T2953 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941937 T2964 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941943 T2953 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941947 T2964 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941948 T2953 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941950 T2953 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941950 T2953 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941952 T2982 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941954 T2953 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941954 T2953 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941955 T2953 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 941955 T2953 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\data\
   [junit4]   2> 941955 T2953 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@183f5ee
   [junit4]   2> 941954 T2964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941956 T2964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941956 T2964 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941957 T2953 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\data\
   [junit4]   2> 941958 T2953 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\data\index/
   [junit4]   2> 941958 T2953 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 941959 T2953 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1393293812396\solrj_collection_shard1_replica1\data\index
   [junit4]   2> 941959 T2953 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=76.8525390625, floorSegmentMB=1.8310546875, forceMergeDeletesPctAllowed=1.6050337962905126, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 941959 T2982 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941962 T2953 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@173ac1d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10f693e),segFN=segments_1,generation=1}
   [junit4]   2> 941964 T2953 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 941962 T2964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941964 T2964 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941964 T2964 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 941965 T2964 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\data\
   [junit4]   2> 941965 T2964 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@183f5ee
   [junit4]   2> 941970 T2953 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 941970 T2953 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 941971 T2982 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941971 T2953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 941971 T2964 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\data\
   [junit4]   2> 941972 T2964 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\data\index/
   [junit4]   2> 941973 T2964 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 941972 T2953 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 941973 T2964 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1393293815695\solrj_collection_shard2_replica1\data\index
   [junit4]   2> 941974 T2982 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941974 T2953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 941976 T2964 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=76.8525390625, floorSegmentMB=1.8310546875, forceMergeDeletesPctAllowed=1.6050337962905126, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 941976 T2982 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941976 T2953 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 941977 T2982 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 941978 T2953 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 941979 T2964 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@397d75 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@912ded),segFN=segments_1,generation=1}
   [junit4]   2> 941979 T2953 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 941980 T2953 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 941981 T2982 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 941981 T2982 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 941981 T2982 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 941983 T2982 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\data\
   [junit4]   2> 941983 T2982 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@183f5ee
   [junit4]   2> 941981 T2953 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 941981 T2964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 941985 T2953 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 941986 T2953 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 941986 T2953 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 941987 T2953 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 941988 T2953 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 941990 T2953 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 941990 T2953 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 941991 T2994 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 941990 T2964 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 941992 T2964 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 941993 T2964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 941993 T2964 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 941994 T2964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 941994 T2964 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 941995 T2964 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 941995 T2964 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 941995 T2964 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 941996 T2964 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 941998 T2953 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 941998 T2982 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\data\
   [junit4]   2> 941998 T2964 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 942000 T2964 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 942000 T2964 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 942001 T2964 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 942002 T2964 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 942003 T2953 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 942005 T2953 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 942005 T2953 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5360772787042991]
   [junit4]   2> 942006 T2953 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@173ac1d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10f693e),segFN=segments_1,generation=1}
   [junit4]   2> 942006 T2953 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942007 T2953 oass.SolrIndexSearcher.<init> Opening Searcher@e3e821[solrj_collection_shard1_replica1] main
   [junit4]   2> 942003 T2964 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 942015 T2953 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
   [junit4]   2> 942015 T2953 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:55962 collection:solrj_collection shard:shard1
   [junit4]   2> 942016 T3006 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@e3e821[solrj_collection_shard1_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 942008 T2994 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 942008 T2982 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\data\index/
   [junit4]   2> 942018 T2982 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 942015 T2964 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 942020 T2982 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1393293819224\solrj_collection_shard1_replica2\data\index
   [junit4]   2> 942021 T2982 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=76.8525390625, floorSegmentMB=1.8310546875, forceMergeDeletesPctAllowed=1.6050337962905126, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 942021 T2964 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942022 T2953 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
   [junit4]   2> 942021 T2982 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d20fe9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@319aaf),segFN=segments_1,generation=1}
   [junit4]   2> 942023 T2982 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942025 T2994 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 942029 T2982 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 942029 T2982 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 942030 T2982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 942030 T2982 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 942031 T2982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 942031 T2982 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 942031 T2964 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 942032 T2964 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 942032 T2982 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 942035 T2982 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 942035 T2982 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 942037 T2982 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 942034 T2994 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 942037 T2994 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 942038 T2994 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 942036 T2964 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5360772787042991]
   [junit4]   2> 942037 T2982 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 942040 T2982 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 942042 T2982 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 942042 T2964 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@397d75 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@912ded),segFN=segments_1,generation=1}
   [junit4]   2> 942043 T2964 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942043 T2964 oass.SolrIndexSearcher.<init> Opening Searcher@18c2420[solrj_collection_shard2_replica1] main
   [junit4]   2> 942043 T2982 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 942045 T2982 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 942046 T2982 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 942046 T2982 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 942049 T2982 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 942044 T2994 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 942050 T2994 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 942051 T2994 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 942051 T3008 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@18c2420[solrj_collection_shard2_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 942050 T2964 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
   [junit4]   2> 942053 T2964 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:55971 collection:solrj_collection shard:shard2
   [junit4]   2> 942051 T2994 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\data\
   [junit4]   2> 942054 T2994 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@183f5ee
   [junit4]   2> 942057 T2994 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\data\
   [junit4]   2> 942057 T2994 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\data\index/
   [junit4]   2> 942057 T2982 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 942058 T2982 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 942058 T2994 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 942059 T2964 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
   [junit4]   2> 942059 T2994 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1393293822396\solrj_collection_shard2_replica2\data\index
   [junit4]   2> 942061 T2994 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=22, maxMergeAtOnceExplicit=50, maxMergedSegmentMB=76.8525390625, floorSegmentMB=1.8310546875, forceMergeDeletesPctAllowed=1.6050337962905126, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 942062 T2982 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=16, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5360772787042991]
   [junit4]   2> 942064 T2994 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@10d59f7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1dcf364),segFN=segments_1,generation=1}
   [junit4]   2> 942065 T2994 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942065 T2953 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 942065 T2982 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@d20fe9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@319aaf),segFN=segments_1,generation=1}
   [junit4]   2> 942066 T2982 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 942066 T2982 oass.SolrIndexSearcher.<init> Opening Searcher@1ce710c[solrj_collection_shard1_replica2] main
   [junit4]   2> 942072 T2994 oasu

[...truncated too long message...]

 [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1026002 T2986 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
   [junit4]   2> 1026003 T2986 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1026003 T2986 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1026003 T2986 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 1026000 T3000 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_0/leader_elect/shard2/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:254)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> NOTE: test params are: codec=Lucene46: {other_tl1=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), _version_=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), multiDefault=PostingsFormat(name=Memory doPackFST= true), a_t=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), a_si=PostingsFormat(name=Memory doPackFST= true), intDefault=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), range_facet_sl=PostingsFormat(name=MockRandom), range_facet_si=PostingsFormat(name=Memory doPackFST= true), id=FST41, text=PostingsFormat(name=MockRandom), range_facet_l=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), timestamp=TestBloomFilteredLucene41Postings(BloomFilteringPostingsFormat(Lucene41(blocksize=128)))}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=DefaultSimilarity, locale=hi_IN, timezone=Asia/Jakarta
   [junit4]   2> NOTE: Windows 7 6.1 x86/Oracle Corporation 1.8.0 (32-bit)/cpus=2,threads=1,free=196911528,total=465567744
   [junit4]   2> NOTE: All tests run in this JVM: [TestSchemaResource, TestOverriddenPrefixQueryForCustomFieldType, XsltUpdateRequestHandlerTest, TestCloudManagedSchema, TestMultiCoreConfBootstrap, BadCopyFieldTest, TimeZoneUtilsTest, TestAnalyzeInfixSuggestions, CurrencyFieldOpenExchangeTest, DocumentAnalysisRequestHandlerTest, TestAnalyzedSuggestions, BasicFunctionalityTest, RemoteQueryErrorTest, WordBreakSolrSpellCheckerTest, OutputWriterTest, TestBM25SimilarityFactory, TestSchemaSimilarityResource, TestJmxIntegration, TestSolrXml, PolyFieldTest, SampleTest, SchemaVersionSpecificBehaviorTest, IndexSchemaRuntimeFieldTest, TestSolrJ, TestInitQParser, TestSolrXMLSerializer, CopyFieldTest, ConnectionManagerTest, HdfsBasicDistributedZk2Test, SolrInfoMBeanTest, TestSuggestSpellingConverter, HdfsCollectionsAPIDistributedZkTest, TestRealTimeGet, DistribCursorPagingTest, TermVectorComponentDistributedTest, DistributedQueryComponentOptimizationTest, UpdateParamsTest, BlockDirectoryTest, TestLMDirichletSimilarityFactory, TestSort, DisMaxRequestHandlerTest, SliceStateUpdateTest, ResourceLoaderTest, TestCharFilters, CircularListTest, TestHighFrequencyDictionaryFactory, DocValuesMissingTest, TestDefaultSearchFieldResource, TestInfoStreamLogging, TestCursorMarkWithoutUniqueKey, SolrCoreCheckLockOnStartupTest, BasicZkTest, AddSchemaFieldsUpdateProcessorFactoryTest, CurrencyFieldXmlFileTest, BinaryUpdateRequestHandlerTest, DirectUpdateHandlerOptimizeTest, QueryElevationComponentTest, TestSolrQueryParser, TestWriterPerf, DistributedDebugComponentTest, OpenCloseCoreStressTest, EchoParamsTest, DocValuesMultiTest, TestFunctionQuery, TestValueSourceCache, TestXIncludeConfig, LoggingHandlerTest, RequestHandlersTest, AnalysisErrorHandlingTest, UniqFieldsUpdateProcessorFactoryTest, FileUtilsTest, TestNonNRTOpen, SolrRequestParserTest, RegexBoostProcessorTest, TestFastWriter, ZkCLITest, TestSweetSpotSimilarityFactory, TestTrie, BasicDistributedZk2Test, TestModifyConfFiles, DirectSolrSpellCheckerTest, ZkNodePropsTest, TestMergePolicyConfig, TestNumberUtils, TestCodecSupport, TestSearchPerf, TermsComponentTest, ChangedSchemaMergeTest, NumericFieldsTest, DistributedSuggestComponentTest, CSVRequestHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParserResource, ClusterStateTest, FileBasedSpellCheckerTest, AnalysisAfterCoreReloadTest, TestFieldTypeResource, TestStressVersions, TestLMJelinekMercerSimilarityFactory, FieldFacetExtrasTest, TestSolrXmlPersistence, TestDocumentBuilder, UnloadDistributedZkTest, TestSolrDeletionPolicy2, TestStressUserVersions, TestPhraseSuggestions, SolrPluginUtilsTest, SuggesterWFSTTest, TestReloadAndDeleteDocs, RequiredFieldsTest, SpellingQueryConverterTest, BJQParserTest, ExternalFileFieldSortTest, ReturnFieldsTest, IndexSchemaTest, PreAnalyzedUpdateProcessorTest, DistributedSpellCheckComponentTest, TestFieldTypeCollectionResource, UUIDFieldTest, OverseerTest, TestHashPartitioner, TestClassNameShortening, DocValuesTest, TestReload, CoreMergeIndexesAdminHandlerTest, TestIndexSearcher, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 103.94s, 1 test, 1 failure <<< FAILURES!

[...truncated 749 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 373 suites, 1606 tests, 1 failure, 40 ignored (12 assumptions)

Total time: 79 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.8.0-fcs-b129 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure