You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/03/07 08:00:48 UTC

[JENKINS] Lucene-Solr-trunk-Windows (64bit/jdk1.7.0_51) - Build # 3840 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Windows/3840/
Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseSerialGC -XX:-UseSuperWord

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch

Error Message:
Could not find the new collection - 503 : http://127.0.0.1:53141/aq_/dt/awholynewcollection_0

Stack Trace:
java.lang.AssertionError: Could not find the new collection - 503 : http://127.0.0.1:53141/aq_/dt/awholynewcollection_0
	at __randomizedtesting.SeedInfo.seed([3B3D54D111FF6A18:BADBDAC966A00A24]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForNon403or404or503(AbstractFullDistribZkTestBase.java:1807)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:734)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:870)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
	at java.lang.Thread.run(Thread.java:744)




Build Log:
[...truncated 19684 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> 1891244 T5189 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1891244 T5189 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /aq_/dt
   [junit4]   2> 1891265 T5189 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> Creating dataDir: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\solrtest-CollectionsAPIDistributedZkTest-1394173753332
   [junit4]   2> 1891269 T5189 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 1891270 T5190 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1891362 T5189 oasc.ZkTestServer.run start zk server on port:53107
   [junit4]   2> 1891363 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891371 T5196 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ea73942 name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891371 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891371 T5189 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1891381 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891386 T5198 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e6937a7 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891387 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891387 T5189 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1891395 T5189 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1891400 T5189 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1891404 T5189 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1891409 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1891410 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1891425 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1891426 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1891435 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891435 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891441 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1891441 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1891445 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1891446 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1891450 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1891450 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1891454 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1891454 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1891459 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1891460 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1891463 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891463 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891469 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1891469 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1891473 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1891473 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> Using new style solr.xml
   [junit4]   2> 1891480 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff0001, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1891481 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891484 T5200 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e104c2b name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891484 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891484 T5189 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1891488 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1891490 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1891493 T5202 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24dc3318 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1891493 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1891495 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.xml to /configs/conf2/solrconfig.xml
   [junit4]   2> 1891496 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.xml
   [junit4]   2> 1891500 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf2/schema.xml
   [junit4]   2> 1891501 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/schema.xml
   [junit4]   2> 1891506 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891507 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1891510 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf2/stopwords.txt
   [junit4]   2> 1891510 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/stopwords.txt
   [junit4]   2> 1891515 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf2/protwords.txt
   [junit4]   2> 1891515 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/protwords.txt
   [junit4]   2> 1891518 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf2/currency.xml
   [junit4]   2> 1891519 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/currency.xml
   [junit4]   2> 1891524 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1891524 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/open-exchange-rates.json
   [junit4]   2> 1891528 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891528 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1891532 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf2/old_synonyms.txt
   [junit4]   2> 1891532 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/old_synonyms.txt
   [junit4]   2> 1891537 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf2/synonyms.txt
   [junit4]   2> 1891537 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/synonyms.txt
   [junit4]   2> 1891541 T5189 oasc.AbstractZkTestCase.putConfig put C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\core\src\test-files\solr\collection1\conf\elevate.xml to /configs/conf2/elevate.xml
   [junit4]   2> 1891541 T5189 oascc.SolrZkClient.makePath makePath: /configs/conf2/elevate.xml
   [junit4]   2> 1893644 T5189 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1893649 T5189 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53120
   [junit4]   2> 1893651 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1893652 T5189 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1893652 T5189 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611
   [junit4]   2> 1893652 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\'
   [junit4]   2> 1893690 T5189 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solr.xml
   [junit4]   2> 1893785 T5189 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611
   [junit4]   2> 1893785 T5189 oasc.CoreContainer.<init> New CoreContainer 364142676
   [junit4]   2> 1893785 T5189 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\]
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1893787 T5189 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1893790 T5189 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1893794 T5189 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1893794 T5189 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1893794 T5189 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1893794 T5189 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53107/solr
   [junit4]   2> 1893794 T5189 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1893799 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893824 T5213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@752035ed name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893825 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893851 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff0004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1893853 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1893857 T5215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2edbcaa8 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1893858 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1893861 T5189 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1893868 T5189 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1893876 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1893880 T5189 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53120_aq_%2Fdt
   [junit4]   2> 1893890 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53120_aq_%2Fdt
   [junit4]   2> 1893896 T5189 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1893900 T5189 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1893907 T5189 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53120_aq_%2Fdt
   [junit4]   2> 1893908 T5189 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1893913 T5189 oasc.Overseer.start Overseer (id=91368571099086853-127.0.0.1:53120_aq_%2Fdt-n_0000000000) starting
   [junit4]   2> 1893919 T5189 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1893926 T5217 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1893927 T5189 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1893928 T5217 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
   [junit4]   2> 1893932 T5189 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1893935 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1893939 T5216 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1893945 T5189 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611
   [junit4]   2> 1895079 T5189 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\conf\
   [junit4]   2> 1895094 T5189 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1895097 T5189 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1895098 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1895101 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1895106 T5220 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68c975b0 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1895107 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1895109 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1895113 T5189 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1897398 T5189 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1897399 T5189 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1897404 T5189 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53132
   [junit4]   2> 1897406 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1897407 T5189 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1897407 T5189 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177
   [junit4]   2> 1897407 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\'
   [junit4]   2> 1897456 T5189 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\solr.xml
   [junit4]   2> 1897547 T5189 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177
   [junit4]   2> 1897547 T5189 oasc.CoreContainer.<init> New CoreContainer 1168173189
   [junit4]   2> 1897547 T5189 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\]
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1897551 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1897553 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1897554 T5189 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1897554 T5189 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1897556 T5189 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1897556 T5189 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1897558 T5189 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1897558 T5189 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53107/solr
   [junit4]   2> 1897558 T5189 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1897560 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1897589 T5231 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47019779 name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1897591 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1897593 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1897595 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1897598 T5233 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e50d4ad name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1897599 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1897608 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1898630 T5189 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53132_aq_%2Fdt
   [junit4]   2> 1898634 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53132_aq_%2Fdt
   [junit4]   2> 1898644 T5233 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1898645 T5215 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1898645 T5220 oascc.ZkStateReader$3.process Updating live nodes... (2)
   [junit4]   2> 1898668 T5189 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177
   [junit4]   2> 1899846 T5189 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\conf\
   [junit4]   2> 1899863 T5189 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1899865 T5189 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1899865 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1902371 T5189 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1902372 T5189 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1902380 T5189 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53141
   [junit4]   2> 1902382 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1902382 T5189 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1902382 T5189 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930
   [junit4]   2> 1902383 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930\'
   [junit4]   2> 1902409 T5189 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930\solr.xml
   [junit4]   2> 1902513 T5189 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930
   [junit4]   2> 1902513 T5189 oasc.CoreContainer.<init> New CoreContainer 1397814586
   [junit4]   2> 1902513 T5189 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930\]
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1902516 T5189 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1902523 T5189 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1902523 T5189 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1902523 T5189 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1902523 T5189 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53107/solr
   [junit4]   2> 1902523 T5189 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1902525 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1902539 T5245 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6813dd91 name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1902540 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1902545 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1902547 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1902551 T5247 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3036b0f5 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1902551 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1902560 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1903585 T5189 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53141_aq_%2Fdt
   [junit4]   2> 1903591 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53141_aq_%2Fdt
   [junit4]   2> 1903602 T5220 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1903603 T5233 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1903603 T5215 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1903604 T5247 oascc.ZkStateReader$3.process Updating live nodes... (3)
   [junit4]   2> 1903618 T5189 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930
   [junit4]   2> 1904831 T5189 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1394173761930\conf\
   [junit4]   2> 1904847 T5189 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1904849 T5189 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1904849 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1907502 T5189 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1907503 T5189 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1907510 T5189 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53150
   [junit4]   2> 1907512 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1907513 T5189 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1907513 T5189 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914
   [junit4]   2> 1907513 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\'
   [junit4]   2> 1907545 T5189 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solr.xml
   [junit4]   2> 1907659 T5189 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914
   [junit4]   2> 1907659 T5189 oasc.CoreContainer.<init> New CoreContainer 401774718
   [junit4]   2> 1907659 T5189 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\]
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1907661 T5189 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1907665 T5189 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1907669 T5189 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1907669 T5189 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1907669 T5189 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1907669 T5189 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53107/solr
   [junit4]   2> 1907669 T5189 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1907673 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1907732 T5259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@37f9847a name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1907733 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1907747 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1907750 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1907753 T5261 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@57740f4c name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1907754 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1907762 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1908884 T5189 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53150_aq_%2Fdt
   [junit4]   2> 1908889 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53150_aq_%2Fdt
   [junit4]   2> 1908914 T5220 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1908915 T5233 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1908915 T5247 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1908915 T5215 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1908916 T5261 oascc.ZkStateReader$3.process Updating live nodes... (4)
   [junit4]   2> 1908935 T5189 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914
   [junit4]   2> 1910020 T5189 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\conf\
   [junit4]   2> 1910034 T5189 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1910035 T5189 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1910036 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1912413 T5189 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 1912414 T5189 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1912419 T5189 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:53159
   [junit4]   2> 1912422 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1912423 T5189 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1912423 T5189 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100
   [junit4]   2> 1912423 T5189 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\'
   [junit4]   2> 1912454 T5189 oasc.ConfigSolr.fromFile Loading container configuration from C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solr.xml
   [junit4]   2> 1912555 T5189 oasc.CorePropertiesLocator.<init> Config-defined core root directory: C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100
   [junit4]   2> 1912555 T5189 oasc.CoreContainer.<init> New CoreContainer 1334215249
   [junit4]   2> 1912556 T5189 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\]
   [junit4]   2> 1912557 T5189 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1912557 T5189 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1912558 T5189 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1912558 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1912558 T5189 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1912558 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1912559 T5189 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1912559 T5189 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1912559 T5189 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1912563 T5189 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1912564 T5189 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1912564 T5189 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1912564 T5189 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53107/solr
   [junit4]   2> 1912565 T5189 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1912568 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912627 T5273 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d5bca1 name:ZooKeeperConnection Watcher:127.0.0.1:53107 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912629 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1912649 T5191 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1449b3b37ff000d, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:744)
   [junit4]   2> 
   [junit4]   2> 1912655 T5189 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1912662 T5275 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@72b76a87 name:ZooKeeperConnection Watcher:127.0.0.1:53107/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1912664 T5189 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1912672 T5189 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1913796 T5189 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53159_aq_%2Fdt
   [junit4]   2> 1913802 T5189 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53159_aq_%2Fdt
   [junit4]   2> 1913816 T5220 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913817 T5215 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913818 T5247 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913819 T5261 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913819 T5275 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913821 T5233 oascc.ZkStateReader$3.process Updating live nodes... (5)
   [junit4]   2> 1913842 T5189 oasc.CorePropertiesLocator.discover Looking for core definitions underneath C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100
   [junit4]   2> 1914897 T5189 oasc.CorePropertiesLocator.discoverUnder Found core conf in C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\conf\
   [junit4]   2> 1914910 T5189 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 1914913 T5189 oass.SolrDispatchFilter.init user.dir=C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0
   [junit4]   2> 1914913 T5189 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1914958 T5228 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&router.field=myOwnField&collection.configName=conf1&action=CREATE&numShards=2&version=2&wt=javabin&name=solrj_collection&router.name=compositeId
   [junit4]   2> 1914962 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1914964 T5217 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 1914964 T5217 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
   [junit4]   2> 	  "operation":"createcollection",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"solrj_collection",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "collection.configName":"conf1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "router.field":"myOwnField",
   [junit4]   2> 	  "router.name":"compositeId"}
   [junit4]   2> 1914969 T5217 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection 
   [junit4]   2> 1914969 T5217 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
   [junit4]   2> 1914979 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1914981 T5216 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1914982 T5216 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
   [junit4]   2> 1914982 T5216 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
   [junit4]   2> 1914988 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1914990 T5275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1914991 T5233 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1914991 T5247 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1914991 T5215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1914991 T5220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1914992 T5261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915102 T5217 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 1915102 T5217 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:53150_aq_%2Fdt
   [junit4]   2> 1915105 T5217 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:53159_aq_%2Fdt
   [junit4]   2> 1915111 T5217 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:53132_aq_%2Fdt
   [junit4]   2> 1915112 T5256 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&action=CREATE&numShards=2&version=2&wt=javabin&name=solrj_collection_shard1_replica1&shard=shard1&collection=solrj_collection
   [junit4]   2> 1915114 T5271 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&action=CREATE&numShards=2&version=2&wt=javabin&name=solrj_collection_shard1_replica2&shard=shard1&collection=solrj_collection
   [junit4]   2> 1915114 T5217 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:53120_aq_%2Fdt
   [junit4]   2> 1915118 T5256 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down collection=solrj_collection
   [junit4]   2> 1915124 T5256 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1915124 T5229 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&action=CREATE&numShards=2&version=2&wt=javabin&name=solrj_collection_shard2_replica1&shard=shard2&collection=solrj_collection
   [junit4]   2> 1915125 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1915126 T5271 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down collection=solrj_collection
   [junit4]   2> 1915128 T5208 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&action=CREATE&numShards=2&version=2&wt=javabin&name=solrj_collection_shard2_replica2&shard=shard2&collection=solrj_collection
   [junit4]   2> 1915132 T5271 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1915134 T5229 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down collection=solrj_collection
   [junit4]   2> 1915135 T5208 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down collection=solrj_collection
   [junit4]   2> 1915136 T5216 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper... 
   [junit4]   2> 1915137 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1915137 T5229 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1915138 T5208 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1915138 T5216 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53150/aq_/dt",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53150_aq_%2Fdt",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1915146 T5216 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53159/aq_/dt",
   [junit4]   2> 	  "core":"solrj_collection_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53159_aq_%2Fdt",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1915152 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1915153 T5216 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53132/aq_/dt",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53132_aq_%2Fdt",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1915158 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1915160 T5216 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53120/aq_/dt",
   [junit4]   2> 	  "core":"solrj_collection_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "node_name":"127.0.0.1:53120_aq_%2Fdt",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"solrj_collection",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core_node_name":null}
   [junit4]   2> 1915165 T5215 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1915293 T5261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915293 T5215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915293 T5220 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915294 T5233 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915293 T5275 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1915293 T5247 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 1916352 T5256 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
   [junit4]   2> 1916359 T5256 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1
   [junit4]   2> 1916359 T5256 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1916362 T5271 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
   [junit4]   2> 1916363 T5256 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1916363 T5256 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1916367 T5208 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
   [junit4]   2> 1916368 T5256 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1916368 T5256 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\'
   [junit4]   2> 1916369 T5229 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
   [junit4]   2> 1916368 T5271 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2
   [junit4]   2> 1916370 T5271 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1916375 T5208 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2
   [junit4]   2> 1916375 T5208 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1916376 T5271 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1916376 T5271 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1916379 T5229 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\solrj_collection_shard2_replica1
   [junit4]   2> 1916379 T5229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
   [junit4]   2> 1916382 T5208 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1916382 T5208 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1916385 T5229 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1916385 T5229 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
   [junit4]   2> 1916387 T5271 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1916387 T5271 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\'
   [junit4]   2> 1916395 T5208 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1916395 T5208 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\'
   [junit4]   2> 1916415 T5229 oascc.ZkStateReader.readConfigName path=/collections/solrj_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1916416 T5229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1394173757177\solrj_collection_shard2_replica1\'
   [junit4]   2> 1916530 T5271 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1916573 T5256 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1916642 T5271 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1916647 T5208 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1916686 T5256 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1916759 T5208 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1916760 T5229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
   [junit4]   2> 1916762 T5256 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1916774 T5256 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
   [junit4]   2> 1916780 T5271 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1916794 T5271 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
   [junit4]   2> 1917044 T5208 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1917055 T5208 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
   [junit4]   2> 1917788 T5229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1918185 T5229 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1918197 T5229 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
   [junit4]   2> 1918430 T5256 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1918577 T5271 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1918619 T5256 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1918623 T5271 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1918624 T5256 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1918627 T5271 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1919006 T5208 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1919015 T5208 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1919020 T5208 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1919078 T5271 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919082 T5256 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919092 T5271 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919104 T5256 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919108 T5208 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919128 T5271 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919138 T5256 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919142 T5271 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919143 T5271 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919143 T5271 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919153 T5208 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1919156 T5256 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919170 T5256 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919171 T5256 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919170 T5208 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919174 T5271 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919174 T5271 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919174 T5271 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1919177 T5271 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\data\
   [junit4]   2> 1919177 T5271 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c3598e1
   [junit4]   2> 1919178 T5271 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\data\
   [junit4]   2> 1919178 T5271 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\data\index/
   [junit4]   2> 1919178 T5271 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1919179 T5271 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1394173772100\solrj_collection_shard1_replica2\data\index
   [junit4]   2> 1919180 T5271 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1919182 T5271 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@17e2bce8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@320254c1),segFN=segments_1,generation=1}
   [junit4]   2> 1919182 T5271 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1919188 T5271 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1919189 T5271 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919190 T5271 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919190 T5271 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919190 T5271 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919191 T5271 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1919191 T5271 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919191 T5271 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919192 T5271 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1919192 T5271 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1919194 T5271 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1919194 T5271 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1919194 T5271 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1919195 T5271 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1919195 T5271 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1919196 T5271 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1919196 T5271 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1919210 T5256 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919210 T5256 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919210 T5256 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1919212 T5256 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\, dataDir=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\data\
   [junit4]   2> 1919212 T5256 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c3598e1
   [junit4]   2> 1919213 T5256 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\data\
   [junit4]   2> 1919213 T5256 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\data\index/
   [junit4]   2> 1919213 T5256 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory '..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1919215 T5208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919215 T5208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919215 T5208 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1919216 T5256 oasc.CachingDirectoryFactory.get return new directory for ..\..\..\..\..\..\..\..\..\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build\solr-core\test\J0\.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1394173766914\solrj_collection_shard1_replica1\data\index
   [junit4]   2> 1919216 T5256 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1919219 T5256 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@88cdd27 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@215494dc),segFN=segments_1,generation=1}
   [junit4]   2> 1919219 T5256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1919224 T5256 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1919225 T5256 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919225 T5256 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919225 T5256 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919226 T5256 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919226 T5256 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1919226 T5256 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919227 T5256 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919227 T5256 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1919227 T5256 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1919228 T5256 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1919228 T5256 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1919228 T5256 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1919231 T5256 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1919231 T5256 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1919232 T5256 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1919232 T5256 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1919237 T5256 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1919237 T5271 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1919250 T5208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1919250 T5208 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1919251 T5208 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1919252 T5256 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1919254 T5256 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1919255 T5208 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\, dataDir=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\data\
   [junit4]   2> 1919255 T5208 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c3598e1
   [junit4]   2> 1919256 T5208 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\data\
   [junit4]   2> 1919256 T5208 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\data\index/
   [junit4]   2> 1919256 T5208 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory '.\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\data\index' doesn't exist. Creating new index...
   [junit4]   2> 1919258 T5256 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=4.2841796875, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=22.21293084801776, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8322377462898615
   [junit4]   2> 1919258 T5208 oasc.CachingDirectoryFactory.get return new directory for .\org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1394173753611\solrj_collection_shard2_replica2\data\index
   [junit4]   2> 1919260 T5208 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=11, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1919260 T5256 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@88cdd27 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@215494dc),segFN=segments_1,generation=1}
   [junit4]   2> 1919261 T5256 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1919261 T5256 oass.SolrIndexSearcher.<init> Opening Searcher@3b9ef9d0[solrj_collection_shard1_replica1] main
   [junit4]   2> 1919262 T5208 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@b711810 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5bb29580),segFN=segments_1,generation=1}
   [junit4]   2> 1919262 T5208 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1919269 T5208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1919270 T5208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919270 T5208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1919270 T5208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919272 T5208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1919272 T5208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1919272 T5208 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919273 T5208 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1919273 T5208 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1919273 T5208 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1919275 T5208 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1919275 T5208 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1919275 T5208 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1919278 T5208 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1919279 T5208 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1919280 T5208 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1919281 T5208 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1919285 T5208 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1919303 T5281 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@3b9ef9d0[solrj_collection_shard1_replica1] main{StandardDirectoryReader(segments_1:1:nrt)}
   [junit4]   2> 1919304 T5256 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
   [junit4]   2> 1919304 T5256 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:53150/aq_/dt collection:solrj_collection shard:shard1
   [junit4]   2> 1919307 T5208 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1919307 T5208 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1919310 T5208 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=19, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=4.2841796875, floorSegmentMB=0.3359375, forceMergeDeletesPctAllowed=22.21293084801776, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=

[...truncated too long message...]

e(SolrZkClient.java:259)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2068814 T5275 oasc.LeaderElector$1.process WARN  org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:259)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:256)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
   [junit4]   2> 
   [junit4]   2> 2068812 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2068814 T5233 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> NOTE: test params are: codec=Lucene46: {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=tr_TR, timezone=Africa/Timbuktu
   [junit4]   2> NOTE: Windows 7 6.1 amd64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=117659080,total=367108096
   [junit4]   2> NOTE: All tests run in this JVM: [TestFieldResource, DirectSolrConnectionTest, ZkCLITest, BadIndexSchemaTest, TestSearcherReuse, SolrTestCaseJ4Test, BasicZkTest, StatsComponentTest, TestFastLRUCache, BasicDistributedZkTest, MigrateRouteKeyTest, OverseerTest, BinaryUpdateRequestHandlerTest, HdfsChaosMonkeySafeLeaderTest, SynonymTokenizerTest, SystemInfoHandlerTest, AnalysisAfterCoreReloadTest, NoCacheHeaderTest, TestFaceting, TestStressUserVersions, PreAnalyzedUpdateProcessorTest, DOMUtilTest, TestCodecSupport, TestExceedMaxTermLength, SliceStateUpdateTest, TestFieldTypeResource, TestMultiCoreConfBootstrap, CacheHeaderTest, SpellingQueryConverterTest, TestDFRSimilarityFactory, TestLRUCache, ExternalFileFieldSortTest, PrimUtilsTest, RequiredFieldsTest, CoreMergeIndexesAdminHandlerTest, TestDistribDocBasedVersion, HighlighterTest, TestNumberUtils, TestCollationFieldDocValues, TestUpdate, BlockCacheTest, DocumentBuilderTest, LukeRequestHandlerTest, TestLFUCache, TestJoin, TestDocBasedVersionConstraints, TestFuzzyAnalyzedSuggestions, FullSolrCloudDistribCmdsTest, TestSurroundQueryParser, TestConfig, HdfsRecoveryZkTest, CoreAdminHandlerTest, QueryParsingTest, TestSolrQueryParserDefaultOperatorResource, UnloadDistributedZkTest, TestFreeTextSuggestions, TestFiltering, TestBinaryField, HdfsWriteToMultipleCollectionsTest, QueryResultKeyTest, TestSimpleQParserPlugin, ResponseLogComponentTest, FileBasedSpellCheckerTest, TestPHPSerializedResponseWriter, TestSolrIndexConfig, ChaosMonkeySafeLeaderTest, DistanceFunctionTest, SolrIndexConfigTest, UpdateParamsTest, TestDistributedMissingSort, SuggestComponentTest, HdfsBasicDistributedZkTest, SpellCheckComponentTest, TestRandomFaceting, TestWriterPerf, TestStressRecovery, UUIDFieldTest, SortByFunctionTest, TestLMJelinekMercerSimilarityFactory, PolyFieldTest, TestPseudoReturnFields, SuggesterFSTTest, DistributedQueryElevationComponentTest, JSONWriterTest, TestCloudManagedSchema, QueryElevationComponentTest, FileUtilsTest, TestSchemaVersionResource, TestStressReorder, TestSchemaNameResource, MBeansHandlerTest, BlockDirectoryTest, TestFieldTypeCollectionResource, CurrencyFieldXmlFileTest, UniqFieldsUpdateProcessorFactoryTest, DateFieldTest, TestSolrXml, OpenCloseCoreStressTest, SolrCoreCheckLockOnStartupTest, TestIndexSearcher, TestSolr4Spatial, TestWordDelimiterFilterFactory, TestCollapseQParserPlugin, ConnectionManagerTest, StandardRequestHandlerTest, ClusterStateUpdateTest, DeleteInactiveReplicaTest, TestPartialUpdateDeduplication, TestBM25SimilarityFactory, TermsComponentTest, NumericFieldsTest, TestInfoStreamLogging, DocValuesTest, TestOverriddenPrefixQueryForCustomFieldType, PrimitiveFieldTypeTest, TestLMDirichletSimilarityFactory, ModifyConfFileTest, SuggesterWFSTTest, HdfsDirectoryTest, TestSolrQueryParserResource, XmlUpdateRequestHandlerTest, TestCSVLoader, HdfsCollectionsAPIDistributedZkTest, HighlighterConfigTest, DateMathParserTest, TermVectorComponentTest, LeaderElectionTest, DistributedQueryComponentOptimizationTest, TestNonNRTOpen, CursorPagingTest, TestReload, RangeFacetTest, TestMergePolicyConfig, SolrPluginUtilsTest, StatelessScriptUpdateProcessorFactoryTest, TestSort, TestQuerySenderListener, TestExpandComponent, IndexSchemaRuntimeFieldTest, BJQParserTest, TestLazyCores, AssignTest, SolrCmdDistributorTest, TestImplicitCoreProperties, StressHdfsTest, SpellCheckCollatorTest, SoftAutoCommitTest, NotRequiredUniqueKeyTest, PreAnalyzedFieldTest, EchoParamsTest, DeleteReplicaTest, LeaderElectionIntegrationTest, ZkControllerTest, TestPerFieldSimilarity, TestXIncludeConfig, FieldAnalysisRequestHandlerTest, DocValuesMultiTest, TestStandardQParsers, CoreContainerCoreInitFailuresTest, ChaosMonkeyNothingIsSafeTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestRecovery, MinimalSchemaTest, TestShardHandlerFactory, TestAnalyzedSuggestions, RequestHandlersTest, TestPhraseSuggestions, TestStressVersions, TestQueryUtils, TestFunctionQuery, DistributedTermsComponentTest, TestMaxScoreQueryParser, CustomCollectionTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed in 178.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 640 lines...]
BUILD FAILED
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:465: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:445: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\build.xml:39: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\extra-targets.xml:37: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\build.xml:189: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\solr\common-build.xml:490: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:1274: The following error occurred while executing this line:
C:\Users\JenkinsSlave\workspace\Lucene-Solr-trunk-Windows\lucene\common-build.xml:907: There were test failures: 378 suites, 1618 tests, 1 failure, 54 ignored (25 assumptions)

Total time: 94 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0_51 -XX:-UseCompressedOops -XX:+UseSerialGC -XX:-UseSuperWord
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure