You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/09/29 12:36:29 UTC

[JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.8.0_20) - Build # 11195 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11195/
Java: 32bit/jdk1.8.0_20 -server -XX:+UseSerialGC

2 tests failed.
REGRESSION:  org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:54590, http://127.0.0.1:38802, http://127.0.0.1:53259]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:54590, http://127.0.0.1:38802, http://127.0.0.1:53259]
	at __randomizedtesting.SeedInfo.seed([4FE08E3460AF700C:CE06002C17F01030]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not  remove replica : customcollreplicadeletion/a/core_node1
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
	... 46 more


REGRESSION:  org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:58520/au_e, http://127.0.0.1:60797/au_e, http://127.0.0.1:56273/au_e, http://127.0.0.1:47395/au_e, http://127.0.0.1:58667/au_e]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:58520/au_e, http://127.0.0.1:60797/au_e, http://127.0.0.1:56273/au_e, http://127.0.0.1:47395/au_e, http://127.0.0.1:58667/au_e]
	at __randomizedtesting.SeedInfo.seed([4FE08E3460AF700C:CE06002C17F01030]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
	at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:171)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:144)
	at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not  remove replica : delLiveColl/shard1/core_node1
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
	... 47 more




Build Log:
[...truncated 10974 lines...]
   [junit4] Suite: org.apache.solr.cloud.DeleteReplicaTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/init-core-data-001
   [junit4]   2> 133241 T309 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 133242 T309 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /au_e/
   [junit4]   2> 133245 T309 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 133247 T309 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 133250 T310 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 133349 T309 oasc.ZkTestServer.run start zk server on port:49619
   [junit4]   2> 133352 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 133392 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133427 T316 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f8a7f3 name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133428 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133428 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 133430 T309 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 133452 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 133454 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133455 T318 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f1ef72 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133455 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133455 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 133459 T309 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 133462 T309 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 133467 T309 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 133469 T309 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 133472 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 133473 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 133477 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 133478 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 133480 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 133481 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 133484 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 133484 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 133486 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 133487 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 133489 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 133490 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 133492 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 133492 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 133494 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 133494 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 133497 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 133497 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 133500 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 133500 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 133502 T309 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 133503 T309 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 133784 T309 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 133790 T309 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:60797
   [junit4]   2> 133791 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 133791 T309 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 133791 T309 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002
   [junit4]   2> 133792 T309 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/'
   [junit4]   2> 133817 T309 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/solr.xml
   [junit4]   2> 133829 T309 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002
   [junit4]   2> 133830 T309 oasc.CoreContainer.<init> New CoreContainer 3992014
   [junit4]   2> 133830 T309 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/]
   [junit4]   2> 133831 T309 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 133831 T309 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 133831 T309 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 133831 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 133832 T309 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 133832 T309 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 133832 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 133832 T309 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 133833 T309 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 133833 T309 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 133834 T309 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 133834 T309 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 133834 T309 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 133834 T309 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49619/solr
   [junit4]   2> 133845 T309 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 133845 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 133846 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133848 T329 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@173f02e name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133848 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133849 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 133853 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133855 T331 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43a2be name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133855 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133861 T309 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 133868 T309 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 133871 T309 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 133874 T309 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 133877 T309 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 133883 T309 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 133885 T309 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60797_au_e
   [junit4]   2> 133887 T309 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60797_au_e
   [junit4]   2> 133890 T309 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 133892 T309 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 133894 T309 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 133899 T309 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:60797_au_e
   [junit4]   2> 133900 T309 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 133902 T309 oasc.Overseer.start Overseer (id=92535798792257539-127.0.0.1:60797_au_e-n_0000000000) starting
   [junit4]   2> 133911 T309 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 133931 T309 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 133935 T333 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 133944 T332 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 133964 T309 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 133968 T309 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 133970 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 133979 T309 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002
   [junit4]   2> 133993 T309 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/conf/
   [junit4]   2> 134222 T309 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 134224 T309 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 134224 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 134226 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 134226 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134228 T337 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e611d6 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134228 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134228 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 134229 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 134234 T309 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 134234 T309 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 134234 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 134235 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134236 T339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d10a28 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134236 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134236 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 134243 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 134248 T332 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
   [junit4]   2> 134248 T332 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 134253 T332 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 134257 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
   [junit4]   2> 134261 T340 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 134264 T341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 134477 T309 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 134478 T309 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 134480 T309 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58520
   [junit4]   2> 134481 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 134481 T309 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 134481 T309 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003
   [junit4]   2> 134481 T309 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003/'
   [junit4]   2> 134491 T309 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003/solr.xml
   [junit4]   2> 134504 T309 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003
   [junit4]   2> 134504 T309 oasc.CoreContainer.<init> New CoreContainer 21338852
   [junit4]   2> 134504 T309 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003/]
   [junit4]   2> 134505 T309 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 134505 T309 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 134505 T309 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 134506 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 134506 T309 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 134506 T309 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 134506 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 134507 T309 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 134507 T309 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 134507 T309 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 134508 T309 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 134508 T309 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 134508 T309 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 134508 T309 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49619/solr
   [junit4]   2> 134509 T309 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 134509 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 134510 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134511 T352 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eec29d name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134512 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134512 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 134514 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 134515 T354 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9aaddc name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 134515 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 134521 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 135527 T309 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58520_au_e
   [junit4]   2> 135528 T309 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58520_au_e
   [junit4]   2> 135531 T309 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 135534 T309 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003
   [junit4]   2> 135539 T309 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-003/conf/
   [junit4]   2> 135654 T309 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 135655 T309 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 135655 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 135896 T309 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 135896 T309 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 135898 T309 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56273
   [junit4]   2> 135898 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 135899 T309 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 135899 T309 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004
   [junit4]   2> 135899 T309 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004/'
   [junit4]   2> 135909 T309 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004/solr.xml
   [junit4]   2> 135925 T309 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004
   [junit4]   2> 135925 T309 oasc.CoreContainer.<init> New CoreContainer 7598666
   [junit4]   2> 135925 T309 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004/]
   [junit4]   2> 135926 T309 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 135926 T309 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 135926 T309 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 135927 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 135927 T309 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 135927 T309 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 135927 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 135928 T309 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 135928 T309 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 135928 T309 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 135929 T309 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 135929 T309 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 135929 T309 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 135929 T309 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49619/solr
   [junit4]   2> 135930 T309 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 135930 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 135931 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135932 T367 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@104df85 name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135933 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135933 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 135936 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135937 T369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a462b3 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135937 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135943 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 136947 T309 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56273_au_e
   [junit4]   2> 136949 T309 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56273_au_e
   [junit4]   2> 136952 T309 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 136954 T309 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004
   [junit4]   2> 136962 T309 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004/conf/
   [junit4]   2> 137107 T309 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 137108 T309 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 137109 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 137359 T309 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 137359 T309 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 137361 T309 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:47395
   [junit4]   2> 137361 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 137362 T309 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 137362 T309 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005
   [junit4]   2> 137362 T309 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005/'
   [junit4]   2> 137372 T309 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005/solr.xml
   [junit4]   2> 137377 T309 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005
   [junit4]   2> 137378 T309 oasc.CoreContainer.<init> New CoreContainer 22374504
   [junit4]   2> 137378 T309 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005/]
   [junit4]   2> 137379 T309 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 137379 T309 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 137379 T309 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 137379 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 137380 T309 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 137380 T309 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 137380 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 137380 T309 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 137381 T309 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 137381 T309 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 137381 T309 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 137382 T309 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 137382 T309 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 137382 T309 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49619/solr
   [junit4]   2> 137382 T309 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 137383 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 137383 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 137385 T382 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1103e22 name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137385 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 137385 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 137388 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 137392 T384 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1085241 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 137393 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 137398 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 138403 T309 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47395_au_e
   [junit4]   2> 138404 T309 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47395_au_e
   [junit4]   2> 138408 T309 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 138413 T309 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005
   [junit4]   2> 138421 T309 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005/conf/
   [junit4]   2> 138536 T309 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 138538 T309 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 138538 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 138782 T309 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
   [junit4]   2> 138783 T309 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 138785 T309 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:58667
   [junit4]   2> 138786 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 138787 T309 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 138787 T309 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006
   [junit4]   2> 138787 T309 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006/'
   [junit4]   2> 138798 T309 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006/solr.xml
   [junit4]   2> 138804 T309 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006
   [junit4]   2> 138804 T309 oasc.CoreContainer.<init> New CoreContainer 11035209
   [junit4]   2> 138804 T309 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006/]
   [junit4]   2> 138805 T309 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 138805 T309 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 138805 T309 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 138805 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 138806 T309 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 138806 T309 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 138806 T309 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 138806 T309 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 138807 T309 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 138807 T309 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 138807 T309 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 138808 T309 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 138808 T309 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 138808 T309 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49619/solr
   [junit4]   2> 138809 T309 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 138809 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 138809 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 138811 T397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dbece name:ZooKeeperConnection Watcher:127.0.0.1:49619 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 138812 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 138812 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 138816 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 138817 T399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1109a90 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 138818 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 138824 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 139829 T309 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58667_au_e
   [junit4]   2> 139831 T309 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:58667_au_e
   [junit4]   2> 139841 T309 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 139845 T309 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006
   [junit4]   2> 139854 T309 oasc.CorePropertiesLocator.discoverUnder Found core conf in /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006/conf/
   [junit4]   2> 139986 T309 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 139987 T309 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 139988 T309 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 139990 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 139991 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 139992 T403 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1dbfc60 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 139992 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 139993 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 139994 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 139997 T309 oasc.AbstractFullDistribZkTestBase.createCollection Creating collection with stateFormat=2: delLiveColl
   [junit4]   2> 139998 T309 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 139999 T309 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 140001 T405 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@987a78 name:ZooKeeperConnection Watcher:127.0.0.1:49619/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 140001 T309 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 140001 T309 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 140003 T309 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 140018 T327 oasha.CollectionsHandler.handleCreateAction Creating Collection : replicationFactor=2&maxShardsPerNode=2&name=delLiveColl&action=CREATE&numShards=2&stateFormat=2&wt=javabin&version=2
   [junit4]   2> 140021 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140023 T333 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"delLiveColl",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "maxShardsPerNode":"2",
   [junit4]   2> 	  "stateFormat":"2"}
   [junit4]   2> 140026 T406 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : create , {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "fromApi":"true",
   [junit4]   2> 	  "name":"delLiveColl",
   [junit4]   2> 	  "replicationFactor":"2",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "maxShardsPerNode":"2",
   [junit4]   2> 	  "stateFormat":"2"}
   [junit4]   2> 140029 T406 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
   [junit4]   2> 140029 T406 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/delLiveColl 
   [junit4]   2> 140030 T406 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl
   [junit4]   2> 140033 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140036 T332 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: delLiveColl
   [junit4]   2> 140037 T332 oasc.Overseer$ClusterStateUpdater.createCollection Create collection delLiveColl with shards [shard1, shard2]
   [junit4]   2> 140037 T332 oasc.Overseer$ClusterStateUpdater.createCollection state version delLiveColl 2
   [junit4]   2> 140040 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/delLiveColl/state.json
   [junit4]   2> 140042 T385 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140042 T355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140042 T340 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140042 T341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140042 T370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140043 T408 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140043 T407 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140043 T400 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
   [junit4]   2> 140133 T406 oasc.OverseerCollectionProcessor.createCollection Creating SolrCores for new collection delLiveColl, shardNames [shard1, shard2] , replicationFactor : 2
   [junit4]   2> 140134 T406 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica1 as part of slice shard1 of collection delLiveColl on 127.0.0.1:56273_au_e
   [junit4]   2> 140136 T406 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard1_replica2 as part of slice shard1 of collection delLiveColl on 127.0.0.1:60797_au_e
   [junit4]   2> 140140 T406 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica1 as part of slice shard2 of collection delLiveColl on 127.0.0.1:47395_au_e
   [junit4]   2> 140144 T406 oasc.OverseerCollectionProcessor.createCollection Creating shard delLiveColl_shard2_replica2 as part of slice shard2 of collection delLiveColl on 127.0.0.1:58667_au_e
   [junit4]   2> 140145 T362 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 140145 T325 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard1_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard1&wt=javabin&version=2
   [junit4]   2> 140146 T380 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica1&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 140150 T325 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica2 state=down collection=delLiveColl
   [junit4]   2> 140150 T380 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica1 state=down collection=delLiveColl
   [junit4]   2> 140152 T392 oasha.CoreAdminHandler.handleCreateAction core create command qt=/admin/cores&collection.configName=conf1&name=delLiveColl_shard2_replica2&action=CREATE&numShards=2&collection=delLiveColl&shard=shard2&wt=javabin&version=2
   [junit4]   2> 140154 T362 oasc.ZkController.publish publishing core=delLiveColl_shard1_replica1 state=down collection=delLiveColl
   [junit4]   2> 140154 T392 oasc.ZkController.publish publishing core=delLiveColl_shard2_replica2 state=down collection=delLiveColl
   [junit4]   2> 140155 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140157 T325 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
   [junit4]   2> 140157 T380 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
   [junit4]   2> 140158 T380 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
   [junit4]   2> 140158 T380 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 140160 T332 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"delLiveColl_shard1_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:60797/au_e",
   [junit4]   2> 	  "node_name":"127.0.0.1:60797_au_e",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"delLiveColl",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 140162 T392 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
   [junit4]   2> 140162 T392 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
   [junit4]   2> 140164 T392 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 140164 T362 oasc.ZkController.preRegister Registering watch for external collection delLiveColl
   [junit4]   2> 140165 T362 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
   [junit4]   2> 140165 T380 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 
   [junit4]   2> 140165 T380 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 140166 T392 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 
   [junit4]   2> 140166 T362 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 140166 T392 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 140167 T362 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 0 
   [junit4]   2> 140168 T362 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 140172 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
   [junit4]   2> 140173 T370 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140173 T400 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140173 T385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140176 T370 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 
   [junit4]   2> 140177 T385 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 
   [junit4]   2> 140177 T400 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 
   [junit4]   2> 140179 T325 oascc.ZkStateReader.addZkWatch addZkWatch delLiveColl
   [junit4]   2> 140179 T325 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/delLiveColl/state.json from ZooKeeper... 
   [junit4]   2> 140181 T325 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 
   [junit4]   2> 140181 T325 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 140182 T325 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica2
   [junit4]   2> 140182 T325 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
   [junit4]   2> 140182 T325 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 140183 T325 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
   [junit4]   2> 140184 T332 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 1 
   [junit4]   2> 140184 T325 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 140184 T332 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"delLiveColl_shard2_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:47395/au_e",
   [junit4]   2> 	  "node_name":"127.0.0.1:47395_au_e",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"delLiveColl",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 140184 T325 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/'
   [junit4]   2> 140187 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140187 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
   [junit4]   2> 140188 T400 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140188 T385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140188 T340 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140189 T400 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 
   [junit4]   2> 140189 T370 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140189 T385 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 
   [junit4]   2> 140191 T370 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 
   [junit4]   2> 140197 T340 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 
   [junit4]   2> 140200 T332 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 2 
   [junit4]   2> 140200 T332 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"delLiveColl_shard2_replica2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:58667/au_e",
   [junit4]   2> 	  "node_name":"127.0.0.1:58667_au_e",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"delLiveColl",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 140202 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140203 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
   [junit4]   2> 140203 T385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140203 T400 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140204 T340 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140204 T370 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140204 T385 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 
   [junit4]   2> 140208 T400 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 
   [junit4]   2> 140209 T370 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 
   [junit4]   2> 140213 T340 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 
   [junit4]   2> 140217 T332 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 3 
   [junit4]   2> 140217 T332 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"delLiveColl_shard1_replica1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:56273/au_e",
   [junit4]   2> 	  "node_name":"127.0.0.1:56273_au_e",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"delLiveColl",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 140221 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140223 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
   [junit4]   2> 140223 T385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140224 T370 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140224 T340 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140224 T400 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140225 T385 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 
   [junit4]   2> 140225 T400 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 
   [junit4]   2> 140225 T370 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 
   [junit4]   2> 140234 T340 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 
   [junit4]   2> 140237 T325 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 140266 T325 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 140268 T325 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 140274 T325 oass.IndexSchema.readSchema [delLiveColl_shard1_replica2] Schema name=test
   [junit4]   2> 140402 T325 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 140406 T325 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 140407 T325 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 140416 T325 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 140419 T325 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 140421 T325 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 140421 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 140423 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 140423 T325 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 140424 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 140424 T325 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 140425 T325 oasc.CoreContainer.create Creating SolrCore 'delLiveColl_shard1_replica2' using configuration from collection delLiveColl
   [junit4]   2> 140425 T325 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 140425 T325 oasc.SolrCore.<init> [delLiveColl_shard1_replica2] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/data/
   [junit4]   2> 140426 T325 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6a8c15
   [junit4]   2> 140431 T325 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/data
   [junit4]   2> 140431 T325 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/data/index/
   [junit4]   2> 140431 T325 oasc.SolrCore.initIndex WARN [delLiveColl_shard1_replica2] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/data/index' doesn't exist. Creating new index...
   [junit4]   2> 140432 T325 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-002/delLiveColl_shard1_replica2/data/index
   [junit4]   2> 140432 T325 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.27585086275228443]
   [junit4]   2> 140433 T325 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-106686)),segFN=segments_1,generation=1}
   [junit4]   2> 140433 T325 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 140439 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 140453 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 140453 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 140454 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 140454 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 140454 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 140455 T325 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 140455 T325 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 140456 T325 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 140459 T325 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 140460 T325 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 140461 T325 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 140463 T325 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 140464 T325 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 140465 T325 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 140465 T325 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 140466 T325 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 140467 T325 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 140467 T325 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 140468 T325 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 140472 T325 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 140473 T325 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 140475 T325 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 140476 T325 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 140485 T325 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 140485 T325 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 140489 T325 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=48.689453125, floorSegmentMB=1.0673828125, forceMergeDeletesPctAllowed=21.511143559883415, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 140492 T325 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-106686)),segFN=segments_1,generation=1}
   [junit4]   2> 140492 T325 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 140492 T325 oass.SolrIndexSearcher.<init> Opening Searcher@4f66c2[delLiveColl_shard1_replica2] main
   [junit4]   2> 140493 T325 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
   [junit4]   2> 140497 T325 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 140498 T325 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 140501 T325 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 140501 T325 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 140502 T325 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 140505 T325 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 140505 T325 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 140508 T325 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 140526 T325 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 140526 T325 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 140526 T325 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 140534 T413 oasc.SolrCore.registerSearcher [delLiveColl_shard1_replica2] Registered new searcher Searcher@4f66c2[delLiveColl_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 140542 T325 oasc.CoreContainer.registerCore registering core: delLiveColl_shard1_replica2
   [junit4]   2> 140543 T325 oasc.ZkController.register Register replica - core:delLiveColl_shard1_replica2 address:http://127.0.0.1:60797/au_e collection:delLiveColl shard:shard1
   [junit4]   2> 140561 T325 oascc.SolrZkClient.makePath makePath: /collections/delLiveColl/leader_elect/shard1/election
   [junit4]   2> 140567 T325 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 140568 T340 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 140569 T325 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=2.60572143E14ms
   [junit4]   2> 140577 T332 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 4 
   [junit4]   2> 140580 T332 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/delLiveColl/state.json
   [junit4]   2> 140580 T385 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140580 T340 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140580 T400 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140581 T385 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 
   [junit4]   2> 140580 T370 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/delLiveColl/state.json, has occurred - updating... 
   [junit4]   2> 140581 T400 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 
   [junit4]   2> 140582 T370 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 
   [junit4]   2> 140583 T340 oascc.ZkStateReader.updateWatchedCollection Updating data for delLiveColl to ver 5 
   [junit4]   2> 141166 T380 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica1
   [junit4]   2> 141166 T380 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
   [junit4]   2> 141167 T392 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard2_replica2
   [junit4]   2> 141167 T380 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 141167 T392 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
   [junit4]   2> 141167 T380 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
   [junit4]   2> 141168 T392 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 141168 T362 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for delLiveColl_shard1_replica1
   [junit4]   2> 141169 T380 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 141169 T392 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
   [junit4]   2> 141170 T380 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-005/delLiveColl_shard2_replica1/'
   [junit4]   2> 141169 T362 oasc.ZkController.createCollectionZkNode Check for collection zkNode:delLiveColl
   [junit4]   2> 141171 T392 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 141172 T362 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 141172 T362 oascc.ZkStateReader.readConfigName Load collection config from:/collections/delLiveColl
   [junit4]   2> 141172 T392 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-006/delLiveColl_shard2_replica2/'
   [junit4]   2> 141173 T362 oascc.ZkStateReader.readConfigName path=/collections/delLiveColl configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 141174 T362 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.DeleteReplicaTest-4FE08E3460AF700C-001/tempDir-004/delLiveColl_shard1_replica1/'
   [junit4]   2> 141210 T380 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 141226 T392 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 141249 T380 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 141250 T362 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 141251 T380 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 141252 T392 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 141253 T392 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 141256 T380 oass.IndexSchema.readSchema [delLiveColl_shard2_replica1] Schema name=test
   [junit4]   2> 141259 T392 oass.IndexSchema.readSchema [delLiveColl_shard2_replica2] Schema name=test
   [junit4]   2> 141277 T362 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 141278 T362 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 141481 T362 oass.IndexSchema.readSchema [delLiveColl_shard1_replica1] Schema name=test
   [junit4]   2> 141644 T380 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 141650 T392 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 141650 T380 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 141652 T380 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 141665 T392 oass.IndexSchema.readSchema default search field in schema is text
   [ju

[...truncated too long message...]

650 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:53259_
   [junit4]   2> 637015 T1650 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 637016 T1650 oasc.Overseer.start Overseer (id=92535824171532297-127.0.0.1:53259_-n_0000000002) starting
   [junit4]   2> 637020 T1650 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 637020 T1652 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 637021 T1651 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 638515 T1607 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 638538 T1561 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 643528 T1561 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 53259
   [junit4]   2> 643528 T1561 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=22159798
   [junit4]   2> 643529 T1561 oasc.Overseer.close Overseer (id=92535824171532297-127.0.0.1:53259_-n_0000000002) closing
   [junit4]   2> 643530 T1651 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:53259_
   [junit4]   2> 643531 T1650 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 643554 T1561 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 648545 T1561 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 648546 T1561 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45328 45328
   [junit4]   2> 649091 T1562 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45328 45328
   [junit4]   2> 649192 T1625 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1b290d rejected from java.util.concurrent.ThreadPoolExecutor@11e8bae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 4]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 649192 T1625 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13ba761 name:ZooKeeperConnection Watcher:127.0.0.1:45328/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
   [junit4]   2> 649192 T1625 oascc.ConnectionManager.process Client->ZooKeeper status change trigger but we are already closed
   [junit4]   2> 649192 T1625 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@1ccc337 rejected from java.util.concurrent.ThreadPoolExecutor@11e8bae[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 4]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2047)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:823)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1369)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:263)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=DeleteLastCustomShardedReplicaTest -Dtests.method=testDistribSearch -Dtests.seed=4FE08E3460AF700C -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=America/Santarem -Dtests.file.encoding=UTF-8
   [junit4] ERROR    129s J1 | DeleteLastCustomShardedReplicaTest.testDistribSearch <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:54590, http://127.0.0.1:38802, http://127.0.0.1:53259]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4FE08E3460AF700C:CE06002C17F01030]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
   [junit4]    > 	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.removeAndWaitForLastReplicaGone(DeleteLastCustomShardedReplicaTest.java:117)
   [junit4]    > 	at org.apache.solr.cloud.DeleteLastCustomShardedReplicaTest.doTest(DeleteLastCustomShardedReplicaTest.java:107)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not  remove replica : customcollreplicadeletion/a/core_node1
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:568)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
   [junit4]    > 	... 46 more
   [junit4]   2> 649208 T1561 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.DeleteLastCustomShardedReplicaTest-4FE08E3460AF700C-001
   [junit4]   2> 129021 T1560 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=en_IN, timezone=America/Santarem
   [junit4]   2> NOTE: Linux 3.13.0-36-generic i386/Oracle Corporation 1.8.0_20 (32-bit)/cpus=8,threads=1,free=49851024,total=186036224
   [junit4]   2> NOTE: All tests run in this JVM: [StatsComponentTest, HdfsBasicDistributedZk2Test, ChangedSchemaMergeTest, AnalysisAfterCoreReloadTest, TestCustomSort, TestRandomMergePolicy, BasicZkTest, BasicDistributedZk2Test, TestCharFilters, ConvertedLegacyTest, SharedFSAutoReplicaFailoverUtilsTest, CustomCollectionTest, OverseerStatusTest, TestAtomicUpdateErrorCases, TestManagedStopFilterFactory, TestBadConfig, CacheHeaderTest, DeleteInactiveReplicaTest, DistributedQueryComponentCustomSortTest, TestNonNRTOpen, TestBlendedInfixSuggestions, TestValueSourceCache, TestSerializedLuceneMatchVersion, RAMDirectoryFactoryTest, MigrateRouteKeyTest, PolyFieldTest, TestInfoStreamLogging, TestNRTOpen, OutputWriterTest, UUIDFieldTest, TestLFUCache, HardAutoCommitTest, TestIBSimilarityFactory, FieldAnalysisRequestHandlerTest, URLClassifyProcessorTest, PreAnalyzedUpdateProcessorTest, CachingDirectoryFactoryTest, TestSchemaVersionResource, UpdateRequestProcessorFactoryTest, TestMissingGroups, TestFreeTextSuggestions, TestJmxMonitoredMap, DeleteLastCustomShardedReplicaTest]
   [junit4] Completed on J1 in 129.30s, 1 test, 1 error <<< FAILURES!

[...truncated 1127 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1360: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 2 errors, 45 ignored (23 assumptions)

Total time: 104 minutes 6 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20 -server -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Linux (64bit/jdk1.8.0_20) - Build # 11198 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11198/
Java: 64bit/jdk1.8.0_20 -XX:-UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.CloudExitableDirectoryReaderTest.testDistribSearch

Error Message:
no exception matching expected: 400: Request took too long during query expansion. Terminating request.

Stack Trace:
java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
	at __randomizedtesting.SeedInfo.seed([370D36ADAF140588:B6EBB8B5D84B65B4]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:81)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.core.ExitableDirectoryReaderTest.testPrefixQuery

Error Message:


Stack Trace:
java.lang.AssertionError: 
	at __randomizedtesting.SeedInfo.seed([370D36ADAF140588:845A02EFCBC9E10D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.assertQEx(SolrTestCaseJ4.java:850)
	at org.apache.solr.core.ExitableDirectoryReaderTest.testPrefixQuery(ExitableDirectoryReaderTest.java:67)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11245 lines...]
   [junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001
   [junit4]   2> 1024570 T2863 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
   [junit4]   2> 1024570 T2863 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /nwb/oy
   [junit4]   2> 1024574 T2863 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1024574 T2863 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1024575 T2864 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1024675 T2863 oasc.ZkTestServer.run start zk server on port:44263
   [junit4]   2> 1024675 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1024676 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1024678 T2870 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f6ec70 name:ZooKeeperConnection Watcher:127.0.0.1:44263 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1024678 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1024679 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1024679 T2863 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1024682 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1024683 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1024684 T2872 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6877d0f1 name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1024684 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1024684 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1024684 T2863 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1024686 T2863 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1024688 T2863 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1024689 T2863 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1024690 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1024690 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1024692 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1024692 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1024694 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1024694 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1024695 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1024696 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1024697 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1024697 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1024699 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1024699 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1024701 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1024702 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1024703 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1024704 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1024705 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1024706 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1024708 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1024708 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1024710 T2863 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1024710 T2863 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1024950 T2863 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1024953 T2863 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:33405
   [junit4]   2> 1024953 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1024954 T2863 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1024954 T2863 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002
   [junit4]   2> 1024954 T2863 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/'
   [junit4]   2> 1024973 T2863 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/solr.xml
   [junit4]   2> 1025016 T2863 oasc.CoreContainer.<init> New CoreContainer 1409066788
   [junit4]   2> 1025016 T2863 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/]
   [junit4]   2> 1025018 T2863 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1025018 T2863 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1025019 T2863 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1025019 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1025019 T2863 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1025020 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1025020 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1025020 T2863 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1025021 T2863 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1025021 T2863 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1025022 T2863 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1025022 T2863 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1025022 T2863 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1025023 T2863 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44263/solr
   [junit4]   2> 1025023 T2863 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1025024 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1025025 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1025027 T2883 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2ca7175e name:ZooKeeperConnection Watcher:127.0.0.1:44263 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1025028 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1025028 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1025030 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1025032 T2885 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6598a0c2 name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1025032 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1025034 T2863 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1025036 T2863 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1025038 T2863 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1025039 T2863 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1025041 T2863 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1025043 T2863 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1025044 T2863 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33405_nwb%2Foy
   [junit4]   2> 1025046 T2863 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33405_nwb%2Foy
   [junit4]   2> 1025047 T2863 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1025049 T2863 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1025050 T2863 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1025051 T2863 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33405_nwb%2Foy
   [junit4]   2> 1025052 T2863 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1025053 T2863 oasc.Overseer.start Overseer (id=92537678788165635-127.0.0.1:33405_nwb%2Foy-n_0000000000) starting
   [junit4]   2> 1025055 T2863 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1025059 T2863 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1025060 T2887 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1025060 T2863 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1025065 T2863 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1025066 T2863 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1025068 T2886 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1025074 T2889 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1025075 T2889 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1025076 T2889 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1025076 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1025078 T2886 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33405/nwb/oy",
   [junit4]   2> 	  "node_name":"127.0.0.1:33405_nwb%2Foy",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1025078 T2886 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1025078 T2886 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 1025079 T2886 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1025080 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1026076 T2889 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1026076 T2889 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1026077 T2889 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1026078 T2889 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1026079 T2889 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1026079 T2889 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/collection1/'
   [junit4]   2> 1026080 T2889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1026080 T2889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1026081 T2889 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1026122 T2889 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1026139 T2889 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1026140 T2889 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1026155 T2889 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1026274 T2889 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1026280 T2889 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1026282 T2889 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1026290 T2889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1026293 T2889 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1026296 T2889 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1026297 T2889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1026297 T2889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1026297 T2889 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1026298 T2889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1026298 T2889 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1026299 T2889 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1026299 T2889 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1026299 T2889 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/control/data/
   [junit4]   2> 1026300 T2889 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@56725786
   [junit4]   2> 1026300 T2889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/control/data
   [junit4]   2> 1026300 T2889 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/control/data/index/
   [junit4]   2> 1026301 T2889 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1026301 T2889 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/control/data/index
   [junit4]   2> 1026301 T2889 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1026302 T2889 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-5630999f)),segFN=segments_1,generation=1}
   [junit4]   2> 1026302 T2889 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1026317 T2889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1026317 T2889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1026318 T2889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1026318 T2889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1026318 T2889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1026318 T2889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1026319 T2889 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1026319 T2889 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1026319 T2889 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1026320 T2889 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1026320 T2889 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1026320 T2889 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1026321 T2889 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1026321 T2889 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1026321 T2889 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1026321 T2889 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1026322 T2889 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1026322 T2889 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1026322 T2889 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1026323 T2889 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1026325 T2889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1026326 T2889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1026327 T2889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1026328 T2889 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1026330 T2889 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1026330 T2889 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1026331 T2889 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1026331 T2889 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-5630999f)),segFN=segments_1,generation=1}
   [junit4]   2> 1026332 T2889 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1026332 T2889 oass.SolrIndexSearcher.<init> Opening Searcher@2d441340[collection1] main
   [junit4]   2> 1026332 T2889 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1026333 T2889 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1026333 T2889 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1026334 T2889 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1026334 T2889 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1026334 T2889 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1026334 T2889 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1026335 T2889 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1026335 T2889 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1026337 T2889 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1026337 T2889 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1026337 T2889 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1026339 T2891 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2d441340[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1026340 T2889 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1026341 T2894 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33405/nwb/oy collection:control_collection shard:shard1
   [junit4]   2> 1026341 T2863 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1026342 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1026342 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1026343 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1026343 T2894 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1026345 T2896 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4176119b name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1026345 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1026346 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1026347 T2863 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1026348 T2894 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1026349 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1026349 T2863 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1026349 T2894 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1026350 T2863 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 1026350 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1026350 T2894 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1431 name=collection1 org.apache.solr.core.SolrCore@382106c4 url=http://127.0.0.1:33405/nwb/oy/collection1 node=127.0.0.1:33405_nwb%2Foy C1431_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:33405/nwb/oy, node_name=127.0.0.1:33405_nwb%2Foy, state=down}
   [junit4]   2> 1026351 T2894 C1431 P33405 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33405/nwb/oy/collection1/
   [junit4]   2> 1026351 T2894 C1431 P33405 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1026351 T2894 C1431 P33405 oasc.SyncStrategy.syncToMe http://127.0.0.1:33405/nwb/oy/collection1/ has no replicas
   [junit4]   2> 1026351 T2894 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33405/nwb/oy/collection1/ shard1
   [junit4]   2> 1026352 T2894 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1026352 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1026361 T2898 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61c837c7 name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1026363 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1026363 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1026365 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1026369 T2886 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
   [junit4]   2> 1026369 T2886 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1026369 T2886 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1026370 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1026371 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
   [junit4]   2> 1026371 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1026375 T2899 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1026417 T2894 oasc.ZkController.register We are http://127.0.0.1:33405/nwb/oy/collection1/ and leader is http://127.0.0.1:33405/nwb/oy/collection1/
   [junit4]   2> 1026417 T2894 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33405/nwb/oy
   [junit4]   2> 1026417 T2894 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1026417 T2894 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1026418 T2894 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1026418 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1026421 T2886 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33405/nwb/oy",
   [junit4]   2> 	  "node_name":"127.0.0.1:33405_nwb%2Foy",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1026524 T2899 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1026524 T2890 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1026625 T2863 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1026626 T2863 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1026627 T2863 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:36610
   [junit4]   2> 1026628 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1026628 T2863 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1026629 T2863 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003
   [junit4]   2> 1026629 T2863 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/'
   [junit4]   2> 1026641 T2863 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/solr.xml
   [junit4]   2> 1026653 T2863 oasc.CoreContainer.<init> New CoreContainer 1938790409
   [junit4]   2> 1026654 T2863 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/]
   [junit4]   2> 1026654 T2863 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1026655 T2863 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1026655 T2863 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1026656 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1026656 T2863 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1026656 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1026657 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1026657 T2863 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1026657 T2863 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1026658 T2863 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1026658 T2863 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1026659 T2863 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1026659 T2863 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1026660 T2863 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44263/solr
   [junit4]   2> 1026660 T2863 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1026660 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1026661 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1026663 T2910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7ba778e1 name:ZooKeeperConnection Watcher:127.0.0.1:44263 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1026664 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1026664 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1026666 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1026670 T2912 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4a7412fc name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1026670 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1026674 T2863 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1027678 T2863 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36610_nwb%2Foy
   [junit4]   2> 1027680 T2863 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36610_nwb%2Foy
   [junit4]   2> 1027685 T2863 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1027693 T2914 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1027694 T2914 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1027696 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1027697 T2914 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1027697 T2914 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1027697 T2914 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1027699 T2914 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 1027699 T2886 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36610/nwb/oy",
   [junit4]   2> 	  "node_name":"127.0.0.1:36610_nwb%2Foy",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1027699 T2914 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1027702 T2886 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1027703 T2886 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1027707 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1027708 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1027708 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 1028700 T2914 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1028700 T2914 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1028701 T2914 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1028701 T2914 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1028702 T2914 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1028702 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/collection1/'
   [junit4]   2> 1028703 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1028703 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1028703 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1028725 T2914 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1028736 T2914 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1028738 T2914 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1028743 T2914 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1028862 T2914 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1028867 T2914 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1028869 T2914 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1028876 T2914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1028879 T2914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1028882 T2914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1028882 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1028883 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1028883 T2914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1028884 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1028884 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1028884 T2914 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1028884 T2914 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1028884 T2914 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty1/
   [junit4]   2> 1028885 T2914 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@56725786
   [junit4]   2> 1028885 T2914 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty1
   [junit4]   2> 1028886 T2914 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty1/index/
   [junit4]   2> 1028886 T2914 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1028886 T2914 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty1/index
   [junit4]   2> 1028886 T2914 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1028887 T2914 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-68bfab8e)),segFN=segments_1,generation=1}
   [junit4]   2> 1028887 T2914 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1028890 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1028891 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1028891 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1028891 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1028891 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1028892 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1028892 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1028892 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1028892 T2914 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1028893 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1028893 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1028894 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1028894 T2914 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1028895 T2914 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1028895 T2914 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1028895 T2914 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1028895 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1028896 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1028896 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1028897 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1028899 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1028900 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1028901 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1028902 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1028905 T2914 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1028905 T2914 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1028905 T2914 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1028906 T2914 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-68bfab8e)),segFN=segments_1,generation=1}
   [junit4]   2> 1028906 T2914 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1028906 T2914 oass.SolrIndexSearcher.<init> Opening Searcher@3aef7867[collection1] main
   [junit4]   2> 1028906 T2914 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1028907 T2914 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1028907 T2914 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1028908 T2914 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1028908 T2914 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1028908 T2914 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1028909 T2914 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1028909 T2914 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1028909 T2914 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1028909 T2914 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1028912 T2915 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3aef7867[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1028914 T2914 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1028914 T2918 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36610/nwb/oy collection:collection1 shard:shard2
   [junit4]   2> 1028915 T2863 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1028915 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1028915 T2918 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1028918 T2918 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1028919 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1028919 T2918 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1028919 T2918 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1432 name=collection1 org.apache.solr.core.SolrCore@7284ee25 url=http://127.0.0.1:36610/nwb/oy/collection1 node=127.0.0.1:36610_nwb%2Foy C1432_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:36610/nwb/oy, node_name=127.0.0.1:36610_nwb%2Foy, state=down}
   [junit4]   2> 1028919 T2918 C1432 P36610 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36610/nwb/oy/collection1/
   [junit4]   2> 1028920 T2918 C1432 P36610 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1028920 T2918 C1432 P36610 oasc.SyncStrategy.syncToMe http://127.0.0.1:36610/nwb/oy/collection1/ has no replicas
   [junit4]   2> 1028920 T2918 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36610/nwb/oy/collection1/ shard2
   [junit4]   2> 1028920 T2918 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1028922 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1028923 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1028923 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 1028930 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1028931 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1028931 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1028932 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1028978 T2918 oasc.ZkController.register We are http://127.0.0.1:36610/nwb/oy/collection1/ and leader is http://127.0.0.1:36610/nwb/oy/collection1/
   [junit4]   2> 1028978 T2918 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36610/nwb/oy
   [junit4]   2> 1028978 T2918 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1028978 T2918 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1028978 T2918 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1028979 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1028981 T2918 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1028981 T2886 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36610/nwb/oy",
   [junit4]   2> 	  "node_name":"127.0.0.1:36610_nwb%2Foy",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1028984 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1028985 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1028985 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1029165 T2863 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1029166 T2863 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1029168 T2863 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:48795
   [junit4]   2> 1029169 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1029170 T2863 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1029170 T2863 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004
   [junit4]   2> 1029170 T2863 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/'
   [junit4]   2> 1029182 T2863 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/solr.xml
   [junit4]   2> 1029194 T2863 oasc.CoreContainer.<init> New CoreContainer 601869893
   [junit4]   2> 1029194 T2863 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/]
   [junit4]   2> 1029195 T2863 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1029195 T2863 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1029196 T2863 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1029196 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1029196 T2863 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1029197 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1029197 T2863 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1029198 T2863 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1029198 T2863 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1029198 T2863 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1029199 T2863 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1029199 T2863 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1029200 T2863 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1029200 T2863 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44263/solr
   [junit4]   2> 1029200 T2863 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1029201 T2863 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1029202 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1029204 T2929 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@171c1121 name:ZooKeeperConnection Watcher:127.0.0.1:44263 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1029205 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1029205 T2863 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1029207 T2863 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1029209 T2931 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@561677d8 name:ZooKeeperConnection Watcher:127.0.0.1:44263/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1029209 T2863 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1029213 T2863 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1030216 T2863 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:48795_nwb%2Foy
   [junit4]   2> 1030217 T2863 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:48795_nwb%2Foy
   [junit4]   2> 1030220 T2863 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1030224 T2933 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1030224 T2933 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1030225 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1030225 T2933 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1030225 T2933 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1030225 T2933 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1030226 T2933 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1030226 T2886 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:48795/nwb/oy",
   [junit4]   2> 	  "node_name":"127.0.0.1:48795_nwb%2Foy",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1030226 T2933 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1030228 T2886 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1030229 T2886 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1030232 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1030232 T2932 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1030232 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1030232 T2932 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1030232 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1031227 T2933 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1031227 T2933 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1031228 T2933 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1031228 T2933 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1031230 T2933 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1031230 T2933 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/collection1/'
   [junit4]   2> 1031231 T2933 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1031231 T2933 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1031232 T2933 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1031260 T2933 oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.0.0
   [junit4]   2> 1031271 T2933 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1031272 T2933 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1031277 T2933 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1031380 T2933 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1031385 T2933 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1031387 T2933 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1031395 T2933 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1031398 T2933 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1031400 T2933 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1031401 T2933 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1031401 T2933 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1031401 T2933 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1031402 T2933 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1031402 T2933 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1031402 T2933 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1031403 T2933 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1031403 T2933 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty2/
   [junit4]   2> 1031403 T2933 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@56725786
   [junit4]   2> 1031404 T2933 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty2
   [junit4]   2> 1031405 T2933 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty2/index/
   [junit4]   2> 1031405 T2933 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1031405 T2933 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-370D36ADAF140588-001/tempDir-001/jetty2/index
   [junit4]   2> 1031406 T2933 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1031406 T2933 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-18264112)),segFN=segments_1,generation=1}
   [junit4]   2> 1031406 T2933 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1031409 T2933 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1031410 T2933 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1031410 T2933 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1031410 T2933 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1031410 T2933 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1031411 T2933 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1031411 T2933 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1031411 T2933 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1031411 T2933 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1031412 T2933 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1031412 T2933 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1031413 T2933 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1031413 T2933 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1031414 T2933 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1031414 T2933 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1031414 T2933 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1031414 T2933 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1031415 T2933 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1031415 T2933 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1031416 T2933 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1031418 T2933 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031419 T2933 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031420 T2933 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031420 T2933 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1031422 T2933 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1031422 T2933 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1031423 T2933 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1031423 T2933 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=BaseDirectoryWrapper(RAMDirectory(id=lucene-18264112)),segFN=segments_1,generation=1}
   [junit4]   2> 1031424 T2933 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1031424 T2933 oass.SolrIndexSearcher.<init> Opening Searcher@915b1f9[collection1] main
   [junit4]   2> 1031424 T2933 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1031425 T2933 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1031425 T2933 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1031426 T2933 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1031426 T2933 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1031426 T2933 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1031427 T2933 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1031427 T2933 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1031427 T2933 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1031427 T2933 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1031430 T2934 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@915b1f9[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1031432 T2933 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1031433 T2937 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:48795/nwb/oy collection:collection1 shard:shard1
   [junit4]   2> 1031433 T2863 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1031433 T2937 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1031433 T2863 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1031436 T2937 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1031437 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1031437 T2937 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1031437 T2937 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1433 name=collection1 org.apache.solr.core.SolrCore@4f544ad9 url=http://127.0.0.1:48795/nwb/oy/collection1 node=127.0.0.1:48795_nwb%2Foy C1433_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:48795/nwb/oy, node_name=127.0.0.1:48795_nwb%2Foy, state=down}
   [junit4]   2> 1031437 T2937 C1433 P48795 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:48795/nwb/oy/collection1/
   [junit4]   2> 1031437 T2937 C1433 P48795 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1031438 T2937 C1433 P48795 oasc.SyncStrategy.syncToMe http://127.0.0.1:48795/nwb/oy/collection1/ has no replicas
   [junit4]   2> 1031438 T2937 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:48795/nwb/oy/collection1/ shard1
   [junit4]   2> 1031438 T2937 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1031440 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1031440 T2932 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1031440 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1031441 T2932 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 
   [junit4]   2> 1031441 T2913 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 
   [junit4]   2> 1031444 T2890 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1031444 T2886 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1031445 T2913 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1031445 T2932 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1031445 T2913 oascc.ZkStateReader.updateWatchedCollection Up

[...truncated too long message...]

 T7095 oas.SolrTestCaseJ4.setUp ###Starting testQueriesOnDocsWithMultipleTerms
   [junit4]   2> ASYNC  NEW_CORE C2576 name=collection1 org.apache.solr.core.SolrCore@3d281f2e
   [junit4]   2> 2414041 T7095 C2576 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=name:dummy&indent=true&timeAllowed=1000} hits=1999 status=0 QTime=8 
   [junit4]   2> 2414044 T7095 C2576 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=name:dummy&indent=true&timeAllowed=1000} hits=1999 status=0 QTime=1 
   [junit4]   2> 2414046 T7095 C2576 oashc.SearchHandler.handleRequestBody WARN Query: q=name:doc*&indent=true&timeAllowed=1; The request took too long to iterate over terms. Timeout: timeoutAt: 420656932096927 (System.nanoTime(): 420656932144039), TermsEnum=org.apache.lucene.codecs.memory.FSTOrdTermsReader$TermsReader$SegmentTermsEnum@1644905c
   [junit4]   2> 2414047 T7095 C2576 oasc.SolrException.log Ignoring exception matching .
   [junit4]   2> 2414047 T7095 C2576 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=name:doc*&indent=true&timeAllowed=1} status=400 QTime=2 
   [junit4]   2> 2414047 T7095 oas.SolrTestCaseJ4.tearDown ###Ending testQueriesOnDocsWithMultipleTerms
   [junit4]   2> 2414049 T7095 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 2414050 T7095 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=600627014
   [junit4]   2> 2414050 T7095 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@3d281f2e
   [junit4]   2> 2414050 T7095 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5997,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2414051 T7095 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2414051 T7095 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2414051 T7095 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2414052 T7095 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2414052 T7095 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2414052 T7095 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 2414053 T7095 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001/index
   [junit4]   2> 2414053 T7095 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001;done=false>>]
   [junit4]   2> 2414053 T7095 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001/init-core-data-001
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build/solr-core/test/J0/temp/solr.core.ExitableDirectoryReaderTest-370D36ADAF140588-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {name=FSTOrd41, id=FSTOrd41}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=be, timezone=NST
   [junit4]   2> NOTE: Linux 3.13.0-36-generic amd64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=8,threads=1,free=297231160,total=531628032
   [junit4]   2> NOTE: All tests run in this JVM: [OverseerCollectionProcessorTest, AddSchemaFieldsUpdateProcessorFactoryTest, ReturnFieldsTest, TestManagedResourceStorage, TestFastLRUCache, PeerSyncTest, SpellCheckCollatorTest, DeleteShardTest, IndexSchemaTest, TestRangeQuery, DocExpirationUpdateProcessorFactoryTest, TestReplicationHandler, IndexBasedSpellCheckerTest, TestLMDirichletSimilarityFactory, DistributedQueryComponentOptimizationTest, TestSortingResponseWriter, TestSolr4Spatial2, TestSolr4Spatial, TestPartialUpdateDeduplication, CoreAdminCreateDiscoverTest, BasicFunctionalityTest, TestStressReorder, TestRestManager, TestSolrDeletionPolicy1, TestStressVersions, TestQuerySenderListener, TestCloudSchemaless, TestHashPartitioner, SignatureUpdateProcessorFactoryTest, SystemInfoHandlerTest, TestSuggestSpellingConverter, DirectUpdateHandlerTest, TestImplicitCoreProperties, AssignTest, TestFastWriter, DocValuesMultiTest, VMParamsZkACLAndCredentialsProvidersTest, HdfsWriteToMultipleCollectionsTest, JsonLoaderTest, TestMaxScoreQueryParser, ShowFileRequestHandlerTest, WordBreakSolrSpellCheckerTest, HdfsLockFactoryTest, TestChildDocTransformer, BlockDirectoryTest, MinimalSchemaTest, TestBinaryResponseWriter, SpellingQueryConverterTest, DocumentBuilderTest, QueryEqualityTest, MBeansHandlerTest, TermsComponentTest, TestConfig, TestFieldTypeCollectionResource, TestLMJelinekMercerSimilarityFactory, SSLMigrationTest, ClusterStateUpdateTest, DisMaxRequestHandlerTest, ZkCLITest, DistributedSuggestComponentTest, TestCodecSupport, SpellPossibilityIteratorTest, TimeZoneUtilsTest, SpellCheckComponentTest, DistributedFacetPivotLargeTest, TestFieldResource, FileUtilsTest, HighlighterMaxOffsetTest, TestReplicationHandlerBackup, TestFuzzyAnalyzedSuggestions, TestCollationFieldDocValues, DocumentAnalysisRequestHandlerTest, FieldMutatingUpdateProcessorTest, TestRequestStatusCollectionAPI, TestSystemIdResolver, BadComponentTest, TestDistribDocBasedVersion, CollectionsAPIAsyncDistributedZkTest, TestAddFieldRealTimeGet, ShardRoutingTest, TestRTGBase, TestRecoveryHdfs, LeaderElectionTest, TestModifyConfFiles, PrimitiveFieldTypeTest, PluginInfoTest, StressHdfsTest, TestManagedSynonymFilterFactory, EchoParamsTest, TestHighFrequencyDictionaryFactory, RecoveryZkTest, OverseerTest, TestFaceting, AliasIntegrationTest, TestDFRSimilarityFactory, TestSolrJ, TestHighlightDedupGrouping, TestConfigSets, BJQParserTest, TestLeaderElectionZkExpiry, NotRequiredUniqueKeyTest, TestTrie, SuggesterWFSTTest, TestSurroundQueryParser, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, ZkSolrClientTest, TestZkChroot, TestRandomDVFaceting, TestDistributedSearch, ZkControllerTest, TestRealTimeGet, TestJoin, TestReload, TestCoreContainer, SimpleFacetsTest, SolrCmdDistributorTest, QueryElevationComponentTest, BadIndexSchemaTest, TestSort, HighlighterTest, SimplePostToolTest, TestCoreDiscovery, CoreAdminHandlerTest, SpatialFilterTest, NoCacheHeaderTest, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, FileBasedSpellCheckerTest, RequestHandlersTest, TestIndexingPerformance, RequiredFieldsTest, TestArbitraryIndexDir, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, TestCollationField, JSONWriterTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, PingRequestHandlerTest, TestComponentsName, HighlighterConfigTest, UpdateParamsTest, TestSolrIndexConfig, CopyFieldTest, TestStressRecovery, DOMUtilTest, RAMDirectoryFactoryTest, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, CursorPagingTest, DistributedIntervalFacetingTest, DeleteLastCustomShardedReplicaTest, DistribDocExpirationUpdateProcessorTest, OverseerStatusTest, ReplicationFactorTest, RollingRestartTest, SharedFSAutoReplicaFailoverTest, SharedFSAutoReplicaFailoverUtilsTest, SolrXmlInZkTest, TestCloudInspectUtil, TestCloudPivotFacet, TestCollectionAPI, TestShortCircuitedRequests, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest, HdfsSyncSliceTest, CachingDirectoryFactoryTest, ExitableDirectoryReaderTest]
   [junit4] Completed on J0 in 3.64s, 2 tests, 1 failure <<< FAILURES!

[...truncated 191 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1360: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:962: There were test failures: 431 suites, 1778 tests, 2 failures, 45 ignored (23 assumptions)

Total time: 96 minutes 14 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0_20 -XX:-UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.8.0_40-ea-b04) - Build # 11197 - Still Failing!

Posted by Alan Woodward <al...@flax.co.uk>.
Bah, I'll fix

Alan Woodward
www.flax.co.uk


On 29 Sep 2014, at 16:07, Policeman Jenkins Server wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11197/
> Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC
> 
> All tests passed
> 
> Build Log:
> [...truncated 4413 lines...]
>    [javac] Compiling 2 source files to /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/memory/classes/test
>    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:434: error: incompatible types: IndexableField cannot be converted to Field
>    [javac]       for (Field field : nextDoc.getFields()) {
>    [javac]                                           ^
>    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:445: error: cannot find symbol
>    [javac]       for (IndexableField field : doc.indexableFields()) {
>    [javac]                                      ^
>    [javac]   symbol:   method indexableFields()
>    [javac]   location: variable doc of type Document
>    [javac] Note: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java uses or overrides a deprecated API.
>    [javac] Note: Recompile with -Xlint:deprecation for details.
>    [javac] 2 errors
> 
> BUILD FAILED
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build.xml:447: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:2142: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/module-build.xml:55: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:785: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:799: The following error occurred while executing this line:
> /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1867: Compile failed; see the compiler error output for details.
> 
> Total time: 32 minutes 32 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.8.0_40-ea-b04) - Build # 11197 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11197/
Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC

All tests passed

Build Log:
[...truncated 4413 lines...]
    [javac] Compiling 2 source files to /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/memory/classes/test
    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:434: error: incompatible types: IndexableField cannot be converted to Field
    [javac]       for (Field field : nextDoc.getFields()) {
    [javac]                                           ^
    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:445: error: cannot find symbol
    [javac]       for (IndexableField field : doc.indexableFields()) {
    [javac]                                      ^
    [javac]   symbol:   method indexableFields()
    [javac]   location: variable doc of type Document
    [javac] Note: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java uses or overrides a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 2 errors

BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:2142: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/module-build.xml:55: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:785: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:799: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1867: Compile failed; see the compiler error output for details.

Total time: 32 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-5.x-Linux (32bit/jdk1.8.0_40-ea-b04) - Build # 11196 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-5.x-Linux/11196/
Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseParallelGC

All tests passed

Build Log:
[...truncated 4491 lines...]
    [javac] Compiling 2 source files to /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build/memory/classes/test
    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:434: error: incompatible types: IndexableField cannot be converted to Field
    [javac]       for (Field field : nextDoc.getFields()) {
    [javac]                                           ^
    [javac] /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java:445: error: cannot find symbol
    [javac]       for (IndexableField field : doc.indexableFields()) {
    [javac]                                      ^
    [javac]   symbol:   method indexableFields()
    [javac]   location: variable doc of type Document
    [javac] Note: /mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/memory/src/test/org/apache/lucene/index/memory/TestMemoryIndexAgainstRAMDir.java uses or overrides a deprecated API.
    [javac] Note: Recompile with -Xlint:deprecation for details.
    [javac] 2 errors

BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:2142: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/module-build.xml:55: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:785: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:799: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-5.x-Linux/lucene/common-build.xml:1867: Compile failed; see the compiler error output for details.

Total time: 29 minutes 42 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any