You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2014/05/28 12:18:13 UTC
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 565 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/565/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 139 from http://127.0.0.1:54202/collection1lastClient and got 127 from http://127.0.0.1:54212/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 139 from http://127.0.0.1:54202/collection1lastClient and got 127 from http://127.0.0.1:54212/collection1
at __randomizedtesting.SeedInfo.seed([3FEBD884E954E55E:BE0D569C9E0B8562]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1131)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1110)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:724)
REGRESSION: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testDistribSearch
Error Message:
IOException occured when talking to server at: http://127.0.0.1:45229/ddge/collection1
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:45229/ddge/collection1
at __randomizedtesting.SeedInfo.seed([3FEBD884E954E55E:BE0D569C9E0B8562]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:566)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:223)
at org.apache.solr.cloud.CloudInspectUtil.compareResults(CloudInspectUtil.java:165)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrServer(FullSolrCloudDistribCmdsTest.java:415)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.doTest(FullSolrCloudDistribCmdsTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:724)
Caused by: java.net.SocketException: Broken pipe
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:109)
at java.net.SocketOutputStream.write(SocketOutputStream.java:153)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.flushBuffer(AbstractSessionOutputBuffer.java:159)
at org.apache.http.impl.io.AbstractSessionOutputBuffer.writeLine(AbstractSessionOutputBuffer.java:258)
at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:59)
at org.apache.http.impl.io.HttpRequestWriter.writeHeadLine(HttpRequestWriter.java:46)
at org.apache.http.impl.io.AbstractMessageWriter.write(AbstractMessageWriter.java:109)
at org.apache.http.impl.AbstractHttpClientConnection.sendRequestHeader(AbstractHttpClientConnection.java:254)
at org.apache.http.impl.conn.DefaultClientConnection.sendRequestHeader(DefaultClientConnection.java:270)
at org.apache.http.impl.conn.ManagedClientConnectionImpl.sendRequestHeader(ManagedClientConnectionImpl.java:209)
at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:203)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:121)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:452)
... 49 more
Build Log:
[...truncated 11572 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/init-core-data-001
[junit4] 2> 1769659 T6021 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (true)
[junit4] 2> 1769660 T6021 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 1769666 T6021 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1769667 T6021 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1769668 T6022 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1769769 T6021 oasc.ZkTestServer.run start zk server on port:54192
[junit4] 2> 1769769 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1769773 T6028 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55a9323a name:ZooKeeperConnection Watcher:127.0.0.1:54192 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1769773 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1769774 T6021 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1769786 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1769788 T6030 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d89a771 name:ZooKeeperConnection Watcher:127.0.0.1:54192/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1769788 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1769788 T6021 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1769799 T6021 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1769801 T6021 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1769803 T6021 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1769805 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1769806 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1769810 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1769811 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1769940 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1769940 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1769952 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1769952 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1769955 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1769956 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1769958 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1769959 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1769961 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1769962 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1769969 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1769969 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1769972 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1769972 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1769975 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1769975 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1769982 T6021 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1769983 T6021 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1771110 T6021 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1771116 T6021 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54195
[junit4] 2> 1771117 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1771117 T6021 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1771117 T6021 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002
[junit4] 2> 1771118 T6021 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/'
[junit4] 2> 1771146 T6021 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/solr.xml
[junit4] 2> 1771215 T6021 oasc.CoreContainer.<init> New CoreContainer 1223736290
[junit4] 2> 1771216 T6021 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/]
[junit4] 2> 1771217 T6021 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1771217 T6021 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1771218 T6021 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1771218 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1771218 T6021 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1771218 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1771219 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1771219 T6021 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1771219 T6021 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1771220 T6021 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1771220 T6021 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1771220 T6021 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1771221 T6021 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54192/solr
[junit4] 2> 1771221 T6021 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1771222 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1771225 T6041 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@34bf17d7 name:ZooKeeperConnection Watcher:127.0.0.1:54192 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1771225 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1771237 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1771238 T6043 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@624d508a name:ZooKeeperConnection Watcher:127.0.0.1:54192/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1771238 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1771240 T6021 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1771249 T6021 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1771252 T6021 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1771255 T6021 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1771258 T6021 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1771260 T6021 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1771262 T6021 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54195_
[junit4] 2> 1771263 T6021 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54195_
[junit4] 2> 1771265 T6021 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1771267 T6021 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1771281 T6021 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54195_
[junit4] 2> 1771281 T6021 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1771283 T6021 oasc.Overseer.start Overseer (id=91833494912237571-127.0.0.1:54195_-n_0000000000) starting
[junit4] 2> 1771286 T6021 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1771294 T6045 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1771295 T6021 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1771296 T6021 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1771297 T6021 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1771299 T6044 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1771304 T6046 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1771304 T6046 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1771305 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1771305 T6046 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1771306 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1771306 T6044 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54195",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54195_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1771307 T6044 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1771307 T6044 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1771309 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1771309 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1772307 T6046 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1772307 T6046 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1772308 T6046 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1772308 T6046 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1772309 T6046 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1772309 T6046 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/collection1/'
[junit4] 2> 1772311 T6046 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 1772312 T6046 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 1772313 T6046 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 1772406 T6046 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1772480 T6046 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1772581 T6046 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1772591 T6046 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1773131 T6046 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1773135 T6046 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1773137 T6046 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1773142 T6046 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1773159 T6046 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1773159 T6046 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1773159 T6046 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/
[junit4] 2> 1773160 T6046 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e822d9b
[junit4] 2> 1773162 T6046 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data
[junit4] 2> 1773163 T6046 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/index/
[junit4] 2> 1773164 T6046 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1773165 T6046 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/index
[junit4] 2> 1773166 T6046 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=0.662109375, floorSegmentMB=0.3896484375, forceMergeDeletesPctAllowed=7.731708872881622, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1773171 T6046 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1773172 T6046 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1773177 T6046 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1773178 T6046 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1773178 T6046 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1773178 T6046 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1773179 T6046 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1773179 T6046 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1773180 T6046 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1773180 T6046 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1773180 T6046 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1773181 T6046 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1773181 T6046 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1773182 T6046 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1773182 T6046 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1773183 T6046 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1773183 T6046 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1773184 T6046 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1773184 T6046 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1773202 T6046 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1773207 T6046 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1773207 T6046 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1773208 T6046 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=64.755859375, floorSegmentMB=0.7509765625, forceMergeDeletesPctAllowed=11.275675692535357, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1773210 T6046 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1773210 T6046 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1773210 T6046 oass.SolrIndexSearcher.<init> Opening Searcher@779d0e67[collection1] main
[junit4] 2> 1773211 T6046 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1773212 T6046 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1773212 T6046 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1773212 T6046 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1773213 T6046 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1773213 T6046 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1773213 T6046 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1773214 T6046 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1773214 T6046 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1773214 T6046 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1773218 T6047 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@779d0e67[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1773221 T6046 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1773222 T6050 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54195 collection:control_collection shard:shard1
[junit4] 2> 1773222 T6021 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1773222 T6050 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1773222 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1773224 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1773234 T6052 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39b727b3 name:ZooKeeperConnection Watcher:127.0.0.1:54192/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1773234 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1773235 T6021 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1773245 T6050 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1773245 T6021 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1773253 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773253 T6050 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1773253 T6050 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1668 name=collection1 org.apache.solr.core.SolrCore@68af4f3d url=http://127.0.0.1:54195/collection1 node=127.0.0.1:54195_ C1668_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:54195, core=collection1, node_name=127.0.0.1:54195_}
[junit4] 2> 1773254 T6050 C1668 P54195 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54195/collection1/
[junit4] 2> 1773254 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1773254 T6050 C1668 P54195 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1773255 T6050 C1668 P54195 oasc.SyncStrategy.syncToMe http://127.0.0.1:54195/collection1/ has no replicas
[junit4] 2> 1773255 T6050 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54195/collection1/ shard1
[junit4] 2> 1773255 T6050 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1773264 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773271 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1773271 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1773282 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773282 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1773285 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773388 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1773388 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1773435 T6050 oasc.ZkController.register We are http://127.0.0.1:54195/collection1/ and leader is http://127.0.0.1:54195/collection1/
[junit4] 2> 1773435 T6050 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54195
[junit4] 2> 1773435 T6050 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1773435 T6050 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1773436 T6050 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1773437 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773437 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773438 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773437 T6050 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1773438 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1773439 T6044 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:54195",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54195_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1773447 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1773556 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1773556 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1774273 T6021 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1774274 T6021 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1774277 T6021 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54199
[junit4] 2> 1774277 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1774278 T6021 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1774278 T6021 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003
[junit4] 2> 1774278 T6021 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/'
[junit4] 2> 1774307 T6021 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/solr.xml
[junit4] 2> 1774375 T6021 oasc.CoreContainer.<init> New CoreContainer 1166546068
[junit4] 2> 1774376 T6021 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/]
[junit4] 2> 1774377 T6021 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1774378 T6021 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1774378 T6021 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1774378 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1774378 T6021 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1774379 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1774379 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1774379 T6021 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1774380 T6021 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1774380 T6021 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1774380 T6021 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1774381 T6021 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1774381 T6021 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54192/solr
[junit4] 2> 1774381 T6021 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1774382 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1774385 T6063 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68ff2435 name:ZooKeeperConnection Watcher:127.0.0.1:54192 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1774385 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1774401 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1774403 T6065 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48667608 name:ZooKeeperConnection Watcher:127.0.0.1:54192/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1774403 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1774410 T6021 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1775412 T6021 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54199_
[junit4] 2> 1775413 T6021 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54199_
[junit4] 2> 1775433 T6066 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1775434 T6066 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1775435 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1775435 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1775436 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1775435 T6066 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1775437 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1775437 T6044 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54199",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54199_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1775437 T6044 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1775438 T6044 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1775446 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1775447 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1775447 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1775447 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1776437 T6066 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1776437 T6066 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1776438 T6066 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1776438 T6066 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1776439 T6066 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1776439 T6066 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/collection1/'
[junit4] 2> 1776440 T6066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 1776441 T6066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 1776442 T6066 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 1776518 T6066 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1776603 T6066 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1776704 T6066 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1776714 T6066 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1777260 T6066 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1777264 T6066 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1777267 T6066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1777272 T6066 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1777288 T6066 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1777289 T6066 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1777289 T6066 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/
[junit4] 2> 1777289 T6066 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e822d9b
[junit4] 2> 1777291 T6066 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1
[junit4] 2> 1777292 T6066 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/index/
[junit4] 2> 1777293 T6066 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1777295 T6066 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/index
[junit4] 2> 1777295 T6066 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=0.662109375, floorSegmentMB=0.3896484375, forceMergeDeletesPctAllowed=7.731708872881622, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1777300 T6066 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1777300 T6066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1777307 T6066 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1777307 T6066 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1777308 T6066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1777308 T6066 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1777308 T6066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1777308 T6066 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1777309 T6066 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1777309 T6066 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1777310 T6066 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1777310 T6066 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1777311 T6066 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1777311 T6066 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1777312 T6066 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1777312 T6066 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1777313 T6066 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1777314 T6066 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1777314 T6066 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1777333 T6066 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1777337 T6066 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1777337 T6066 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1777339 T6066 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=64.755859375, floorSegmentMB=0.7509765625, forceMergeDeletesPctAllowed=11.275675692535357, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1777340 T6066 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1777341 T6066 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1777341 T6066 oass.SolrIndexSearcher.<init> Opening Searcher@6acf99bf[collection1] main
[junit4] 2> 1777341 T6066 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1777342 T6066 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1777343 T6066 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1777343 T6066 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1777343 T6066 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1777344 T6066 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1777344 T6066 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1777344 T6066 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1777345 T6066 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1777345 T6066 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1777349 T6067 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6acf99bf[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1777353 T6066 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1777354 T6070 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54199 collection:collection1 shard:shard1
[junit4] 2> 1777354 T6021 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1777355 T6070 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1777355 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1777475 T6070 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1777506 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777506 T6070 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1777507 T6070 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1669 name=collection1 org.apache.solr.core.SolrCore@4d0a5d89 url=http://127.0.0.1:54199/collection1 node=127.0.0.1:54199_ C1669_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54199, core=collection1, node_name=127.0.0.1:54199_}
[junit4] 2> 1777507 T6070 C1669 P54199 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54199/collection1/
[junit4] 2> 1777507 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1777507 T6070 C1669 P54199 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1777508 T6070 C1669 P54199 oasc.SyncStrategy.syncToMe http://127.0.0.1:54199/collection1/ has no replicas
[junit4] 2> 1777508 T6070 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54199/collection1/ shard1
[junit4] 2> 1777508 T6070 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1777527 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777559 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777559 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777559 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777592 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777593 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1777600 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777704 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777704 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777704 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777745 T6070 oasc.ZkController.register We are http://127.0.0.1:54199/collection1/ and leader is http://127.0.0.1:54199/collection1/
[junit4] 2> 1777745 T6070 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54199
[junit4] 2> 1777745 T6070 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1777745 T6070 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1777745 T6070 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1777747 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777747 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777747 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777747 T6070 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1777748 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1777748 T6044 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:54199",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54199_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1777761 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1777863 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777863 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1777863 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1778504 T6021 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1778505 T6021 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1778508 T6021 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:54202
[junit4] 2> 1778508 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1778508 T6021 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1778509 T6021 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004
[junit4] 2> 1778509 T6021 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/'
[junit4] 2> 1778538 T6021 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/solr.xml
[junit4] 2> 1778607 T6021 oasc.CoreContainer.<init> New CoreContainer 586165786
[junit4] 2> 1778607 T6021 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/]
[junit4] 2> 1778608 T6021 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1778609 T6021 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1778609 T6021 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1778609 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1778610 T6021 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1778610 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1778610 T6021 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1778610 T6021 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1778611 T6021 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1778611 T6021 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1778612 T6021 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1778612 T6021 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1778612 T6021 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:54192/solr
[junit4] 2> 1778613 T6021 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1778613 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1778641 T6081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4662bee1 name:ZooKeeperConnection Watcher:127.0.0.1:54192 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1778642 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1778656 T6021 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1778658 T6083 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2465596 name:ZooKeeperConnection Watcher:127.0.0.1:54192/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1778658 T6021 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1778679 T6021 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1779682 T6021 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54202_
[junit4] 2> 1779684 T6021 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54202_
[junit4] 2> 1779705 T6084 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1779705 T6084 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1779707 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1779707 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1779707 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1779707 T6084 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1779708 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1779709 T6044 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:54202",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54202_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1779709 T6044 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1779709 T6044 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1779712 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1779713 T6083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1779713 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1779713 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1779713 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1780709 T6084 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1780709 T6084 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1780710 T6084 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1780710 T6084 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1780710 T6084 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1780711 T6084 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/collection1/'
[junit4] 2> 1780713 T6084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 1780714 T6084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 1780715 T6084 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 1780793 T6084 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1780869 T6084 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1780970 T6084 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1780980 T6084 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1781522 T6084 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1781526 T6084 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1781528 T6084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1781533 T6084 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1781559 T6084 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1781559 T6084 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1781559 T6084 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/
[junit4] 2> 1781560 T6084 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7e822d9b
[junit4] 2> 1781561 T6084 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2
[junit4] 2> 1781562 T6084 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/index/
[junit4] 2> 1781563 T6084 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1781565 T6084 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/index
[junit4] 2> 1781565 T6084 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=0.662109375, floorSegmentMB=0.3896484375, forceMergeDeletesPctAllowed=7.731708872881622, segmentsPerTier=34.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1781570 T6084 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1781570 T6084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1781577 T6084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1781577 T6084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1781578 T6084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1781578 T6084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1781578 T6084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1781579 T6084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1781579 T6084 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1781580 T6084 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1781580 T6084 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1781581 T6084 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1781581 T6084 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1781581 T6084 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1781582 T6084 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1781583 T6084 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1781583 T6084 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1781584 T6084 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1781584 T6084 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1781603 T6084 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1781607 T6084 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1781608 T6084 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1781609 T6084 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=20, maxMergeAtOnceExplicit=19, maxMergedSegmentMB=64.755859375, floorSegmentMB=0.7509765625, forceMergeDeletesPctAllowed=11.275675692535357, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1781610 T6084 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.ChaosMonkeySafeLeaderTest-3FEBD884E954E55E-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1781611 T6084 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1781611 T6084 oass.SolrIndexSearcher.<init> Opening Searcher@3779325b[collection1] main
[junit4] 2> 1781611 T6084 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1781612 T6084 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1781612 T6084 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1781613 T6084 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1781613 T6084 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1781613 T6084 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1781614 T6084 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1781614 T6084 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1781614 T6084 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1781615 T6084 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1781619 T6085 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3779325b[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 1781623 T6084 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1781623 T6088 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54202 collection:collection1 shard:shard3
[junit4] 2> 1781624 T6021 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 1781624 T6088 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1781624 T6021 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1781639 T6088 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1781648 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1781648 T6088 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1781648 T6088 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1670 name=collection1 org.apache.solr.core.SolrCore@336f3043 url=http://127.0.0.1:54202/collection1 node=127.0.0.1:54202_ C1670_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:54202, core=collection1, node_name=127.0.0.1:54202_}
[junit4] 2> 1781649 T6088 C1670 P54202 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54202/collection1/
[junit4] 2> 1781649 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1781649 T6088 C1670 P54202 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1781650 T6088 C1670 P54202 oasc.SyncStrategy.syncToMe http://127.0.0.1:54202/collection1/ has no replicas
[junit4] 2> 1781650 T6088 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54202/collection1/ shard3
[junit4] 2> 1781650 T6088 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1781656 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1781657 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1781657 T6065 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1781657 T6052 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1781657 T6083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1781675 T6044 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1781678 T6043 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1781780 T6043 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1781780 T6083 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged
[...truncated too long message...]
n/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.FullSolrCloudDistribCmdsTest-3FEBD884E954E55E-001/tempDir-008/collection2_shard2_replica2/data/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.FullSolrCloudDistribCmdsTest-3FEBD884E954E55E-001/tempDir-008/collection2_shard2_replica2/data/index;done=false>>]
[junit4] 2> 2362660 T7916 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.FullSolrCloudDistribCmdsTest-3FEBD884E954E55E-001/tempDir-008/collection2_shard2_replica2/data/index
[junit4] 2> 2362660 T7916 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2362660 T7916 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard5/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2362661 T7916 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection2/leader_elect/shard7/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 2362662 T7916 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.FullSolrCloudDistribCmdsTest-3FEBD884E954E55E-001
[junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=29), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=29)), sim=DefaultSimilarity, locale=ar_SY, timezone=Kwajalein
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=1,free=120082096,total=477233152
[junit4] 2> NOTE: All tests run in this JVM: [TestLuceneMatchVersion, BasicFunctionalityTest, QueryElevationComponentTest, TestCollapseQParserPlugin, TestSurroundQueryParser, AbstractAnalyticsFacetTest, TestSolrXmlPersistor, TestConfig, SliceStateUpdateTest, TestDefaultSimilarityFactory, SolrXmlInZkTest, TestDocSet, TestHighlightDedupGrouping, DistributedQueryElevationComponentTest, TestSchemaVersionResource, SolrInfoMBeanTest, DistribCursorPagingTest, TestWriterPerf, TestUniqueKeyFieldResource, TestSearchPerf, TestCharFilters, StressHdfsTest, SpatialFilterTest, SpellingQueryConverterTest, BJQParserTest, TestShortCircuitedRequests, BinaryUpdateRequestHandlerTest, TestSolrQueryParserDefaultOperatorResource, TestPostingsSolrHighlighter, TestRemoteStreaming, TestCursorMarkWithoutUniqueKey, HdfsBasicDistributedZk2Test, FastVectorHighlighterTest, TestSuggestSpellingConverter, PrimitiveFieldTypeTest, TestFileDictionaryLookup, TestDefaultSearchFieldResource, ShowFileRequestHandlerTest, ResponseLogComponentTest, FieldFacetTest, StatelessScriptUpdateProcessorFactoryTest, TestRestManager, CopyFieldTest, TestOrdValues, MergeStrategyTest, SampleTest, DistributedQueryComponentCustomSortTest, AsyncMigrateRouteKeyTest, TestRequestStatusCollectionAPI, DistributedSuggestComponentTest, TestCloudManagedSchemaAddField, DocumentBuilderTest, SliceStateTest, SchemaVersionSpecificBehaviorTest, AliasIntegrationTest, CoreAdminHandlerTest, TestCloudManagedSchema, TestDistributedMissingSort, CSVRequestHandlerTest, TestFreeTextSuggestions, SoftAutoCommitTest, DirectUpdateHandlerOptimizeTest, CacheHeaderTest, TestLFUCache, EnumFieldTest, IndexSchemaTest, TestRealTimeGet, TestQueryUtils, PolyFieldTest, JsonLoaderTest, TestPerFieldSimilarity, TestFastLRUCache, BasicDistributedZkTest, BlockDirectoryTest, MigrateRouteKeyTest, TestCoreContainer, FieldMutatingUpdateProcessorTest, TestReversedWildcardFilterFactory, LukeRequestHandlerTest, FileBasedSpellCheckerTest, LeaderElectionTest, TestJoin, TestLMJelinekMercerSimilarityFactory, TestSchemaNameResource, TestDynamicFieldCollectionResource, SyncSliceTest, TestFunctionQuery, LoggingHandlerTest, TestCollationFieldDocValues, TestValueSourceCache, RankQueryTest, DeleteShardTest, TestImplicitCoreProperties, MultiThreadedOCPTest, DistribDocExpirationUpdateProcessorTest, RecoveryZkTest, BadComponentTest, TestMaxScoreQueryParser, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OverseerTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest]
[junit4] Completed on J0 in 149.98s, 1 test, 1 error <<< FAILURES!
[...truncated 792 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1296: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 error, 1 failure, 34 ignored (5 assumptions)
Total time: 207 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 568 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/568/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.SSLMigrationTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([902D88334BF75D69]:0)
FAILED: org.apache.solr.cloud.SSLMigrationTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([902D88334BF75D69]:0)
Build Log:
[...truncated 12025 lines...]
[junit4] Suite: org.apache.solr.cloud.SSLMigrationTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/init-core-data-001
[junit4] 2> 89708 T204 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /f/
[junit4] 2> 89714 T204 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 89715 T204 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 89716 T205 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 89818 T204 oasc.ZkTestServer.run start zk server on port:30568
[junit4] 2> 89819 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 89849 T211 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@31772a4f name:ZooKeeperConnection Watcher:127.0.0.1:30568 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 89849 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 89850 T204 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 89862 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 89871 T213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@336eb995 name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 89871 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 89871 T204 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 89881 T204 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 89891 T204 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 89893 T204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 89896 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 89896 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 89909 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 89909 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 89913 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 89913 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 89926 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 89926 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 89929 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 89930 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 89933 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 89933 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 89936 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 89937 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 89939 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 89940 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 89948 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 89948 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 89951 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 89952 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 89955 T204 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 89955 T204 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 90840 T204 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 90843 T204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30571
[junit4] 2> 90844 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 90844 T204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 90844 T204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002
[junit4] 2> 90845 T204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/'
[junit4] 2> 90874 T204 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/solr.xml
[junit4] 2> 90948 T204 oasc.CoreContainer.<init> New CoreContainer 1886990706
[junit4] 2> 90948 T204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/]
[junit4] 2> 90950 T204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 90950 T204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 90950 T204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 90951 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 90951 T204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 90951 T204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 90951 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 90952 T204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 90952 T204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 90953 T204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 90953 T204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 90953 T204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 90953 T204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:30568/solr
[junit4] 2> 90954 T204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 90954 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90958 T224 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@249d6d0e name:ZooKeeperConnection Watcher:127.0.0.1:30568 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90958 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90961 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 90969 T226 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6519f72b name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 90969 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 90972 T204 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 90983 T204 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 90987 T204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 90998 T204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 91009 T204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 91012 T204 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 91014 T204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30571_f
[junit4] 2> 91016 T204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30571_f
[junit4] 2> 91019 T204 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 91021 T204 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 91025 T204 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:30571_f
[junit4] 2> 91025 T204 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 91028 T204 oasc.Overseer.start Overseer (id=91867276334792707-127.0.0.1:30571_f-n_0000000000) starting
[junit4] 2> 91031 T204 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 91042 T228 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 91042 T204 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 91044 T204 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 91046 T204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 91049 T227 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 91062 T229 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 91062 T229 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 91064 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91064 T229 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 91066 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 91067 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:30571/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30571_f",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 91067 T227 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 91068 T227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 91071 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 91071 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 92066 T229 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 92066 T229 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 92067 T229 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 92067 T229 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 92068 T229 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 92069 T229 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/collection1/'
[junit4] 2> 92071 T229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 92072 T229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 92073 T229 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 92156 T229 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 92237 T229 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 92239 T229 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 92254 T229 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 92881 T229 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 92899 T229 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 92903 T229 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 92929 T229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 92934 T229 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 92942 T229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 92944 T229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 92944 T229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 92944 T229 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 92945 T229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 92946 T229 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 92946 T229 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 92946 T229 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 92947 T229 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/control/data/
[junit4] 2> 92947 T229 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@267fd96e
[junit4] 2> 92948 T229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/control/data
[junit4] 2> 92949 T229 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/control/data/index/
[junit4] 2> 92949 T229 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 92949 T229 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/control/data/index
[junit4] 2> 92950 T229 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=0.8544921875, floorSegmentMB=1.83984375, forceMergeDeletesPctAllowed=14.967080996200524, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11044413454085263
[junit4] 2> 92951 T229 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@84210d2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fa8c03a),segFN=segments_1,generation=1}
[junit4] 2> 92951 T229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 92958 T229 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 92958 T229 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 92959 T229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 92959 T229 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 92960 T229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 92960 T229 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 92960 T229 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 92961 T229 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 92961 T229 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 92962 T229 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 92963 T229 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 92963 T229 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 92963 T229 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 92964 T229 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 92964 T229 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 92965 T229 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 92966 T229 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 92984 T229 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 92992 T229 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 92993 T229 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 92993 T229 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=57.478515625, floorSegmentMB=0.306640625, forceMergeDeletesPctAllowed=5.485188247260599, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14619642865962837
[junit4] 2> 92994 T229 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@84210d2 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2fa8c03a),segFN=segments_1,generation=1}
[junit4] 2> 92995 T229 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 92995 T229 oass.SolrIndexSearcher.<init> Opening Searcher@71891f76[collection1] main
[junit4] 2> 92995 T229 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 92997 T229 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 92997 T229 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 92997 T229 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 92998 T229 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 92998 T229 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 92999 T229 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 92999 T229 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 92999 T229 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 93000 T229 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 93005 T230 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@71891f76[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 93008 T229 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 93009 T233 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30571/f collection:control_collection shard:shard1
[junit4] 2> 93009 T204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 93010 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 93010 T233 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 93011 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 93013 T235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2aac8fe3 name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 93014 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 93029 T204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 93050 T204 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 93096 T233 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 93120 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93120 T233 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 93120 T233 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C11 name=collection1 org.apache.solr.core.SolrCore@2f17b946 url=http://127.0.0.1:30571/f/collection1 node=127.0.0.1:30571_f C11_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:30571/f, core=collection1, node_name=127.0.0.1:30571_f}
[junit4] 2> 93121 T233 C11 P30571 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30571/f/collection1/
[junit4] 2> 93121 T233 C11 P30571 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 93121 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 93121 T233 C11 P30571 oasc.SyncStrategy.syncToMe http://127.0.0.1:30571/f/collection1/ has no replicas
[junit4] 2> 93122 T233 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30571/f/collection1/ shard1
[junit4] 2> 93122 T233 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 93175 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93200 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 93200 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 93243 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 93284 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93387 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 93387 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 93396 T233 oasc.ZkController.register We are http://127.0.0.1:30571/f/collection1/ and leader is http://127.0.0.1:30571/f/collection1/
[junit4] 2> 93396 T233 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30571/f
[junit4] 2> 93396 T233 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 93396 T233 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 93397 T233 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 93399 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93399 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93399 T233 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 93399 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93401 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 93402 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:30571/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30571_f",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 93405 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 93508 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 93508 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 94466 T204 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 94467 T204 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 94469 T204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30575
[junit4] 2> 94470 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 94470 T204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 94470 T204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003
[junit4] 2> 94471 T204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/'
[junit4] 2> 94512 T204 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/solr.xml
[junit4] 2> 94609 T204 oasc.CoreContainer.<init> New CoreContainer 1515364534
[junit4] 2> 94610 T204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/]
[junit4] 2> 94611 T204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 94611 T204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 94612 T204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 94612 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 94612 T204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 94612 T204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 94613 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 94613 T204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 94613 T204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 94614 T204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 94614 T204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 94614 T204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 94615 T204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:30568/solr
[junit4] 2> 94615 T204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 94616 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 94619 T246 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66b53b0d name:ZooKeeperConnection Watcher:127.0.0.1:30568 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 94619 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 94637 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 94639 T248 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1454f892 name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 94639 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 94653 T204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 95656 T204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30575_f
[junit4] 2> 95660 T204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30575_f
[junit4] 2> 95686 T249 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 95686 T249 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 95688 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95688 T249 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 95688 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95689 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95690 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 95691 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:30575/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30575_f",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 95691 T227 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 95691 T227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 95695 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 95704 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 95704 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 95704 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 96690 T249 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 96690 T249 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 96691 T249 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 96691 T249 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 96692 T249 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 96692 T249 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/collection1/'
[junit4] 2> 96694 T249 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 96695 T249 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 96696 T249 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 96767 T249 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 96840 T249 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 96842 T249 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 96853 T249 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 97504 T249 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 97519 T249 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 97522 T249 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 97539 T249 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97544 T249 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 97548 T249 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97549 T249 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97549 T249 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97549 T249 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 97550 T249 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 97550 T249 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 97550 T249 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 97550 T249 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 97551 T249 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty1/
[junit4] 2> 97551 T249 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@267fd96e
[junit4] 2> 97552 T249 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty1
[junit4] 2> 97552 T249 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty1/index/
[junit4] 2> 97552 T249 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 97552 T249 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty1/index
[junit4] 2> 97553 T249 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=0.8544921875, floorSegmentMB=1.83984375, forceMergeDeletesPctAllowed=14.967080996200524, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11044413454085263
[junit4] 2> 97553 T249 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@d104f63 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71cdc96a),segFN=segments_1,generation=1}
[junit4] 2> 97554 T249 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 97559 T249 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 97560 T249 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 97560 T249 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 97560 T249 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 97561 T249 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 97561 T249 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 97561 T249 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97561 T249 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 97562 T249 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 97562 T249 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 97563 T249 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 97563 T249 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 97563 T249 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 97564 T249 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 97564 T249 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 97565 T249 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 97566 T249 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 97581 T249 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 97587 T249 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 97587 T249 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 97588 T249 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=57.478515625, floorSegmentMB=0.306640625, forceMergeDeletesPctAllowed=5.485188247260599, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14619642865962837
[junit4] 2> 97589 T249 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@d104f63 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@71cdc96a),segFN=segments_1,generation=1}
[junit4] 2> 97589 T249 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 97589 T249 oass.SolrIndexSearcher.<init> Opening Searcher@a82ce8e[collection1] main
[junit4] 2> 97590 T249 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 97590 T249 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 97591 T249 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 97591 T249 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 97591 T249 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 97591 T249 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 97592 T249 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 97592 T249 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 97593 T249 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 97593 T249 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 97597 T250 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a82ce8e[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 97601 T249 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 97602 T253 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30575/f collection:collection1 shard:shard2
[junit4] 2> 97602 T204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 97603 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 97603 T253 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 97622 T253 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 97631 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97631 T253 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 97631 T253 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C12 name=collection1 org.apache.solr.core.SolrCore@16323c61 url=http://127.0.0.1:30575/f/collection1 node=127.0.0.1:30575_f C12_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:30575/f, core=collection1, node_name=127.0.0.1:30575_f}
[junit4] 2> 97632 T253 C12 P30575 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30575/f/collection1/
[junit4] 2> 97632 T253 C12 P30575 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 97632 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 97632 T253 C12 P30575 oasc.SyncStrategy.syncToMe http://127.0.0.1:30575/f/collection1/ has no replicas
[junit4] 2> 97633 T253 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30575/f/collection1/ shard2
[junit4] 2> 97633 T253 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 97639 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97650 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97650 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97650 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97664 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 97667 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97769 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97769 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97769 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97818 T253 oasc.ZkController.register We are http://127.0.0.1:30575/f/collection1/ and leader is http://127.0.0.1:30575/f/collection1/
[junit4] 2> 97818 T253 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30575/f
[junit4] 2> 97818 T253 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 97818 T253 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 97818 T253 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 97821 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97821 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97821 T253 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 97821 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97822 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 97823 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:30575/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30575_f",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 97834 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 97938 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97938 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 97938 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 98653 T204 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 98654 T204 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 98656 T204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30584
[junit4] 2> 98657 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 98657 T204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 98657 T204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004
[junit4] 2> 98658 T204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/'
[junit4] 2> 98687 T204 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/solr.xml
[junit4] 2> 98758 T204 oasc.CoreContainer.<init> New CoreContainer 23026243
[junit4] 2> 98759 T204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/]
[junit4] 2> 98760 T204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 98760 T204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 98760 T204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 98761 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 98761 T204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 98761 T204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 98762 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 98762 T204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 98762 T204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 98763 T204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 98763 T204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 98763 T204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 98764 T204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:30568/solr
[junit4] 2> 98764 T204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 98765 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 98768 T264 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b1ee569 name:ZooKeeperConnection Watcher:127.0.0.1:30568 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 98768 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 98783 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 98785 T266 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2f378a22 name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 98785 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 98802 T204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 99806 T204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30584_f
[junit4] 2> 99808 T204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30584_f
[junit4] 2> 99828 T267 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 99828 T267 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 99829 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 99830 T267 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 99830 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 99830 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 99831 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 99831 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:30584/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30584_f",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 99831 T227 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 99832 T227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 99834 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 99843 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 99843 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 99843 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 99843 T266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 100832 T267 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 100832 T267 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 100833 T267 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 100833 T267 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 100834 T267 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 100834 T267 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/collection1/'
[junit4] 2> 100835 T267 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 100836 T267 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 100836 T267 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 100900 T267 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 100953 T267 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 100955 T267 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 100964 T267 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 101502 T267 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 101518 T267 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 101522 T267 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 101547 T267 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 101552 T267 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 101557 T267 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 101558 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 101559 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 101559 T267 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 101560 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 101560 T267 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 101560 T267 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 101561 T267 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 101561 T267 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty2/
[junit4] 2> 101561 T267 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@267fd96e
[junit4] 2> 101563 T267 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty2
[junit4] 2> 101563 T267 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty2/index/
[junit4] 2> 101563 T267 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 101564 T267 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-001/jetty2/index
[junit4] 2> 101564 T267 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=23, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=0.8544921875, floorSegmentMB=1.83984375, forceMergeDeletesPctAllowed=14.967080996200524, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.11044413454085263
[junit4] 2> 101565 T267 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@11b9ad5a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f971ab2),segFN=segments_1,generation=1}
[junit4] 2> 101566 T267 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 101574 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 101575 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 101575 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 101575 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 101576 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 101576 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 101577 T267 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 101577 T267 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 101577 T267 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 101578 T267 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 101579 T267 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 101579 T267 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 101580 T267 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 101581 T267 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 101581 T267 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 101582 T267 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 101583 T267 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 101602 T267 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 101608 T267 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 101608 T267 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 101609 T267 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=33, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=57.478515625, floorSegmentMB=0.306640625, forceMergeDeletesPctAllowed=5.485188247260599, segmentsPerTier=19.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.14619642865962837
[junit4] 2> 101610 T267 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=BaseDirectoryWrapper(RAMDirectory@11b9ad5a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7f971ab2),segFN=segments_1,generation=1}
[junit4] 2> 101610 T267 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 101611 T267 oass.SolrIndexSearcher.<init> Opening Searcher@77134b89[collection1] main
[junit4] 2> 101611 T267 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 101612 T267 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 101613 T267 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 101613 T267 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 101613 T267 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 101614 T267 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 101614 T267 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 101615 T267 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 101615 T267 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 101615 T267 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 101622 T268 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@77134b89[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 101627 T267 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 101628 T271 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:30584/f collection:collection1 shard:shard1
[junit4] 2> 101629 T204 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1
[junit4] 2> 101629 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 101629 T271 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 101654 T271 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 101657 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101658 T271 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 101658 T271 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C13 name=collection1 org.apache.solr.core.SolrCore@15c28240 url=http://127.0.0.1:30584/f/collection1 node=127.0.0.1:30584_f C13_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:30584/f, core=collection1, node_name=127.0.0.1:30584_f}
[junit4] 2> 101658 T271 C13 P30584 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:30584/f/collection1/
[junit4] 2> 101658 T271 C13 P30584 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 101659 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101659 T271 C13 P30584 oasc.SyncStrategy.syncToMe http://127.0.0.1:30584/f/collection1/ has no replicas
[junit4] 2> 101659 T271 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:30584/f/collection1/ shard1
[junit4] 2> 101659 T271 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 101662 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101665 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101665 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101665 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101665 T266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101676 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101686 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101791 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101791 T266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101791 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101791 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101831 T271 oasc.ZkController.register We are http://127.0.0.1:30584/f/collection1/ and leader is http://127.0.0.1:30584/f/collection1/
[junit4] 2> 101831 T271 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:30584/f
[junit4] 2> 101831 T271 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 101831 T271 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 101832 T271 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 101841 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101841 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101841 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101842 T271 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101842 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 101843 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:30584/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30584_f",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 101854 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 101958 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101958 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101958 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 101958 T266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 102771 T204 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 102772 T204 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 102774 T204 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:30591
[junit4] 2> 102775 T204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 102775 T204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 102776 T204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-005
[junit4] 2> 102776 T204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-005/'
[junit4] 2> 102805 T204 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-005/solr.xml
[junit4] 2> 102882 T204 oasc.CoreContainer.<init> New CoreContainer 439347958
[junit4] 2> 102883 T204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J1/./temp/solr.cloud.SSLMigrationTest-902D88334BF75D69-001/tempDir-005/]
[junit4] 2> 102884 T204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 102885 T204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 102885 T204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 102885 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 102885 T204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 102886 T204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 102886 T204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 102886 T204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 102887 T204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 102887 T204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 102887 T204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 102888 T204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 102888 T204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:30568/solr
[junit4] 2> 102888 T204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 102889 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 102892 T282 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3feac9e8 name:ZooKeeperConnection Watcher:127.0.0.1:30568 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 102893 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 102915 T204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 102917 T284 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14fda3ee name:ZooKeeperConnection Watcher:127.0.0.1:30568/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 102917 T204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 102926 T204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 103930 T204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:30591_f
[junit4] 2> 103932 T204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:30591_f
[junit4] 2> 103953 T285 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 103953 T285 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 103955 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103955 T285 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 103955 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103956 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103957 T227 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 103958 T227 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:30591/f",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:30591_f",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 103958 T227 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 103959 T227 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 103961 T226 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 103970 T235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 103970 T226 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 103970 T284 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 103970 T248 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 103970 T266 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 104957 T285 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 104957 T285 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 104958 T285 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 104958 T285 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4
[...truncated too long message...]
Stop(FilterHolder.java:131)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:206)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.doStop(HandlerWrapper.java:107)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:136)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.doStop(HandlerWrapper.java:107)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.doStop(HandlerWrapper.java:107)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:808)
[junit4] 2> at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:160)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.doStop(HandlerWrapper.java:107)
[junit4] 2> at org.eclipse.jetty.server.Server.doStop(Server.java:341)
[junit4] 2> at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:457)
[junit4] 2> at org.apache.solr.cloud.SSLMigrationTest.testMigrateSSL(SSLMigrationTest.java:66)
[junit4] 2> at org.apache.solr.cloud.SSLMigrationTest.doTest(SSLMigrationTest.java:58)
[junit4] 2> at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:606)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 20) Thread[id=231, name=Thread-65, state=WAITING, group=TGRP-SSLMigrationTest]
[junit4] 2> at java.lang.Object.wait(Native Method)
[junit4] 2> at java.lang.Object.wait(Object.java:503)
[junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=ms, timezone=Pacific/Palau
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=25,free=51118584,total=164298752
[junit4] 2> NOTE: All tests run in this JVM: [RequestHandlersTest, HdfsBasicDistributedZkTest, TestZkChroot, TestCollectionAPI, TestRangeQuery, SSLMigrationTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SSLMigrationTest -Dtests.seed=902D88334BF75D69 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=ms -Dtests.timezone=Pacific/Palau -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | SSLMigrationTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([902D88334BF75D69]:0)
[junit4] Completed on J1 in 7223.58s, 1 test, 2 errors <<< FAILURES!
[...truncated 311 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1296: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 1 suite-level error, 1 error, 369 ignored (3 assumptions)
Total time: 240 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-NightlyTests-trunk - Build # 566 - Still
Failing
Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-trunk/566/
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest: 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=TIMED_WAITING, group=TGRP-MultiThreadedOCPTest] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.ZkController.waitForCoreNodeName(ZkController.java:1317) at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1285) at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1427) at org.apache.solr.core.CoreContainer.preRegisterInZk(CoreContainer.java:880) at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:565) at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:200) at org.apache.solr.handler.admin.CoreAdminHandler$ParallelCoreAdminHandlerThread.run(CoreAdminHandler.java:1303) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:
1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=TIMED_WAITING, group=TGRP-MultiThreadedOCPTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.ZkController.waitForCoreNodeName(ZkController.java:1317)
at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1285)
at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1427)
at org.apache.solr.core.CoreContainer.preRegisterInZk(CoreContainer.java:880)
at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:565)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:200)
at org.apache.solr.handler.admin.CoreAdminHandler$ParallelCoreAdminHandlerThread.run(CoreAdminHandler.java:1303)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([5737F652854EE64B]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.MultiThreadedOCPTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=WAITING, group=TGRP-MultiThreadedOCPTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:724)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=WAITING, group=TGRP-MultiThreadedOCPTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:724)
at __randomizedtesting.SeedInfo.seed([5737F652854EE64B]:0)
Build Log:
[...truncated 11092 lines...]
[junit4] Suite: org.apache.solr.cloud.MultiThreadedOCPTest
[junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/init-core-data-001
[junit4] 2> 146593 T553 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 146593 T553 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 146600 T553 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 146602 T553 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 146603 T554 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 146703 T553 oasc.ZkTestServer.run start zk server on port:25247
[junit4] 2> 146704 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 146709 T560 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@68eeddc7 name:ZooKeeperConnection Watcher:127.0.0.1:25247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 146709 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 146710 T553 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 146727 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 146730 T562 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a2dbb69 name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 146730 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 146731 T553 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 146740 T553 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 146744 T553 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 146747 T553 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 146756 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 146757 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 146769 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 146770 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 146774 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 146775 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 146778 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 146779 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 146782 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 146783 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 146786 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 146787 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 146791 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 146792 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 146796 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 146797 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 146800 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 146801 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 146804 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 146805 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 146808 T553 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 146809 T553 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 146825 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 146828 T564 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@429e2d1c name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 146828 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 147910 T553 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 147914 T553 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 147918 T553 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:25251
[junit4] 2> 147920 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 147920 T553 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 147920 T553 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002
[junit4] 2> 147921 T553 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/'
[junit4] 2> 147949 T553 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/solr.xml
[junit4] 2> 148017 T553 oasc.CoreContainer.<init> New CoreContainer 2043488800
[junit4] 2> 148018 T553 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/]
[junit4] 2> 148019 T553 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 148019 T553 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 148020 T553 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 148020 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 148020 T553 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 148020 T553 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 148021 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 148021 T553 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 148021 T553 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 148025 T553 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 148025 T553 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 148026 T553 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 148026 T553 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25247/solr
[junit4] 2> 148027 T553 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 148027 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 148030 T575 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75939004 name:ZooKeeperConnection Watcher:127.0.0.1:25247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 148031 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 148044 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 148047 T577 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7fabbb4 name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 148047 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 148049 T553 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 148059 T553 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 148063 T553 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 148066 T553 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 148070 T553 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 148074 T553 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 148076 T553 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25251_
[junit4] 2> 148077 T553 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25251_
[junit4] 2> 148080 T553 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 148083 T553 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 148097 T553 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:25251_
[junit4] 2> 148097 T553 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 148100 T553 oasc.Overseer.start Overseer (id=91839190514335748-127.0.0.1:25251_-n_0000000000) starting
[junit4] 2> 148103 T553 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 148114 T579 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 148114 T553 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 148117 T553 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 148118 T553 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 148121 T578 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 148126 T580 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 148127 T580 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 148128 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148128 T580 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 148129 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 148130 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:25251",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25251_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 148130 T578 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 148131 T578 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 148133 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148134 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149130 T580 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 149130 T580 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 149131 T580 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 149131 T580 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 149132 T580 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 149132 T580 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/collection1/'
[junit4] 2> 149134 T580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 149134 T580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 149135 T580 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 149195 T580 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 149250 T580 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149252 T580 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 149262 T580 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 149694 T580 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 149704 T580 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 149707 T580 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 149725 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 149729 T580 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 149733 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 149734 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 149734 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 149735 T580 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 149736 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 149736 T580 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 149736 T580 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 149737 T580 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 149737 T580 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-002/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-001/control/data/
[junit4] 2> 149737 T580 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@426e95e9
[junit4] 2> 149738 T580 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-001/control/data
[junit4] 2> 149738 T580 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-001/control/data/index/
[junit4] 2> 149738 T580 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 149739 T580 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-001/control/data/index
[junit4] 2> 149739 T580 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 149740 T580 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4053a91b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6f708930),segFN=segments_1,generation=1}
[junit4] 2> 149740 T580 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 149745 T580 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 149746 T580 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 149746 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 149746 T580 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 149746 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 149747 T580 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 149747 T580 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 149748 T580 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 149748 T580 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 149748 T580 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 149749 T580 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 149749 T580 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 149749 T580 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 149750 T580 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 149750 T580 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 149751 T580 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 149751 T580 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 149764 T580 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 149770 T580 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 149770 T580 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 149771 T580 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=21.494140625, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=15.776319924435521, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 149771 T580 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@4053a91b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6f708930),segFN=segments_1,generation=1}
[junit4] 2> 149772 T580 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 149773 T580 oass.SolrIndexSearcher.<init> Opening Searcher@51d6134b[collection1] main
[junit4] 2> 149773 T580 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 149774 T580 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 149774 T580 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 149775 T580 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 149775 T580 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 149775 T580 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 149776 T580 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 149777 T580 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 149777 T580 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 149777 T580 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 149781 T581 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@51d6134b[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 149784 T580 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 149785 T584 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:25251 collection:control_collection shard:shard1
[junit4] 2> 149785 T553 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 149786 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 149786 T584 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 149792 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 149808 T586 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e6c1010 name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 149808 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 149810 T553 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 149818 T584 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 149821 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149821 T553 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 149822 T584 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 149822 T584 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C130 name=collection1 org.apache.solr.core.SolrCore@2258b320 url=https://127.0.0.1:25251/collection1 node=127.0.0.1:25251_ C130_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:25251, core=collection1, node_name=127.0.0.1:25251_}
[junit4] 2> 149822 T584 C130 P25251 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:25251/collection1/
[junit4] 2> 149823 T584 C130 P25251 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 149823 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 149823 T584 C130 P25251 oasc.SyncStrategy.syncToMe https://127.0.0.1:25251/collection1/ has no replicas
[junit4] 2> 149823 T584 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:25251/collection1/ shard1
[junit4] 2> 149823 T584 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 149826 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149828 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149828 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149833 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 149837 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149940 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149940 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 149986 T584 oasc.ZkController.register We are https://127.0.0.1:25251/collection1/ and leader is https://127.0.0.1:25251/collection1/
[junit4] 2> 149986 T584 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:25251
[junit4] 2> 149986 T584 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 149986 T584 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 149987 T584 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 149989 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149989 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149989 T584 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 149989 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 149991 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 149991 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:25251",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25251_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 150001 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 150104 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150104 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 150862 T553 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 150863 T553 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 150868 T553 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 150870 T553 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:25255
[junit4] 2> 150873 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 150873 T553 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 150873 T553 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003
[junit4] 2> 150874 T553 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/'
[junit4] 2> 150902 T553 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/solr.xml
[junit4] 2> 150972 T553 oasc.CoreContainer.<init> New CoreContainer 1258826659
[junit4] 2> 150972 T553 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/]
[junit4] 2> 150974 T553 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 150974 T553 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 150974 T553 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 150975 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 150975 T553 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 150975 T553 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 150976 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 150976 T553 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 150976 T553 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 150980 T553 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 150980 T553 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 150981 T553 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 150981 T553 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25247/solr
[junit4] 2> 150981 T553 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 150982 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 151010 T597 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3f8429a7 name:ZooKeeperConnection Watcher:127.0.0.1:25247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 151010 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 151024 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 151026 T599 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6c86c3e5 name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 151026 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 151049 T553 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 152053 T553 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25255_
[junit4] 2> 152056 T553 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25255_
[junit4] 2> 152079 T600 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 152079 T600 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 152081 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152081 T600 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 152081 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152082 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152083 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 152084 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:25255",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25255_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 152084 T578 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 152084 T578 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 152088 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 152096 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 152096 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 152096 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153083 T600 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 153083 T600 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 153084 T600 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 153084 T600 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 153086 T600 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 153086 T600 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/'
[junit4] 2> 153088 T600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 153089 T600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 153090 T600 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 153169 T600 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 153242 T600 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 153244 T600 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 153258 T600 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 153759 T600 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 153769 T600 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 153772 T600 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 153788 T600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 153793 T600 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 153797 T600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 153798 T600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 153799 T600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 153799 T600 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 153800 T600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 153801 T600 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 153801 T600 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 153801 T600 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 153802 T600 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/data/
[junit4] 2> 153802 T600 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@426e95e9
[junit4] 2> 153803 T600 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/data
[junit4] 2> 153803 T600 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/data/index/
[junit4] 2> 153803 T600 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 153804 T600 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-003/collection1/data/index
[junit4] 2> 153804 T600 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 153805 T600 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50969d9a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2789a9e6),segFN=segments_1,generation=1}
[junit4] 2> 153805 T600 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153811 T600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 153812 T600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 153812 T600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 153813 T600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 153813 T600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 153813 T600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 153813 T600 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153814 T600 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153814 T600 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 153815 T600 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 153816 T600 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 153816 T600 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 153816 T600 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 153817 T600 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 153817 T600 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 153818 T600 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 153819 T600 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 153831 T600 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 153837 T600 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 153837 T600 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 153838 T600 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=21.494140625, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=15.776319924435521, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 153839 T600 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@50969d9a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2789a9e6),segFN=segments_1,generation=1}
[junit4] 2> 153839 T600 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153840 T600 oass.SolrIndexSearcher.<init> Opening Searcher@761e074[collection1] main
[junit4] 2> 153840 T600 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 153841 T600 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 153841 T600 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 153842 T600 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 153842 T600 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 153842 T600 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 153843 T600 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 153843 T600 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 153843 T600 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 153844 T600 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 153848 T601 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@761e074[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 153851 T600 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 153852 T604 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:25255 collection:collection1 shard:shard2
[junit4] 2> 153853 T553 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 153853 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 153853 T604 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 153871 T604 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 153874 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153874 T604 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 153874 T604 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C131 name=collection1 org.apache.solr.core.SolrCore@696e95a7 url=https://127.0.0.1:25255/collection1 node=127.0.0.1:25255_ C131_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:25255, core=collection1, node_name=127.0.0.1:25255_}
[junit4] 2> 153875 T604 C131 P25255 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:25255/collection1/
[junit4] 2> 153875 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 153875 T604 C131 P25255 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 153875 T604 C131 P25255 oasc.SyncStrategy.syncToMe https://127.0.0.1:25255/collection1/ has no replicas
[junit4] 2> 153876 T604 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:25255/collection1/ shard2
[junit4] 2> 153876 T604 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 153878 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153879 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153879 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153879 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153882 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153884 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 153887 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153990 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153990 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 153990 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 154036 T604 oasc.ZkController.register We are https://127.0.0.1:25255/collection1/ and leader is https://127.0.0.1:25255/collection1/
[junit4] 2> 154036 T604 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:25255
[junit4] 2> 154036 T604 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 154036 T604 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 154037 T604 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 154039 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 154039 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 154039 T604 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 154039 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 154041 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 154041 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:25255",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25255_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 154051 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 154171 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 154171 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 154171 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 154722 T553 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 154723 T553 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 154728 T553 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 154730 T553 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:25261
[junit4] 2> 154732 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 154733 T553 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 154733 T553 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004
[junit4] 2> 154733 T553 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/'
[junit4] 2> 154762 T553 oasc.ConfigSolr.fromFile Loading container configuration from /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/solr.xml
[junit4] 2> 154834 T553 oasc.CoreContainer.<init> New CoreContainer 1134806013
[junit4] 2> 154834 T553 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/]
[junit4] 2> 154836 T553 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 154836 T553 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 154836 T553 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 154837 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 154837 T553 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 154837 T553 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 154838 T553 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 154838 T553 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 154838 T553 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 154842 T553 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 154842 T553 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 154843 T553 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 154843 T553 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:25247/solr
[junit4] 2> 154843 T553 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 154844 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 154847 T615 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@45b9a742 name:ZooKeeperConnection Watcher:127.0.0.1:25247 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 154848 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 154861 T553 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 154863 T617 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@560767df name:ZooKeeperConnection Watcher:127.0.0.1:25247/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 154863 T553 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 154879 T553 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 155882 T553 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:25261_
[junit4] 2> 155885 T553 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:25261_
[junit4] 2> 155908 T618 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 155908 T618 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 155910 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 155910 T618 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 155910 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 155911 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 155912 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 155913 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:25261",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25261_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 155913 T578 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 155913 T578 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 155917 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 155924 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 155924 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 155924 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 155924 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 156911 T618 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 156911 T618 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 156912 T618 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 156912 T618 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 156914 T618 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 156914 T618 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/'
[junit4] 2> 156917 T618 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 156918 T618 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 156919 T618 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 156997 T618 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 157072 T618 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 157074 T618 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 157088 T618 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 157678 T618 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 157692 T618 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 157696 T618 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 157715 T618 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 157721 T618 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 157725 T618 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 157727 T618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 157727 T618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 157728 T618 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 157729 T618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 157729 T618 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 157729 T618 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 157730 T618 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 157730 T618 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/data/
[junit4] 2> 157731 T618 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@426e95e9
[junit4] 2> 157732 T618 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/data
[junit4] 2> 157732 T618 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/data/index/
[junit4] 2> 157732 T618 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/data/index' doesn't exist. Creating new index...
[junit4] 2> 157733 T618 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/../../../../../../../../../../../usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-004/collection1/data/index
[junit4] 2> 157733 T618 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 157734 T618 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1949fcc8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6ba16d0b),segFN=segments_1,generation=1}
[junit4] 2> 157735 T618 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 157742 T618 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 157743 T618 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 157743 T618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 157744 T618 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 157744 T618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 157744 T618 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 157745 T618 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 157745 T618 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 157746 T618 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 157746 T618 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 157747 T618 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 157747 T618 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 157748 T618 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 157749 T618 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 157749 T618 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 157750 T618 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 157751 T618 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 157768 T618 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 157775 T618 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 157775 T618 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 157776 T618 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=21.494140625, floorSegmentMB=0.607421875, forceMergeDeletesPctAllowed=15.776319924435521, segmentsPerTier=14.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 157777 T618 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1949fcc8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6ba16d0b),segFN=segments_1,generation=1}
[junit4] 2> 157778 T618 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 157778 T618 oass.SolrIndexSearcher.<init> Opening Searcher@39fd89b4[collection1] main
[junit4] 2> 157779 T618 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 157780 T618 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 157780 T618 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 157781 T618 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 157781 T618 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 157782 T618 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 157782 T618 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 157783 T618 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 157783 T618 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 157783 T618 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 157789 T619 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39fd89b4[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 157793 T618 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 157794 T622 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:25261 collection:collection1 shard:shard1
[junit4] 2> 157795 T553 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0
[junit4] 2> 157795 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 157795 T622 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 157813 T622 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 157816 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157816 T622 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 157817 T622 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C132 name=collection1 org.apache.solr.core.SolrCore@5d58a6c9 url=https://127.0.0.1:25261/collection1 node=127.0.0.1:25261_ C132_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:25261, core=collection1, node_name=127.0.0.1:25261_}
[junit4] 2> 157817 T622 C132 P25261 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:25261/collection1/
[junit4] 2> 157817 T622 C132 P25261 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 157817 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 157818 T622 C132 P25261 oasc.SyncStrategy.syncToMe https://127.0.0.1:25261/collection1/ has no replicas
[junit4] 2> 157818 T622 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:25261/collection1/ shard1
[junit4] 2> 157818 T622 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 157821 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157822 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157822 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157823 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157822 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157827 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 157831 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157934 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157934 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157934 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157934 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 157979 T622 oasc.ZkController.register We are https://127.0.0.1:25261/collection1/ and leader is https://127.0.0.1:25261/collection1/
[junit4] 2> 157979 T622 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:25261
[junit4] 2> 157979 T622 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 157980 T622 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 157980 T622 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 157982 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157983 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157983 T622 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 157983 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 157984 T578 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 157985 T578 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:25261",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:25261_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 157989 T577 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 158092 T577 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 158093 T586 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 158093 T617 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 158093 T599 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 158952 T553 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 158953 T553 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 158958 T553 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 158960 T553 oejs.AbstractConnector.doStart Started SslSocketConnector@127.0.0.1:42069
[junit4] 2> 158962 T553 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 158963 T553 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 158963 T553 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build/solr-core/test/J0/./temp/solr.cloud.MultiThreadedOCPTest-5737F652854EE64B-001/tempDir-005
[junit4] 2> 158963 T553
[...truncated too long message...]
e=TIMED_WAITING, group=TGRP-MultiThreadedOCPTest]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.ZkController.waitForCoreNodeName(ZkController.java:1317)
[junit4] 2> at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1285)
[junit4] 2> at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1427)
[junit4] 2> at org.apache.solr.core.CoreContainer.preRegisterInZk(CoreContainer.java:880)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:565)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:200)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$ParallelCoreAdminHandlerThread.run(CoreAdminHandler.java:1303)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2> 91623 T552 ccr.ThreadLeakControl.tryToInterruptAll Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=TIMED_WAITING, group=TGRP-MultiThreadedOCPTest]
[junit4] 2> 238223 T4149 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1_shard1_0_replica2
[junit4] 2> 238232 T4149 oasc.SolrException.log ERROR null:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue/qn-
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:243)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$5.execute(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.create(SolrZkClient.java:240)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.createData(DistributedQueue.java:313)
[junit4] 2> at org.apache.solr.cloud.DistributedQueue.offer(DistributedQueue.java:297)
[junit4] 2> at org.apache.solr.cloud.ZkController.unregister(ZkController.java:1117)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:585)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:200)
[junit4] 2> at org.apache.solr.handler.admin.CoreAdminHandler$ParallelCoreAdminHandlerThread.run(CoreAdminHandler.java:1303)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2>
[junit4] 2> 94630 T552 ccr.ThreadLeakControl.tryToInterruptAll SEVERE There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=WAITING, group=TGRP-MultiThreadedOCPTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] 2> at java.lang.Thread.run(Thread.java:724)
[junit4] 2> NOTE: test params are: codec=FastDecompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=140), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST_DECOMPRESSION, chunkSize=140)), sim=DefaultSimilarity, locale=ru_RU, timezone=America/Eirunepe
[junit4] 2> NOTE: FreeBSD 9.1-RELEASE-p3 amd64/Oracle Corporation 1.7.0_25 (64-bit)/cpus=16,threads=2,free=166349584,total=440139776
[junit4] 2> NOTE: All tests run in this JVM: [TestCloudManagedSchemaAddField, TestBadConfig, RecoveryZkTest, PeerSyncTest, TestFileDictionaryLookup, SolrXmlInZkTest, PolyFieldTest, TestOrdValues, TestInfoStreamLogging, UUIDFieldTest, HdfsChaosMonkeySafeLeaderTest, AnalysisAfterCoreReloadTest, ExternalFileFieldSortTest, MultiThreadedOCPTest]
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.seed=5737F652854EE64B -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/home/hudson/lucene-data/enwiki.random.lines.txt -Dtests.locale=ru_RU -Dtests.timezone=America/Eirunepe -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | MultiThreadedOCPTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.MultiThreadedOCPTest:
[junit4] > 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=TIMED_WAITING, group=TGRP-MultiThreadedOCPTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.solr.cloud.ZkController.waitForCoreNodeName(ZkController.java:1317)
[junit4] > at org.apache.solr.cloud.ZkController.doGetShardIdAndNodeNameProcess(ZkController.java:1285)
[junit4] > at org.apache.solr.cloud.ZkController.preRegister(ZkController.java:1427)
[junit4] > at org.apache.solr.core.CoreContainer.preRegisterInZk(CoreContainer.java:880)
[junit4] > at org.apache.solr.handler.admin.CoreAdminHandler.handleCreateAction(CoreAdminHandler.java:565)
[junit4] > at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestInternal(CoreAdminHandler.java:200)
[junit4] > at org.apache.solr.handler.admin.CoreAdminHandler$ParallelCoreAdminHandlerThread.run(CoreAdminHandler.java:1303)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > at __randomizedtesting.SeedInfo.seed([5737F652854EE64B]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=4149, name=parallelCoreAdminExecutor-367-thread-1, state=WAITING, group=TGRP-MultiThreadedOCPTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:724)
[junit4] > at __randomizedtesting.SeedInfo.seed([5737F652854EE64B]:0)
[junit4] Completed on J0 in 94.69s, 1 test, 2 errors <<< FAILURES!
[...truncated 1105 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:474: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:447: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/build.xml:45: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/extra-targets.xml:37: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/build.xml:189: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/solr/common-build.xml:496: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:1296: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-NightlyTests-trunk/lucene/common-build.xml:920: There were test failures: 406 suites, 1688 tests, 2 suite-level errors, 1211 ignored (2 assumptions)
Total time: 138 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure