You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/02/04 02:44:30 UTC
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 1971
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1971/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
3 tests failed.
FAILED: org.apache.solr.cloud.ReplicationFactorTest.test
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([EBDE05C83D3A332A]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ReplicationFactorTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([EBDE05C83D3A332A]:0)
FAILED: org.apache.solr.cloud.TestRebalanceLeaders.test
Error Message:
No live SolrServers available to handle this request:[https://127.0.0.1:50445/ws_rk, https://127.0.0.1:50448/ws_rk, https://127.0.0.1:50451/ws_rk, https://127.0.0.1:50441/ws_rk, https://127.0.0.1:50454/ws_rk]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[https://127.0.0.1:50445/ws_rk, https://127.0.0.1:50448/ws_rk, https://127.0.0.1:50451/ws_rk, https://127.0.0.1:50441/ws_rk, https://127.0.0.1:50454/ws_rk]
at __randomizedtesting.SeedInfo.seed([EBDE05C83D3A332A:638A3A1293C65ED2]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:349)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1009)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:787)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:730)
at org.apache.solr.cloud.TestRebalanceLeaders.issueCommands(TestRebalanceLeaders.java:280)
at org.apache.solr.cloud.TestRebalanceLeaders.rebalanceLeaderTest(TestRebalanceLeaders.java:107)
at org.apache.solr.cloud.TestRebalanceLeaders.test(TestRebalanceLeaders.java:73)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:940)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:915)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:50454/ws_rk: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 500 </title>
</head>
<body>
<h2>HTTP ERROR: 500</h2>
<p>Problem accessing /ws_rk/admin/collections. Reason:
<pre> {trace=java.lang.AssertionError
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:36)
at org.apache.solr.common.util.ByteUtils.UTF8toUTF16(ByteUtils.java:64)
at org.apache.solr.common.cloud.ZkStateReader.fromJSON(ZkStateReader.java:140)
at org.apache.solr.common.cloud.ZkNodeProps.load(ZkNodeProps.java:92)
at org.apache.solr.cloud.DistributedQueue.containsTaskWithRequestId(DistributedQueue.java:127)
at org.apache.solr.handler.admin.CollectionsHandler.overseerCollectionQueueContains(CollectionsHandler.java:687)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:712)
at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:692)
at org.apache.solr.handler.admin.CollectionsHandler.rejoinElection(CollectionsHandler.java:487)
at org.apache.solr.handler.admin.CollectionsHandler.insurePreferredIsLeader(CollectionsHandler.java:402)
at org.apache.solr.handler.admin.CollectionsHandler.handleBalanceLeaders(CollectionsHandler.java:309)
at org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:275)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:144)
at org.apache.solr.servlet.SolrDispatchFilter.handleAdminRequest(SolrDispatchFilter.java:736)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:204)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:143)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlets.UserAgentFilter.doFilter(UserAgentFilter.java:83)
at org.eclipse.jetty.servlets.GzipFilter.doFilter(GzipFilter.java:364)
at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:221)
at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1125)
at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1059)
at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
at org.eclipse.jetty.server.Server.handle(Server.java:497)
at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:313)
at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:248)
at org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:626)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:546)
at java.lang.Thread.run(Thread.java:745)
,code=500}</pre></p>
<hr /><i><small>Powered by Jetty://</small></i>
</body>
</html>
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:527)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:214)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:210)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:370)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:338)
... 48 more
Build Log:
[...truncated 9118 lines...]
[junit4] Suite: org.apache.solr.cloud.TestRebalanceLeaders
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/init-core-data-001
[junit4] 2> 1025600 T5204 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1025601 T5204 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ws_rk/
[junit4] 2> 1025606 T5204 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1025607 T5205 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1025707 T5204 oasc.ZkTestServer.run start zk server on port:50437
[junit4] 2> 1025708 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1025709 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1025717 T5212 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@d1e0031 name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1025717 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1025718 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1025718 T5204 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1025726 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1025729 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1025735 T5215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aa946cb name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1025735 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1025735 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1025735 T5204 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1025743 T5204 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1025749 T5204 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1025755 T5204 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1025761 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1025762 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1025770 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1025770 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1025776 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1025777 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1025782 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1025782 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1025789 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1025790 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1025796 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1025796 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1025803 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1025804 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1025809 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1025810 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1025822 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1025823 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1025829 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1025830 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1025837 T5204 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1025838 T5204 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1025846 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1025847 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1025852 T5218 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32d779e2 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1025852 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1025853 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1027396 T5204 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores/collection1
[junit4] 2> 1027400 T5204 oejs.Server.doStart jetty-9.2.6.v20141205
[junit4] 2> 1027406 T5204 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1da135a0{/ws_rk,null,AVAILABLE}
[junit4] 2> 1027417 T5204 oejs.AbstractConnector.doStart Started ServerConnector@6edae683{SSL-http/1.1}{127.0.0.1:50441}
[junit4] 2> 1027418 T5204 oejs.Server.doStart Started @1030662ms
[junit4] 2> 1027423 T5204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 1027429 T5204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1027429 T5204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001
[junit4] 2> 1027429 T5204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/'
[junit4] 2> 1027468 T5204 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/solr.xml
[junit4] 2> 1027487 T5204 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores
[junit4] 2> 1027489 T5204 oasc.CoreContainer.<init> New CoreContainer 1719293886
[junit4] 2> 1027489 T5204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/]
[junit4] 2> 1027490 T5204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1027490 T5204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1027491 T5204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1027491 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1027492 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1027492 T5204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1027492 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1027493 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1027493 T5204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1027494 T5204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1027494 T5204 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1027497 T5204 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1027506 T5204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1027507 T5204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1027508 T5204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1027509 T5204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50437/solr
[junit4] 2> 1027509 T5204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1027509 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1027510 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1027514 T5232 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@65ba3481 name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1027515 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1027515 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1027520 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1027525 T5235 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@47185ebc name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1027526 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1027530 T5204 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1027537 T5204 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1027544 T5204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1027551 T5204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1027559 T5204 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1027568 T5204 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1027572 T5204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50441_ws_rk
[junit4] 2> 1027573 T5204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50441_ws_rk
[junit4] 2> 1027581 T5204 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1027585 T5204 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1027590 T5204 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1027594 T5204 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50441_ws_rk
[junit4] 2> 1027595 T5204 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1027599 T5204 oasc.Overseer.start Overseer (id=93258149339660292-127.0.0.1:50441_ws_rk-n_0000000000) starting
[junit4] 2> 1027605 T5204 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1027629 T5204 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
[junit4] 2> 1027630 T5237 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1027631 T5204 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1027639 T5204 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1027643 T5204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1027654 T5236 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1027662 T5204 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores
[junit4] 2> 1027667 T5204 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores/collection1/
[junit4] 2> 1027667 T5204 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1027689 T5239 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1027689 T5239 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1027692 T5239 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1027692 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1027699 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50441/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50441_ws_rk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 0
[junit4] 2> 1027701 T5236 oasco.ReplicaMutator.updateState Update state numShards=1 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50441/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50441_ws_rk",
[junit4] 2> "numShards":"1",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1027702 T5236 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
[junit4] 2> 1027702 T5236 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1027711 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1028694 T5239 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1028694 T5239 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1028695 T5239 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1028695 T5239 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1028697 T5239 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1028698 T5239 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores/collection1/'
[junit4] 2> 1028719 T5239 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1028724 T5239 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1028737 T5239 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1028746 T5239 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1028771 T5239 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1028776 T5239 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1028779 T5239 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1028965 T5239 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1028966 T5239 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1028967 T5239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1028972 T5239 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1029022 T5239 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1029022 T5239 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1029022 T5239 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/control-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/control/data/
[junit4] 2> 1029023 T5239 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7182e71
[junit4] 2> 1029023 T5239 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/control/data
[junit4] 2> 1029023 T5239 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/control/data/index/
[junit4] 2> 1029024 T5239 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1029024 T5239 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/control/data/index
[junit4] 2> 1029024 T5239 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.37396387506435536]
[junit4] 2> 1029025 T5239 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d6fb10 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@422d27bd),segFN=segments_1,generation=1}
[junit4] 2> 1029025 T5239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1029032 T5239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1029032 T5239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1029032 T5239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1029033 T5239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1029033 T5239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1029033 T5239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1029034 T5239 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1029034 T5239 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1029034 T5239 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1029034 T5239 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1029035 T5239 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1029035 T5239 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1029036 T5239 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1029036 T5239 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 1029036 T5239 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 1029037 T5239 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 1029038 T5239 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 1029038 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 1029040 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 1029040 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 1029041 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 1029041 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 1029041 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 1029042 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 1029042 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 1029042 T5239 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1029043 T5239 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1029051 T5239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1029053 T5239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1029053 T5239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1029055 T5239 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1029055 T5239 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1029059 T5239 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1029059 T5239 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1029059 T5239 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=68.91796875, floorSegmentMB=0.3603515625, forceMergeDeletesPctAllowed=22.272590051176678, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1029060 T5239 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@47d6fb10 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@422d27bd),segFN=segments_1,generation=1}
[junit4] 2> 1029060 T5239 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1029060 T5239 oass.SolrIndexSearcher.<init> Opening Searcher@ae78893[collection1] main
[junit4] 2> 1029061 T5239 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1029063 T5239 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1029064 T5239 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1029065 T5239 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1029065 T5239 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1029065 T5239 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1029066 T5239 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1029067 T5239 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1029067 T5239 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1029067 T5239 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1029067 T5239 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1029068 T5240 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ae78893[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1029070 T5243 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50441/ws_rk collection:control_collection shard:shard1
[junit4] 2> 1029070 T5204 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1029071 T5204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1029072 T5243 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1029075 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1029076 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1029084 T5246 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e718da9 name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1029085 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1029086 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1029088 T5243 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1029089 T5204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1029092 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1029093 T5243 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1029094 T5243 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3215 name=collection1 org.apache.solr.core.SolrCore@221e2c0e url=https://127.0.0.1:50441/ws_rk/collection1 node=127.0.0.1:50441_ws_rk C3215_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=https://127.0.0.1:50441/ws_rk, node_name=127.0.0.1:50441_ws_rk, state=down}
[junit4] 2> 1029094 T5243 C3215 P50441 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50441/ws_rk/collection1/
[junit4] 2> 1029094 T5243 C3215 P50441 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1029095 T5243 C3215 P50441 oasc.SyncStrategy.syncToMe https://127.0.0.1:50441/ws_rk/collection1/ has no replicas
[junit4] 2> 1029095 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection"} current state version: 1
[junit4] 2> 1029095 T5243 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50441/ws_rk/collection1/ shard1
[junit4] 2> 1029096 T5243 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1029102 T5204 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1029109 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1029111 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "base_url":"https://127.0.0.1:50441/ws_rk",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 1
[junit4] 2> 1029220 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1029220 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1029262 T5243 oasc.ZkController.register We are https://127.0.0.1:50441/ws_rk/collection1/ and leader is https://127.0.0.1:50441/ws_rk/collection1/
[junit4] 2> 1029263 T5243 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50441/ws_rk
[junit4] 2> 1029263 T5243 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1029263 T5243 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1029263 T5243 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1029265 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1029273 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50441/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50441_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"} current state version: 2
[junit4] 2> 1029276 T5236 oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50441/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50441_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "operation":"state"}
[junit4] 2> 1029383 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1029383 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1030649 T5204 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores/collection1
[junit4] 2> 1030651 T5204 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1030653 T5204 oejs.Server.doStart jetty-9.2.6.v20141205
[junit4] 2> 1030658 T5204 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@78986f6e{/ws_rk,null,AVAILABLE}
[junit4] 2> 1030663 T5204 oejs.AbstractConnector.doStart Started ServerConnector@5738aad6{SSL-http/1.1}{127.0.0.1:50445}
[junit4] 2> 1030664 T5204 oejs.Server.doStart Started @1033907ms
[junit4] 2> 1030666 T5204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 1030666 T5204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1030666 T5204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001
[junit4] 2> 1030666 T5204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/'
[junit4] 2> 1030706 T5204 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/solr.xml
[junit4] 2> 1030724 T5204 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores
[junit4] 2> 1030725 T5204 oasc.CoreContainer.<init> New CoreContainer 1771810122
[junit4] 2> 1030726 T5204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/]
[junit4] 2> 1030726 T5204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1030726 T5204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1030727 T5204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1030727 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1030728 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1030728 T5204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1030728 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1030728 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1030729 T5204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1030729 T5204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1030730 T5204 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1030735 T5204 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1030736 T5204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1030736 T5204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1030737 T5204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1030737 T5204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50437/solr
[junit4] 2> 1030738 T5204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1030738 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1030739 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1030743 T5260 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e620dc9 name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1030744 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1030744 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1030752 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1030755 T5263 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3045a03b name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1030755 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1030772 T5204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1031785 T5204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50445_ws_rk
[junit4] 2> 1031787 T5204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50445_ws_rk
[junit4] 2> 1031798 T5204 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1031804 T5204 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores
[junit4] 2> 1031805 T5204 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores/collection1/
[junit4] 2> 1031806 T5204 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1031810 T5264 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1031810 T5264 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1031811 T5264 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1031811 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1031815 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50445/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50445_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 3
[junit4] 2> 1031817 T5236 oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50445/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50445_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1031817 T5236 oasco.ClusterStateMutator.createCollection building a new cName: collection1
[junit4] 2> 1031817 T5236 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1031820 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1031820 T5263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1031820 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1032815 T5264 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1032815 T5264 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1032817 T5264 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1032817 T5264 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1032820 T5264 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1032820 T5264 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores/collection1/'
[junit4] 2> 1032844 T5264 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1032850 T5264 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1032860 T5264 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1032870 T5264 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1032892 T5264 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1032896 T5264 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1032905 T5264 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1033089 T5264 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1033091 T5264 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1033092 T5264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1033096 T5264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1033148 T5264 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1033149 T5264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1033149 T5264 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-1-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty1/
[junit4] 2> 1033149 T5264 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7182e71
[junit4] 2> 1033150 T5264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty1
[junit4] 2> 1033150 T5264 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty1/index/
[junit4] 2> 1033150 T5264 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1033151 T5264 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty1/index
[junit4] 2> 1033151 T5264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.37396387506435536]
[junit4] 2> 1033151 T5264 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@220dec0e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f52212b),segFN=segments_1,generation=1}
[junit4] 2> 1033152 T5264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1033155 T5264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1033156 T5264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1033156 T5264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1033157 T5264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1033157 T5264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1033157 T5264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1033158 T5264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1033158 T5264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1033158 T5264 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1033159 T5264 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1033159 T5264 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1033159 T5264 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1033160 T5264 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1033160 T5264 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 1033161 T5264 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 1033162 T5264 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 1033162 T5264 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 1033163 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 1033166 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 1033166 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 1033166 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 1033167 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 1033168 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 1033173 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 1033174 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 1033175 T5264 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1033175 T5264 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1033182 T5264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1033183 T5264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1033184 T5264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1033185 T5264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1033186 T5264 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
[junit4] 2> 1033189 T5264 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1033190 T5264 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1033191 T5264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=36, maxMergedSegmentMB=68.91796875, floorSegmentMB=0.3603515625, forceMergeDeletesPctAllowed=22.272590051176678, segmentsPerTier=29.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1033191 T5264 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@220dec0e lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1f52212b),segFN=segments_1,generation=1}
[junit4] 2> 1033191 T5264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1033192 T5264 oass.SolrIndexSearcher.<init> Opening Searcher@57a0d78d[collection1] main
[junit4] 2> 1033193 T5264 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1033195 T5264 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1033195 T5264 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1033197 T5264 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1033197 T5264 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1033197 T5264 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1033198 T5264 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1033199 T5264 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1033199 T5264 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1033199 T5264 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4] 2> 1033200 T5265 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@57a0d78d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1033201 T5264 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1033203 T5268 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:50445/ws_rk collection:collection1 shard:shard2
[junit4] 2> 1033204 T5204 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1033205 T5204 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1033210 T5268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 1033221 T5268 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 1033228 T5268 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1033229 T5268 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C3216 name=collection1 org.apache.solr.core.SolrCore@422d3684 url=https://127.0.0.1:50445/ws_rk/collection1 node=127.0.0.1:50445_ws_rk C3216_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=https://127.0.0.1:50445/ws_rk, node_name=127.0.0.1:50445_ws_rk, state=down}
[junit4] 2> 1033229 T5268 C3216 P50445 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:50445/ws_rk/collection1/
[junit4] 2> 1033229 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1033229 T5268 C3216 P50445 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1033230 T5268 C3216 P50445 oasc.SyncStrategy.syncToMe https://127.0.0.1:50445/ws_rk/collection1/ has no replicas
[junit4] 2> 1033231 T5268 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:50445/ws_rk/collection1/ shard2
[junit4] 2> 1033231 T5268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 1033248 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1"} current state version: 4
[junit4] 2> 1033276 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "operation":"leader",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "base_url":"https://127.0.0.1:50445/ws_rk",
[junit4] 2> "core":"collection1",
[junit4] 2> "state":"active"} current state version: 4
[junit4] 2> 1033302 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1033305 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1033306 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1033306 T5263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1033326 T5268 oasc.ZkController.register We are https://127.0.0.1:50445/ws_rk/collection1/ and leader is https://127.0.0.1:50445/ws_rk/collection1/
[junit4] 2> 1033326 T5268 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:50445/ws_rk
[junit4] 2> 1033327 T5268 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1033327 T5268 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1033327 T5268 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1033332 T5269 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1033336 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50445/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50445_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 5
[junit4] 2> 1033339 T5236 oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "core_node_name":"core_node1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50445/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50445_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"active",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1033449 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1033449 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1033449 T5263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1034800 T5204 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores/collection1
[junit4] 2> 1034803 T5204 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1034806 T5204 oejs.Server.doStart jetty-9.2.6.v20141205
[junit4] 2> 1034811 T5204 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@614b0226{/ws_rk,null,AVAILABLE}
[junit4] 2> 1034826 T5204 oejs.AbstractConnector.doStart Started ServerConnector@1cbfe4f0{SSL-http/1.1}{127.0.0.1:50448}
[junit4] 2> 1034827 T5204 oejs.Server.doStart Started @1038071ms
[junit4] 2> 1034829 T5204 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
[junit4] 2> 1034829 T5204 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1034830 T5204 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001
[junit4] 2> 1034831 T5204 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/'
[junit4] 2> 1034868 T5204 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/solr.xml
[junit4] 2> 1034888 T5204 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores
[junit4] 2> 1034889 T5204 oasc.CoreContainer.<init> New CoreContainer 2106122999
[junit4] 2> 1034889 T5204 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/]
[junit4] 2> 1034890 T5204 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1034890 T5204 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1034890 T5204 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1034891 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1034891 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
[junit4] 2> 1034891 T5204 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1034892 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1034893 T5204 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1034894 T5204 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1034894 T5204 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1034894 T5204 oashc.HttpShardHandlerFactory.getParameter Setting useRetries to: false
[junit4] 2> 1034896 T5204 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
[junit4] 2> 1034898 T5204 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1034899 T5204 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1034899 T5204 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1034899 T5204 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50437/solr
[junit4] 2> 1034899 T5204 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1034900 T5204 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
[junit4] 2> 1034901 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1034906 T5283 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a9d603 name:ZooKeeperConnection Watcher:127.0.0.1:50437 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1034906 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1034907 T5204 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
[junit4] 2> 1034913 T5204 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1034916 T5286 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c205ced name:ZooKeeperConnection Watcher:127.0.0.1:50437/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1034917 T5204 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1034933 T5204 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1035945 T5204 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50448_ws_rk
[junit4] 2> 1035947 T5204 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50448_ws_rk
[junit4] 2> 1035957 T5204 oasc.Overseer.close Overseer (id=null) closing
[junit4] 2> 1035962 T5204 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores
[junit4] 2> 1035964 T5204 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores/collection1/
[junit4] 2> 1035964 T5204 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1035968 T5287 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1035968 T5287 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1035969 T5235 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
[junit4] 2> 1035969 T5287 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1035972 T5236 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50448/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50448_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"} current state version: 6
[junit4] 2> 1035974 T5236 oasco.ReplicaMutator.updateState Update state numShards=4 message={
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "base_url":"https://127.0.0.1:50448/ws_rk",
[junit4] 2> "node_name":"127.0.0.1:50448_ws_rk",
[junit4] 2> "numShards":"4",
[junit4] 2> "state":"down",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "operation":"state"}
[junit4] 2> 1035975 T5236 oasco.ReplicaMutator.updateState Collection already exists with numShards=4
[junit4] 2> 1035975 T5236 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1035978 T5235 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1035978 T5263 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1035978 T5286 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1035978 T5246 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1036971 T5287 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1036971 T5287 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1036973 T5287 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1036973 T5287 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1036976 T5287 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1036976 T5287 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores/collection1/'
[junit4] 2> 1036993 T5287 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
[junit4] 2> 1036999 T5287 oasc.Config.<init> loaded config solrconfig.xml with version 0
[junit4] 2> 1037010 T5287 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
[junit4] 2> 1037026 T5287 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
[junit4] 2> 1037048 T5287 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1037051 T5287 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
[junit4] 2> 1037055 T5287 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1037248 T5287 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1037251 T5287 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1037256 T5287 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1037261 T5287 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1037314 T5287 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1037314 T5287 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1037315 T5287 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/shard-2-001/cores/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty2/
[junit4] 2> 1037315 T5287 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@7182e71
[junit4] 2> 1037316 T5287 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty2
[junit4] 2> 1037316 T5287 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty2/index/
[junit4] 2> 1037316 T5287 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1037317 T5287 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestRebalanceLeaders EBDE05C83D3A332A-001/tempDir-001/jetty2/index
[junit4] 2> 1037317 T5287 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=25, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.37396387506435536]
[junit4] 2> 1037318 T5287 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@6dd40643 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f3b6c2b),segFN=segments_1,generation=1}
[junit4] 2> 1037318 T5287 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1037321 T5287 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1037321 T5287 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1037322 T5287 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1037322 T5287 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1037322 T5287 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1037322 T5287 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1037324 T5287 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1037324 T5287 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1037324 T5287 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1037325 T5287 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1037325 T5287 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1037326 T5287 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1037326 T5287 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
[junit4] 2> 1037326 T5287 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
[junit4] 2> 1037327 T5287 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
[junit4] 2> 1037327 T5287 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
[junit4] 2> 1037328 T5287 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
[junit4] 2> 1037328 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
[junit4] 2> 1037330 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
[junit4] 2> 1037330 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
[junit4] 2> 1037330 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
[junit4] 2> 1037331 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
[junit4] 2> 1037331 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
[junit4] 2> 1037332 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
[junit4] 2> 1037333 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
[junit4] 2> 1037333 T5287 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1037334 T5287 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1037341 T5287 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1037343 T5287 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[...truncated too long message...]
e.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] 2> 39) Thread[id=7201, name=searcherExecutor-3616-thread-1, state=WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 40) Thread[id=7163, name=coreZkRegister-3603-thread-1, state=WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
[junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 41) Thread[id=7152, name=org.eclipse.jetty.server.session.HashSessionManager@62ccbe57Timer, state=TIMED_WAITING, group=TGRP-ReplicationFactorTest]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 42) Thread[id=7086, name=OverseerHdfsCoreFailoverThread-93258179079110659-127.0.0.1:50959__rps%2Ffi-n_0000000000, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
[junit4] 2> at java.lang.Thread.sleep(Native Method)
[junit4] 2> at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:137)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), intDefault=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128), text=PostingsFormat(name=LuceneFixedGap), range_facet_l=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{timestamp=DocValuesFormat(name=Asserting)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=ms, timezone=Asia/Dushanbe
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_31 (64-bit)/cpus=2,threads=73,free=194963440,total=380542976
[junit4] 2> NOTE: All tests run in this JVM: [AlternateDirectoryTest, ResponseHeaderTest, EchoParamsTest, TestDistribDocBasedVersion, TestManagedSchemaFieldTypeResource, TestFieldTypeCollectionResource, TestBinaryField, MoreLikeThisHandlerTest, ZkStateWriterTest, TestFreeTextSuggestions, CSVRequestHandlerTest, SolrIndexSplitterTest, TestMaxScoreQueryParser, TestLMDirichletSimilarityFactory, SSLMigrationTest, TestIntervalFaceting, TestReversedWildcardFilterFactory, SharedFSAutoReplicaFailoverTest, SignatureUpdateProcessorFactoryTest, TestManagedSynonymFilterFactory, TestJmxMonitoredMap, HdfsWriteToMultipleCollectionsTest, HdfsChaosMonkeySafeLeaderTest, ExitableDirectoryReaderTest, ZkNodePropsTest, DistributedQueryComponentCustomSortTest, TestLRUStatsCache, SolrCoreTest, MultiThreadedOCPTest, TestSchemaSimilarityResource, TestFastOutputStream, UpdateParamsTest, ClusterStateTest, ExternalFileFieldSortTest, DocValuesTest, TestDefaultStatsCache, CursorPagingTest, TestDefaultSearchFieldResource, SimpleMLTQParserTest, InfoHandlerTest, TestBlendedInfixSuggestions, DocValuesMissingTest, SampleTest, TestSearcherReuse, TestDefaultSimilarityFactory, ClusterStateUpdateTest, TestReplicationHandler, SolrCoreCheckLockOnStartupTest, TestLeaderElectionZkExpiry, TestBlobHandler, TestCollectionAPI, TestBadConfig, TestCollapseQParserPlugin, DistanceUnitsTest, TestFunctionQuery, TimeZoneUtilsTest, BasicDistributedZk2Test, TestAnalyzeInfixSuggestions, TestFileDictionaryLookup, TestSearchPerf, TestSurroundQueryParser, CursorMarkTest, DistributedIntervalFacetingTest, BufferStoreTest, ChaosMonkeyNothingIsSafeTest, BadIndexSchemaTest, TestDocSet, TestIndexSearcher, LoggingHandlerTest, TestSolrJ, TestValueSourceCache, IndexSchemaTest, TestConfig, OutOfBoxZkACLAndCredentialsProvidersTest, TestCharFilters, HighlighterConfigTest, MultiTermTest, TestJmxIntegration, TestIBSimilarityFactory, CachingDirectoryFactoryTest, DistributedFacetPivotLongTailTest, QueryParsingTest, DeleteReplicaTest, TestCoreDiscovery, AliasIntegrationTest, TestPostingsSolrHighlighter, StressHdfsTest, TestInitParams, TestExactStatsCache, PolyFieldTest, FacetPivotSmallTest, TestSolrCoreProperties, DirectUpdateHandlerOptimizeTest, TestClusterStateMutator, QueryElevationComponentTest, PathHierarchyTokenizerFactoryTest, TestFieldResource, CloudMLTQParserTest, SpatialFilterTest, TestFastLRUCache, HardAutoCommitTest, CoreAdminHandlerTest, HdfsUnloadDistributedZkTest, HdfsBasicDistributedZk2Test, BasicDistributedZkTest, DisMaxRequestHandlerTest, HdfsRecoveryZkTest, CopyFieldTest, TestChildDocTransformer, DistributedQueryComponentOptimizationTest, TestWordDelimiterFilterFactory, TestRestManager, TestRangeQuery, TestExpandComponent, LeaderInitiatedRecoveryOnCommitTest, TestRebalanceLeaders, TestDFRSimilarityFactory, CircularListTest, SOLR749Test, ReturnFieldsTest, CollectionsAPIDistributedZkTest, SolrTestCaseJ4Test, TestGroupingSearch, TestSolrConfigHandler, TestCloudInspectUtil, RAMDirectoryFactoryTest, TestHighlightDedupGrouping, ChangedSchemaMergeTest, TestHashPartitioner, AnalyticsMergeStrategyTest, TestFieldCollectionResource, AnalyticsQueryTest, DistributedFacetPivotSmallAdvancedTest, FieldAnalysisRequestHandlerTest, TestSortingResponseWriter, RemoteQueryErrorTest, TestJoin, PingRequestHandlerTest, TestCloudPivotFacet, AsyncMigrateRouteKeyTest, TestRequestStatusCollectionAPI, VMParamsZkACLAndCredentialsProvidersTest, TestNoOpRegenerator, StandardRequestHandlerTest, TestAnalyzedSuggestions, TestDocumentBuilder, TestSolrDeletionPolicy2, ReplicationFactorTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ReplicationFactorTest -Dtests.seed=EBDE05C83D3A332A -Dtests.slow=true -Dtests.locale=ms -Dtests.timezone=Asia/Dushanbe -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s | ReplicationFactorTest (suite) <<<
[junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4] > at __randomizedtesting.SeedInfo.seed([EBDE05C83D3A332A]:0)
[junit4] Completed in 7224.46s, 1 test, 2 errors <<< FAILURES!
[...truncated 941 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:191: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1348: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 463 suites, 1848 tests, 1 suite-level error, 2 errors, 1276 ignored (13 assumptions)
Total time: 180 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any