You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/07/07 21:09:31 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_20-ea-b21) -
Build # 10750 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10750/
Java: 32bit/jdk1.8.0_20-ea-b21 -server -XX:+UseParallelGC
3 tests failed.
REGRESSION: org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection
Error Message:
No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
Stack Trace:
org.apache.solr.common.SolrException: No registered leader was found after waiting for 30000ms , collection: collection1 slice: shard1
at __randomizedtesting.SeedInfo.seed([60E8CF8C6AC6EA00:3EDC02C229B976E7]:0)
at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:567)
at org.apache.solr.cloud.LeaderElectionIntegrationTest.getLeader(LeaderElectionIntegrationTest.java:255)
at org.apache.solr.cloud.LeaderElectionIntegrationTest.testSimpleSliceLeaderElection(LeaderElectionIntegrationTest.java:179)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerTest.testReplay
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:55398/solr within 30000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:55398/solr within 30000 ms
at __randomizedtesting.SeedInfo.seed([60E8CF8C6AC6EA00:2821C7C884F59B7B]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:151)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:102)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:97)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:84)
at org.apache.solr.cloud.OverseerTest.testReplay(OverseerTest.java:899)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:55398/solr within 30000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:143)
... 44 more
REGRESSION: org.apache.solr.cloud.OverseerTest.testDoubleAssignment
Error Message:
Illegal state, was:null expected:recoveringclusterState:live nodes:[node1] collections:{}
Stack Trace:
java.lang.AssertionError: Illegal state, was:null expected:recoveringclusterState:live nodes:[node1] collections:{}
at __randomizedtesting.SeedInfo.seed([60E8CF8C6AC6EA00:20AD9C67219BFF56]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.OverseerTest.verifyStatus(OverseerTest.java:580)
at org.apache.solr.cloud.OverseerTest.testDoubleAssignment(OverseerTest.java:806)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11229 lines...]
[junit4] Suite: org.apache.solr.cloud.LeaderElectionIntegrationTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/init-core-data-001
[junit4] 2> 551360 T2248 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 551362 T2248 oas.SolrTestCaseJ4.setUp ###Starting testLeaderElectionAfterClientTimeout
[junit4] 2> 551363 T2248 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 551363 T2249 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 551463 T2248 oasc.ZkTestServer.run start zk server on port:38793
[junit4] 2> 551464 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 551742 T2255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d1f908 name:ZooKeeperConnection Watcher:127.0.0.1:38793 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 551742 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 551743 T2248 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 551751 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 551753 T2257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd5b62 name:ZooKeeperConnection Watcher:127.0.0.1:38793/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 551753 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 551753 T2248 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 551757 T2248 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 551760 T2248 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 551762 T2248 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 551764 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 551765 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 551771 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 551772 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 551776 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 551777 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 551782 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 551783 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 551786 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 551787 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 551790 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 551791 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 551794 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 551795 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 551799 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 551800 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 551803 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 551804 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 551808 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 551809 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 551812 T2248 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 551812 T2248 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 551816 T2248 oasc.LeaderElectionIntegrationTest.setUp ####SETUP_START testLeaderElectionAfterClientTimeout
[junit4] 2> 551818 T2248 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 551818 T2248 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
[junit4] 2> 551819 T2248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 551837 T2248 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 551844 T2248 oasc.CoreContainer.<init> New CoreContainer 32549169
[junit4] 2> 551844 T2248 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 551845 T2248 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 551845 T2248 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 551845 T2248 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 551846 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 551846 T2248 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 551846 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 551846 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 551846 T2248 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 551847 T2248 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 551848 T2248 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 551849 T2248 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 551849 T2248 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 551849 T2248 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38793/solr
[junit4] 2> 551850 T2248 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 551850 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 551852 T2259 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a38bed name:ZooKeeperConnection Watcher:127.0.0.1:38793 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 551853 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 551856 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 551858 T2261 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a8949b name:ZooKeeperConnection Watcher:127.0.0.1:38793/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 551858 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 551859 T2248 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 551861 T2248 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 551862 T2248 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 551865 T2248 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 551866 T2248 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 551868 T2248 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 551869 T2248 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7000_solr
[junit4] 2> 551870 T2248 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7000_solr
[junit4] 2> 551871 T2248 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 551872 T2248 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 551873 T2248 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:7000_solr
[junit4] 2> 551874 T2248 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 551875 T2248 oasc.Overseer.start Overseer (id=92062279641071619-127.0.0.1:7000_solr-n_0000000000) starting
[junit4] 2> 551876 T2248 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 551884 T2263 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 551884 T2248 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 551886 T2248 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 551887 T2248 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 551888 T2262 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 551889 T2264 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 551889 T2264 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 551890 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 551890 T2264 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 551891 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 551891 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7000/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7000_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 551892 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 551893 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 552890 T2264 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 552891 T2264 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 552892 T2264 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 552892 T2264 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 552894 T2264 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 552894 T2264 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 552895 T2264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 552896 T2264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 552896 T2264 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 552945 T2264 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 552970 T2264 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 552972 T2264 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 552979 T2264 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 553065 T2264 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 553069 T2264 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 553070 T2264 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 553078 T2264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 553079 T2264 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 553080 T2264 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 553081 T2264 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 553081 T2264 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 553081 T2264 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 553082 T2264 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 553082 T2264 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 553082 T2264 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 553082 T2264 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 553083 T2264 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-001/
[junit4] 2> 553083 T2264 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1ffc9
[junit4] 2> 553083 T2264 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-001
[junit4] 2> 553084 T2264 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-001/index/
[junit4] 2> 553084 T2264 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-001/index' doesn't exist. Creating new index...
[junit4] 2> 553084 T2264 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-001/index
[junit4] 2> 553084 T2264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8726375915928645]
[junit4] 2> 553085 T2264 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@d001ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@23d6d9)),segFN=segments_1,generation=1}
[junit4] 2> 553085 T2264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 553085 T2264 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 553087 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 553087 T2264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 553088 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 553088 T2264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 553088 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 553088 T2264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 553088 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 553089 T2264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 553089 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 553089 T2264 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 553089 T2264 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 553090 T2264 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 553090 T2264 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 553090 T2264 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 553090 T2264 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 553090 T2264 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 553091 T2264 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 553091 T2264 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 553091 T2264 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 553092 T2264 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 553092 T2264 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 553092 T2264 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 553092 T2264 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 553092 T2264 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 553093 T2264 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 553093 T2264 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553093 T2264 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553093 T2264 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553094 T2264 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553094 T2264 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553094 T2264 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553094 T2264 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553094 T2264 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 553095 T2264 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 553095 T2264 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 553097 T2264 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 553097 T2264 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 553098 T2264 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 553098 T2264 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 553099 T2264 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=74.9052734375, floorSegmentMB=0.9638671875, forceMergeDeletesPctAllowed=29.75252009259534, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4833628024630221
[junit4] 2> 553099 T2264 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@d001ab lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@23d6d9)),segFN=segments_1,generation=1}
[junit4] 2> 553099 T2264 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 553100 T2264 oass.SolrIndexSearcher.<init> Opening Searcher@1d3fa54[collection1] main
[junit4] 2> 553100 T2264 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 553101 T2264 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 553101 T2264 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 553101 T2264 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 553101 T2264 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 553102 T2264 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
[junit4] 2> 553102 T2264 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 553102 T2264 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 553112 T2264 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 553137 T2265 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d3fa54[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 553140 T2264 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 553141 T2268 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7000/solr collection:collection1 shard:shard1
[junit4] 2> 553142 T2268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 553143 T2248 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 553143 T2248 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
[junit4] 2> 553144 T2248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 553149 T2268 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 553152 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553154 T2268 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 553154 T2268 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 553154 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 553154 T2268 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:7000/solr/collection1/ shard1
[junit4] 2> 553155 T2268 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 553157 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553161 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553164 T2248 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 553169 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553175 T2248 oasc.CoreContainer.<init> New CoreContainer 22138681
[junit4] 2> 553176 T2248 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 553176 T2248 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 553176 T2248 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 553177 T2248 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 553177 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 553177 T2248 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 553177 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 553178 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 553178 T2248 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 553178 T2248 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 553180 T2248 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 553181 T2248 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 553181 T2248 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 553181 T2248 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38793/solr
[junit4] 2> 553182 T2248 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 553183 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 553185 T2270 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@242be4 name:ZooKeeperConnection Watcher:127.0.0.1:38793 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 553186 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 553188 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 553188 T2250 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x1471227d3380004, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 553191 T2272 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@eb9fd5 name:ZooKeeperConnection Watcher:127.0.0.1:38793/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 553191 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 553195 T2248 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 553272 T2272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 553272 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 553312 T2268 oasc.ZkController.register We are http://127.0.0.1:7000/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 553312 T2268 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7000/solr
[junit4] 2> 553312 T2268 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 553313 T2268 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 553313 T2268 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 553315 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553315 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553315 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553315 T2268 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 553316 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 553316 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7000/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7000_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 553317 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 553419 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 553419 T2272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 554197 T2248 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7001_solr
[junit4] 2> 554199 T2248 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7001_solr
[junit4] 2> 554208 T2273 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 554209 T2273 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 554210 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 554210 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 554210 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 554210 T2273 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 554212 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 554213 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7001/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7001_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 554216 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 554319 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 554319 T2272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 555211 T2273 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 555212 T2273 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 555213 T2273 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 555213 T2273 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 555215 T2273 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 555215 T2273 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 555216 T2273 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 555217 T2273 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 555217 T2273 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 555269 T2273 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 555295 T2273 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 555296 T2273 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 555300 T2273 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 555383 T2273 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 555386 T2273 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 555387 T2273 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 555398 T2273 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 555400 T2273 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 555402 T2273 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 555403 T2273 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 555403 T2273 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 555403 T2273 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 555404 T2273 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 555405 T2273 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 555405 T2273 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 555405 T2273 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 555405 T2273 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-002/
[junit4] 2> 555405 T2273 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1ffc9
[junit4] 2> 555406 T2273 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-002
[junit4] 2> 555406 T2273 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-002/index/
[junit4] 2> 555406 T2273 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-002/index' doesn't exist. Creating new index...
[junit4] 2> 555406 T2273 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-002/index
[junit4] 2> 555407 T2273 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8726375915928645]
[junit4] 2> 555407 T2273 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@10b0208 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4e04)),segFN=segments_1,generation=1}
[junit4] 2> 555408 T2273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 555408 T2273 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 555411 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 555411 T2273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 555412 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 555412 T2273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 555412 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 555412 T2273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 555412 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 555413 T2273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 555413 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 555413 T2273 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 555414 T2273 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 555414 T2273 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 555414 T2273 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 555414 T2273 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 555415 T2273 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 555415 T2273 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 555415 T2273 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 555416 T2273 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 555416 T2273 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 555416 T2273 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 555416 T2273 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 555417 T2273 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 555417 T2273 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 555417 T2273 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 555417 T2273 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 555417 T2273 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555418 T2273 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555418 T2273 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555418 T2273 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555419 T2273 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555419 T2273 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555419 T2273 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555419 T2273 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 555420 T2273 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 555420 T2273 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 555421 T2273 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 555421 T2273 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 555422 T2273 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 555423 T2273 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 555423 T2273 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=74.9052734375, floorSegmentMB=0.9638671875, forceMergeDeletesPctAllowed=29.75252009259534, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4833628024630221
[junit4] 2> 555423 T2273 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@10b0208 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4e04)),segFN=segments_1,generation=1}
[junit4] 2> 555424 T2273 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 555424 T2273 oass.SolrIndexSearcher.<init> Opening Searcher@1a45b34[collection1] main
[junit4] 2> 555424 T2273 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 555425 T2273 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 555425 T2273 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 555426 T2273 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 555426 T2273 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 555426 T2273 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
[junit4] 2> 555426 T2273 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 555426 T2273 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 555433 T2273 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 555469 T2274 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a45b34[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 555475 T2273 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 555477 T2277 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7001/solr collection:collection1 shard:shard1
[junit4] 2> 555479 T2248 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 555480 T2248 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
[junit4] 2> 555480 T2277 oasc.ZkController.register We are http://127.0.0.1:7001/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 555481 T2248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 555481 T2277 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7001/solr
[junit4] 2> 555482 T2277 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 555482 T2277 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 555482 T2277 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 555483 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 555484 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 555484 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 555484 T2277 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 555485 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 555485 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7001/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7001_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 555487 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 555505 T2248 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 555516 T2248 oasc.CoreContainer.<init> New CoreContainer 20815901
[junit4] 2> 555517 T2248 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/]
[junit4] 2> 555517 T2248 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 555517 T2248 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: https
[junit4] 2> 555518 T2248 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 555518 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 555518 T2248 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 555518 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 555518 T2248 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 555519 T2248 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 555519 T2248 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 555521 T2248 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 555521 T2248 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 555522 T2248 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 555522 T2248 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:38793/solr
[junit4] 2> 555522 T2248 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 555523 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 555527 T2279 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1134c64 name:ZooKeeperConnection Watcher:127.0.0.1:38793 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 555528 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 555531 T2248 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 555533 T2281 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb9b82 name:ZooKeeperConnection Watcher:127.0.0.1:38793/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 555533 T2248 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 555539 T2248 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 555589 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 555589 T2272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 555589 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 556542 T2248 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:7002_solr
[junit4] 2> 556544 T2248 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:7002_solr
[junit4] 2> 556553 T2282 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 556553 T2282 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 556555 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 556555 T2282 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 556555 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 556556 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 556558 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 556559 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:7002/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7002_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":null}
[junit4] 2> 556561 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 556663 T2261 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 556663 T2272 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 556663 T2281 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 557556 T2282 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 557556 T2282 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 557557 T2282 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 557557 T2282 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 557559 T2282 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 557559 T2282 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 557560 T2282 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 557560 T2282 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 557561 T2282 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 557621 T2282 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 557650 T2282 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 557651 T2282 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 557655 T2282 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 557726 T2282 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 557729 T2282 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 557730 T2282 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 557743 T2282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 557746 T2282 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 557747 T2282 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 557748 T2282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 557748 T2282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 557749 T2282 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 557749 T2282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 557749 T2282 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 557750 T2282 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 557750 T2282 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 557750 T2282 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-003/
[junit4] 2> 557750 T2282 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e1ffc9
[junit4] 2> 557751 T2282 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-003
[junit4] 2> 557751 T2282 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-003/index/
[junit4] 2> 557751 T2282 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-003/index' doesn't exist. Creating new index...
[junit4] 2> 557751 T2282 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.LeaderElectionIntegrationTest-60E8CF8C6AC6EA00-001/tempDir-003/index
[junit4] 2> 557752 T2282 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=40, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8726375915928645]
[junit4] 2> 557752 T2282 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@114eed8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10c6c75)),segFN=segments_1,generation=1}
[junit4] 2> 557752 T2282 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 557753 T2282 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 557755 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 557755 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 557755 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 557756 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 557757 T2282 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 557757 T2282 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 557757 T2282 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 557757 T2282 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 557757 T2282 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 557758 T2282 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 557758 T2282 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 557758 T2282 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 557758 T2282 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 557759 T2282 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 557759 T2282 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 557759 T2282 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 557760 T2282 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 557760 T2282 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 557760 T2282 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 557760 T2282 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 557760 T2282 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557761 T2282 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557761 T2282 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557761 T2282 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557762 T2282 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557762 T2282 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557762 T2282 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557762 T2282 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 557763 T2282 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 557763 T2282 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 557764 T2282 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 557765 T2282 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 557766 T2282 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 557766 T2282 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 557772 T2282 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=35, maxMergedSegmentMB=74.9052734375, floorSegmentMB=0.9638671875, forceMergeDeletesPctAllowed=29.75252009259534, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4833628024630221
[junit4] 2> 557772 T2282 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@114eed8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10c6c75)),segFN=segments_1,generation=1}
[junit4] 2> 557773 T2282 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 557773 T2282 oass.SolrIndexSearcher.<init> Opening Searcher@1c0969f[collection1] main
[junit4] 2> 557773 T2282 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 557774 T2282 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 557774 T2282 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 557774 T2282 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 557774 T2282 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 557774 T2282 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using InMemoryStorage
[junit4] 2> 557775 T2282 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 557775 T2282 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 557780 T2282 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 557801 T2283 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c0969f[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 557806 T2282 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 557807 T2286 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:7002/solr collection:collection1 shard:shard1
[junit4] 2> 557809 T2248 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 557809 T2248 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr
[junit4] 2> 557810 T2248 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/'
[junit4] 2> 557811 T2286 oasc.ZkController.register We are http://127.0.0.1:7002/solr/collection1/ and leader is http://127.0.0.1:7000/solr/collection1/
[junit4] 2> 557811 T2286 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:7002/solr
[junit4] 2> 557811 T2286 oasc.ZkController.checkRecovery WARN Skipping recovery according to sys prop solrcloud.skip.autorecovery
[junit4] 2> 557811 T2286 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 557812 T2286 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 557813 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 557813 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 557814 T2286 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 557814 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 557815 T2262 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 557816 T2262 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:7002/solr",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:7002_solr",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":null,
[junit4] 2> "core_node_name":"core_node3"}
[junit4] 2> 557818 T2261 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 557827 T2248 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/solr.xml
[junit4] 2> 557837 T2248 oasc.CoreContainer.<init> New CoreContainer 10525552
[junit4] 2> 557837 T2248 oasc.CoreContainer.load Loading cores into CoreContainer [insta
[...truncated too long message...]
0.0.1:43773_solr
[junit4] 2> 1086018 T6109 oasc.Overseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:317)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 1086019 T5602 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 1086019 T5602 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 1086830 T6108 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1086830 T6108 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1086831 T6108 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1089020 T5602 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./temp/solr.cloud.OverseerTest-60E8CF8C6AC6EA00-001
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=sr__#Latn, timezone=America/Marigot
[junit4] 2> NOTE: Linux 3.8.0-42-generic i386/Oracle Corporation 1.8.0_20-ea (32-bit)/cpus=8,threads=1,free=117862024,total=497287168
[junit4] 2> NOTE: All tests run in this JVM: [TestReRankQParserPlugin, SignatureUpdateProcessorFactoryTest, TestManagedResource, TestConfig, SimpleFacetsTest, TestFastLRUCache, SuggesterTSTTest, TestFastOutputStream, TestFuzzyAnalyzedSuggestions, TestCloudInspectUtil, DirectUpdateHandlerTest, TestReplicationHandler, BadCopyFieldTest, DocValuesMultiTest, PluginInfoTest, DocValuesMissingTest, SuggesterTest, SpellCheckCollatorTest, ChangedSchemaMergeTest, TestComponentsName, TestSchemaResource, BadIndexSchemaTest, TestLMDirichletSimilarityFactory, DisMaxRequestHandlerTest, OverseerCollectionProcessorTest, TestSolrJ, CoreAdminHandlerTest, TestManagedStopFilterFactory, QueryFacetTest, CustomCollectionTest, AnalyticsQueryTest, RAMDirectoryFactoryTest, TestBinaryResponseWriter, HdfsRecoveryZkTest, FieldFacetExtrasTest, TestExceedMaxTermLength, TestSearcherReuse, AnalysisErrorHandlingTest, JSONWriterTest, BadComponentTest, TestAddFieldRealTimeGet, TestCloudManagedSchemaConcurrent, TestSolrQueryParserDefaultOperatorResource, TestFoldingMultitermQuery, PrimitiveFieldTypeTest, TestStressVersions, HdfsDirectoryTest, TestSearchPerf, TestDistributedMissingSort, TestReload, HighlighterConfigTest, ZkControllerTest, NotRequiredUniqueKeyTest, SpellingQueryConverterTest, HttpPartitionTest, RemoteQueryErrorTest, SuggesterWFSTTest, DistributedSpellCheckComponentTest, StandardRequestHandlerTest, TestLMJelinekMercerSimilarityFactory, TestInitQParser, ZkNodePropsTest, MBeansHandlerTest, DistribCursorPagingTest, DocumentBuilderTest, PreAnalyzedUpdateProcessorTest, TestRandomDVFaceting, TestDocSet, TestTrie, PingRequestHandlerTest, SpellCheckComponentTest, TestRemoteStreaming, TestSchemaNameResource, TestDocBasedVersionConstraints, TestManagedSchemaFieldResource, TriLevelCompositeIdRoutingTest, CursorMarkTest, ResponseLogComponentTest, SolrCoreCheckLockOnStartupTest, InfoHandlerTest, RecoveryZkTest, TestMiniSolrCloudCluster, TestArbitraryIndexDir, SyncSliceTest, HdfsCollectionsAPIDistributedZkTest, HighlighterTest, ShardRoutingTest, TestDFRSimilarityFactory, FileUtilsTest, DirectSolrSpellCheckerTest, MigrateRouteKeyTest, TestCodecSupport, EchoParamsTest, XsltUpdateRequestHandlerTest, TestReplicationHandlerBackup, CachingDirectoryFactoryTest, MoreLikeThisHandlerTest, PrimUtilsTest, FieldFacetTest, TestFieldTypeCollectionResource, SolrCmdDistributorTest, ChaosMonkeySafeLeaderTest, OverseerTest]
[junit4] Completed on J0 in 135.48s, 9 tests, 1 failure, 1 error <<< FAILURES!
[...truncated 624 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 416 suites, 1706 tests, 2 errors, 1 failure, 38 ignored (17 assumptions)
Total time: 72 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_20-ea-b21 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_05) - Build #
10751 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10751/
Java: 32bit/jdk1.8.0_05 -server -XX:+UseParallelGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 46 from https://127.0.0.1:43936/collection1lastClient and got 41 from https://127.0.0.1:43325/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 46 from https://127.0.0.1:43936/collection1lastClient and got 41 from https://127.0.0.1:43325/collection1
at __randomizedtesting.SeedInfo.seed([7B17D3C1B3FBCCB:8657F3246C60DCF7]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1132)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1111)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 10785 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/init-core-data-001
[junit4] 2> 5752 T30 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 5753 T30 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 5763 T30 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 5766 T30 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 5770 T31 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 5870 T30 oasc.ZkTestServer.run start zk server on port:49456
[junit4] 2> 5942 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 5966 T32 oazs.NIOServerCnxn.doIO WARN Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
[junit4] 2> 7231 T37 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f0d5 name:ZooKeeperConnection Watcher:127.0.0.1:49456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 7232 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 7233 T30 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 7254 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 7260 T39 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c55c92 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 7262 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 7266 T30 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 7273 T30 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 7277 T30 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 7282 T30 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 7286 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 7286 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 7294 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 7295 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 7298 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 7299 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 7302 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 7303 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 7308 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 7309 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 7313 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 7314 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 7320 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 7321 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 7328 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 7328 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 7334 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 7335 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 7337 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 7338 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 7343 T30 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 7343 T30 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 7349 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 7350 T41 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@155ef9c name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 7351 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 7897 T30 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 8215 T30 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 8284 T30 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:57990
[junit4] 2> 8346 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 8353 T30 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 8356 T30 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002
[junit4] 2> 8357 T30 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/'
[junit4] 2> 8376 T30 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/solr.xml
[junit4] 2> 8401 T30 oasc.CoreContainer.<init> New CoreContainer 19452443
[junit4] 2> 8402 T30 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/]
[junit4] 2> 8424 T30 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 8425 T30 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 8425 T30 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 8427 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 8428 T30 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 8428 T30 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 8429 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 8429 T30 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 8430 T30 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 8434 T30 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 8434 T30 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 8435 T30 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 8435 T30 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49456/solr
[junit4] 2> 8455 T30 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 8456 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 8460 T53 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1952b16 name:ZooKeeperConnection Watcher:127.0.0.1:49456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 8461 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 8472 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 8475 T55 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9b150 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 8475 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 8485 T30 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 8498 T30 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 8505 T30 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 8515 T30 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 8524 T30 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 8547 T30 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 8551 T30 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57990_
[junit4] 2> 8555 T30 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57990_
[junit4] 2> 8561 T30 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 8567 T30 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 8588 T30 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:57990_
[junit4] 2> 8588 T30 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 8592 T30 oasc.Overseer.start Overseer (id=92062827431985156-127.0.0.1:57990_-n_0000000000) starting
[junit4] 2> 8605 T30 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 8634 T57 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 8634 T30 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 8648 T30 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 8651 T30 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 8663 T56 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 8687 T58 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 8688 T58 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 8691 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 8691 T58 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 8696 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 8698 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:57990",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57990_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 8698 T56 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 8709 T56 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 8716 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 8729 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 9692 T58 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 9692 T58 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 9693 T58 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 9693 T58 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 9696 T58 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 9697 T58 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/collection1/'
[junit4] 2> 9698 T58 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 9698 T58 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 9699 T58 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 9763 T58 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 9782 T58 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 9784 T58 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 9803 T58 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 9975 T58 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 9977 T58 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 9978 T58 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 9992 T58 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 10063 T58 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 10063 T58 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 10076 T58 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/
[junit4] 2> 10077 T58 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1328809
[junit4] 2> 10094 T58 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data
[junit4] 2> 10103 T58 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/index/
[junit4] 2> 10107 T58 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 10107 T58 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/index
[junit4] 2> 10108 T58 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28924743974070166]
[junit4] 2> 10133 T58 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 10134 T58 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 10148 T58 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 10149 T58 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 10149 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 10149 T58 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 10149 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 10150 T58 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 10150 T58 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 10151 T58 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 10151 T58 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 10152 T58 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 10153 T58 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 10154 T58 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 10154 T58 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 10155 T58 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 10156 T58 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 10157 T58 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 10157 T58 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 10160 T58 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 10166 T58 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 10166 T58 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 10168 T58 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.7900390625, floorSegmentMB=1.783203125, forceMergeDeletesPctAllowed=8.971932139927636, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5924259230260053
[junit4] 2> 10172 T58 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 10173 T58 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 10173 T58 oass.SolrIndexSearcher.<init> Opening Searcher@1722970[collection1] main
[junit4] 2> 10174 T58 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 10175 T58 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 10176 T58 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 10181 T58 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 10181 T58 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 10182 T58 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10183 T58 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 10183 T58 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10185 T58 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
[junit4] 2> 10188 T58 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
[junit4] 2> 10188 T58 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 10189 T58 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 10195 T59 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1722970[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 10202 T58 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 10203 T62 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:57990 collection:control_collection shard:shard1
[junit4] 2> 10204 T30 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 10204 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 10213 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 10226 T62 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 10228 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10229 T62 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 10230 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 10230 T62 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@f82f5a url=https://127.0.0.1:57990/collection1 node=127.0.0.1:57990_ C4_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:57990, core=collection1, node_name=127.0.0.1:57990_}
[junit4] 2> 10232 T62 C4 P57990 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:57990/collection1/
[junit4] 2> 10233 T62 C4 P57990 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 10234 T62 C4 P57990 oasc.SyncStrategy.syncToMe https://127.0.0.1:57990/collection1/ has no replicas
[junit4] 2> 10234 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10237 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 10237 T62 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:57990/collection1/ shard1
[junit4] 2> 10245 T62 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 10248 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 10255 T64 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70bc04 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10256 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 10261 T30 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 10263 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10265 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 10267 T30 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 10280 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10382 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 10382 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 10415 T62 oasc.ZkController.register We are https://127.0.0.1:57990/collection1/ and leader is https://127.0.0.1:57990/collection1/
[junit4] 2> 10416 T62 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:57990
[junit4] 2> 10416 T62 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 10416 T62 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 10416 T62 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 10418 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10418 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10418 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10418 T62 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 10420 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 10421 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:57990",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:57990_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 10424 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 10526 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 10526 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 10595 T30 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 10596 T30 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 10601 T30 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 10603 T30 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:56804
[junit4] 2> 10606 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 10606 T30 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 10606 T30 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003
[junit4] 2> 10607 T30 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/'
[junit4] 2> 10619 T30 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/solr.xml
[junit4] 2> 10631 T30 oasc.CoreContainer.<init> New CoreContainer 10582896
[junit4] 2> 10631 T30 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/]
[junit4] 2> 10632 T30 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 10632 T30 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 10632 T30 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 10632 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 10633 T30 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 10633 T30 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 10633 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 10634 T30 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 10634 T30 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 10637 T30 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 10637 T30 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 10637 T30 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 10638 T30 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49456/solr
[junit4] 2> 10638 T30 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 10639 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 10641 T75 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9d87e3 name:ZooKeeperConnection Watcher:127.0.0.1:49456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10643 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 10646 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 10656 T77 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15cf951 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 10656 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 10672 T30 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 11676 T30 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56804_
[junit4] 2> 11677 T30 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56804_
[junit4] 2> 11688 T78 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 11688 T78 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 11690 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 11691 T78 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 11692 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 11692 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 11701 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 11702 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:56804",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56804_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 11702 T56 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 11702 T56 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 11704 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 11806 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 11807 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 11806 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 12692 T78 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 12693 T78 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 12693 T78 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 12693 T78 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 12694 T78 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 12694 T78 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/collection1/'
[junit4] 2> 12695 T78 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 12695 T78 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 12696 T78 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 12721 T78 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 12732 T78 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 12733 T78 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 12758 T78 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 12878 T78 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 12879 T78 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 12880 T78 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 12883 T78 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 12904 T78 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 12905 T78 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 12905 T78 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/
[junit4] 2> 12905 T78 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1328809
[junit4] 2> 12906 T78 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1
[junit4] 2> 12906 T78 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/index/
[junit4] 2> 12906 T78 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 12907 T78 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/index
[junit4] 2> 12907 T78 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28924743974070166]
[junit4] 2> 12916 T78 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 12917 T78 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 12923 T78 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 12923 T78 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 12924 T78 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 12924 T78 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 12924 T78 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 12924 T78 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 12925 T78 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 12925 T78 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 12925 T78 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 12926 T78 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 12926 T78 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 12927 T78 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 12927 T78 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 12928 T78 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 12928 T78 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 12929 T78 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 12930 T78 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 12932 T78 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 12933 T78 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 12933 T78 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 12934 T78 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.7900390625, floorSegmentMB=1.783203125, forceMergeDeletesPctAllowed=8.971932139927636, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5924259230260053
[junit4] 2> 12936 T78 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 12936 T78 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 12936 T78 oass.SolrIndexSearcher.<init> Opening Searcher@796830[collection1] main
[junit4] 2> 12936 T78 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 12937 T78 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 12937 T78 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 12938 T78 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 12938 T78 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 12938 T78 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 12939 T78 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 12940 T78 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 12940 T78 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 12940 T78 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 12948 T79 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@796830[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 12954 T78 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 12955 T82 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:56804 collection:collection1 shard:shard2
[junit4] 2> 12955 T30 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 12956 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 12956 T82 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 12966 T82 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 12979 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 12979 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 12979 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 12983 T82 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 12983 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 12984 T82 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C5 name=collection1 org.apache.solr.core.SolrCore@16da4fc url=https://127.0.0.1:56804/collection1 node=127.0.0.1:56804_ C5_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:56804, core=collection1, node_name=127.0.0.1:56804_}
[junit4] 2> 12984 T82 C5 P56804 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:56804/collection1/
[junit4] 2> 12986 T82 C5 P56804 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 12987 T82 C5 P56804 oasc.SyncStrategy.syncToMe https://127.0.0.1:56804/collection1/ has no replicas
[junit4] 2> 12987 T82 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:56804/collection1/ shard2
[junit4] 2> 12987 T82 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 12996 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13006 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13009 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13111 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13112 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13112 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13158 T82 oasc.ZkController.register We are https://127.0.0.1:56804/collection1/ and leader is https://127.0.0.1:56804/collection1/
[junit4] 2> 13159 T82 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:56804
[junit4] 2> 13159 T82 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 13159 T82 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 13159 T82 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 13161 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13161 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13161 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13162 T82 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 13163 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 13164 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:56804",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56804_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 13167 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 13270 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13270 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13270 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 13284 T30 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 13285 T30 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 13290 T30 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 13294 T30 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:43936
[junit4] 2> 13300 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 13301 T30 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 13301 T30 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004
[junit4] 2> 13302 T30 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/'
[junit4] 2> 13327 T30 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/solr.xml
[junit4] 2> 13336 T30 oasc.CoreContainer.<init> New CoreContainer 23884940
[junit4] 2> 13336 T30 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/]
[junit4] 2> 13337 T30 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 13337 T30 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 13337 T30 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 13338 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 13338 T30 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 13338 T30 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 13338 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 13339 T30 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 13339 T30 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 13345 T30 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 13346 T30 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 13346 T30 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 13346 T30 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49456/solr
[junit4] 2> 13347 T30 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 13348 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 13351 T93 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@14298eb name:ZooKeeperConnection Watcher:127.0.0.1:49456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13352 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 13355 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 13358 T95 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c57857 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 13359 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 13365 T30 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 14367 T30 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43936_
[junit4] 2> 14368 T30 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43936_
[junit4] 2> 14390 T96 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 14390 T96 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 14392 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 14392 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 14392 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 14392 T96 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 14393 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 14394 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:43936",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43936_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 14394 T56 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 14395 T56 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 14397 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 14499 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 14500 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 14500 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 14500 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15393 T96 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 15393 T96 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 15394 T96 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 15394 T96 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 15395 T96 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 15395 T96 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/collection1/'
[junit4] 2> 15396 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 15396 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 15396 T96 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 15421 T96 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 15435 T96 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 15436 T96 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 15449 T96 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 15575 T96 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 15577 T96 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 15579 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 15585 T96 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 15622 T96 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 15622 T96 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 15622 T96 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/
[junit4] 2> 15623 T96 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1328809
[junit4] 2> 15623 T96 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2
[junit4] 2> 15624 T96 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/index/
[junit4] 2> 15624 T96 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 15625 T96 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/index
[junit4] 2> 15625 T96 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=45, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.28924743974070166]
[junit4] 2> 15629 T96 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 15629 T96 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 15636 T96 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 15636 T96 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 15637 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 15637 T96 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 15637 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 15637 T96 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 15638 T96 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 15638 T96 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 15639 T96 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 15639 T96 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 15640 T96 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 15641 T96 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 15641 T96 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 15642 T96 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 15642 T96 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 15643 T96 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 15643 T96 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 15645 T96 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 15647 T96 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 15647 T96 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 15649 T96 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=11, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=41.7900390625, floorSegmentMB=1.783203125, forceMergeDeletesPctAllowed=8.971932139927636, segmentsPerTier=38.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5924259230260053
[junit4] 2> 15650 T96 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 15650 T96 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 15650 T96 oass.SolrIndexSearcher.<init> Opening Searcher@6e672e[collection1] main
[junit4] 2> 15651 T96 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 15652 T96 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 15652 T96 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 15652 T96 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 15652 T96 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 15653 T96 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 15653 T96 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
[junit4] 2> 15654 T96 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 15654 T96 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
[junit4] 2> 15654 T96 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 15663 T96 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 15664 T100 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:43936 collection:collection1 shard:shard3
[junit4] 2> 15664 T30 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 15665 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 15665 T97 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6e672e[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 15665 T100 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 15672 T100 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 15674 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15674 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15675 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15676 T100 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 15676 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 15676 T100 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C6 name=collection1 org.apache.solr.core.SolrCore@1b2e32 url=https://127.0.0.1:43936/collection1 node=127.0.0.1:43936_ C6_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:43936, core=collection1, node_name=127.0.0.1:43936_}
[junit4] 2> 15677 T100 C6 P43936 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:43936/collection1/
[junit4] 2> 15677 T100 C6 P43936 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 15678 T100 C6 P43936 oasc.SyncStrategy.syncToMe https://127.0.0.1:43936/collection1/ has no replicas
[junit4] 2> 15678 T100 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:43936/collection1/ shard3
[junit4] 2> 15678 T100 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 15679 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15683 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15686 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15788 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15788 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15788 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15788 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15835 T100 oasc.ZkController.register We are https://127.0.0.1:43936/collection1/ and leader is https://127.0.0.1:43936/collection1/
[junit4] 2> 15835 T100 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:43936
[junit4] 2> 15837 T100 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 15837 T100 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 15837 T100 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 15839 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15840 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15840 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15840 T100 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 15844 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 15845 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:43936",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43936_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 15847 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 15949 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15949 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15949 T95 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 15949 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 16059 T30 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 16060 T30 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 16069 T30 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 16073 T30 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:49575
[junit4] 2> 16075 T30 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 16076 T30 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 16076 T30 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-005
[junit4] 2> 16077 T30 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-005/'
[junit4] 2> 16107 T30 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-005/solr.xml
[junit4] 2> 16129 T30 oasc.CoreContainer.<init> New CoreContainer 5279452
[junit4] 2> 16130 T30 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-005/]
[junit4] 2> 16130 T30 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 16131 T30 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 16131 T30 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 16132 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 16132 T30 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 16133 T30 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 16133 T30 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 16134 T30 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 16135 T30 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 16140 T30 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 16140 T30 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 16141 T30 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 16143 T30 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49456/solr
[junit4] 2> 16144 T30 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 16145 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 16147 T111 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@74716b name:ZooKeeperConnection Watcher:127.0.0.1:49456 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 16148 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 16152 T30 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 16155 T113 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a78fe8 name:ZooKeeperConnection Watcher:127.0.0.1:49456/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 16155 T30 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 16161 T30 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 17165 T30 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49575_
[junit4] 2> 17167 T30 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49575_
[junit4] 2> 17182 T114 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 17183 T114 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 17184 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 17184 T114 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 17185 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 17185 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 17187 T56 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 17188 T56 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:49575",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49575_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 17188 T56 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 17189 T56 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 17192 T55 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 17295 T55 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 17295 T64 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 17295 T77 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 17295 T113 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 17295 T95 oascc.ZkStateReader$2.process A cluster state change: Watched
[...truncated too long message...]
has reached 0 - closing IndexWriter
[junit4] 2> 65654 T297 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 65655 T297 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 65655 T297 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 65655 T297 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12/index.20140707170828758 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12/index.20140707170828758;done=false>>]
[junit4] 2> 65656 T297 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12/index.20140707170828758
[junit4] 2> 65656 T297 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12;done=false>>]
[junit4] 2> 65656 T297 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty12
[junit4] 2> 65656 T297 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 65656 T297 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> ASYNC NEW_CORE C175 name=collection1 org.apache.solr.core.SolrCore@f2e8a1 url=https://127.0.0.1:36360/collection1 node=127.0.0.1:36360_ C175_STATE=coll:collection1 core:collection1 props:{state=active, base_url=https://127.0.0.1:36360, core=collection1, node_name=127.0.0.1:36360_}
[junit4] 2> 65737 T255 C175 P36360 oasc.SyncStrategy.sync WARN Closed, skipping sync up.
[junit4] 2> 65738 T255 oasc.ShardLeaderElectionContext.rejoinLeaderElection Not rejoining election because CoreContainer is shutdown
[junit4] 2> 65738 T255 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@f2e8a1
[junit4] 2> 65740 T255 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=12,autocommits=0,soft autocommit maxTime=1000ms,soft autocommits=11,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=107,cumulative_deletesById=52,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=12330,transaction_logs_total_number=1}
[junit4] 2> 65741 T255 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 65741 T255 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 65741 T255 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 65743 T255 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 65744 T255 oasc.CachingDirectoryFactory.close Closing StandardDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 65744 T255 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10;done=false>>]
[junit4] 2> 65744 T255 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10
[junit4] 2> 65745 T255 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10/index;done=false>>]
[junit4] 2> 65745 T255 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001/tempDir-001/jetty10/index
[junit4] 2> 65746 T255 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 65746 T255 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:358)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./temp/solr.cloud.ChaosMonkeySafeLeaderTest-7B17D3C1B3FBCCB-001
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=no): {}, locale=zh_SG, timezone=US/Michigan
[junit4] 2> NOTE: Linux 3.8.0-42-generic i386/Oracle Corporation 1.8.0_05 (32-bit)/cpus=8,threads=1,free=140024328,total=237764608
[junit4] 2> NOTE: All tests run in this JVM: [MultiTermTest, TestUpdate, TestSolrXmlPersistor, TestElisionMultitermQuery, ChaosMonkeySafeLeaderTest]
[junit4] Completed on J1 in 60.69s, 1 test, 1 failure <<< FAILURES!
[...truncated 1243 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1298: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:922: There were test failures: 416 suites, 1706 tests, 1 failure, 38 ignored (17 assumptions)
Total time: 64 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_05 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any