You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/18 23:38:41 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_55) - Build #
10330 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10330/
Java: 32bit/jdk1.7.0_55 -client -XX:+UseG1GC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard1 is not consistent. Got 104 from https://127.0.0.1:59804/collection1lastClient and got 81 from https://127.0.0.1:57958/collection1
Stack Trace:
java.lang.AssertionError: shard1 is not consistent. Got 104 from https://127.0.0.1:59804/collection1lastClient and got 81 from https://127.0.0.1:57958/collection1
at __randomizedtesting.SeedInfo.seed([4E584460E7D43F56:CFBECA78908B5F6A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1109)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerTest.testOverseerFailure
Error Message:
Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
Stack Trace:
org.apache.solr.common.SolrException: Could not register as the leader because creating the ephemeral registration node in ZooKeeper failed
at __randomizedtesting.SeedInfo.seed([4E584460E7D43F56:4A50CB93F571D077]:0)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:135)
at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:134)
at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
at org.apache.solr.cloud.OverseerTest$MockZKController.publishState(OverseerTest.java:155)
at org.apache.solr.cloud.OverseerTest.testOverseerFailure(OverseerTest.java:661)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.zookeeper.KeeperException$NodeExistsException: KeeperErrorCode = NodeExists for /collections/collection1/leaders/shard1
at org.apache.zookeeper.KeeperException.create(KeeperException.java:119)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.create(ZooKeeper.java:783)
at org.apache.solr.common.cloud.SolrZkClient$10.execute(SolrZkClient.java:432)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:429)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:386)
at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:373)
at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:127)
at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:122)
... 46 more
Build Log:
[...truncated 11086 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/init-core-data-001
[junit4] 2> 402728 T1295 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 402728 T1295 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 402735 T1295 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 402736 T1295 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 402736 T1296 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 402836 T1295 oasc.ZkTestServer.run start zk server on port:42195
[junit4] 2> 402837 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 402891 T1302 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@336c24 name:ZooKeeperConnection Watcher:127.0.0.1:42195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 402891 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 402892 T1295 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 402897 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 402898 T1304 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2bbe54 name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 402898 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 402899 T1295 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 402901 T1295 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 402903 T1295 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 402904 T1295 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 402906 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 402906 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 402909 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 402909 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 402912 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 402913 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 402915 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 402916 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 402917 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 402918 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 402919 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 402920 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 402922 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 402922 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 402924 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 402925 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 402926 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 402927 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 402929 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 402930 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 402932 T1295 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 402932 T1295 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 402935 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 402936 T1306 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e427b5 name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 402936 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 403185 T1295 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 403188 T1295 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 403191 T1295 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38091
[junit4] 2> 403192 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 403193 T1295 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 403193 T1295 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002
[junit4] 2> 403193 T1295 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/'
[junit4] 2> 403208 T1295 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/solr.xml
[junit4] 2> 403256 T1295 oasc.CoreContainer.<init> New CoreContainer 2289891
[junit4] 2> 403257 T1295 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/]
[junit4] 2> 403258 T1295 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 403258 T1295 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 403259 T1295 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 403259 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 403260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 403260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 403260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 403261 T1295 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 403261 T1295 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 403263 T1295 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 403263 T1295 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 403264 T1295 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 403264 T1295 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42195/solr
[junit4] 2> 403265 T1295 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 403265 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 403268 T1317 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e4ab4 name:ZooKeeperConnection Watcher:127.0.0.1:42195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 403268 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 403270 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 403271 T1319 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1321e67 name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 403271 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 403273 T1295 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 403275 T1295 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 403277 T1295 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 403278 T1295 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 403280 T1295 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 403282 T1295 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 403283 T1295 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38091_
[junit4] 2> 403284 T1295 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38091_
[junit4] 2> 403286 T1295 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 403287 T1295 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 403289 T1295 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:38091_
[junit4] 2> 403290 T1295 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 403292 T1295 oasc.Overseer.start Overseer (id=91779750769524740-127.0.0.1:38091_-n_0000000000) starting
[junit4] 2> 403293 T1295 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 403299 T1321 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 403300 T1295 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 403301 T1295 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 403303 T1295 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 403304 T1320 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 403308 T1322 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 403309 T1322 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 403310 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 403310 T1322 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 403311 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 403311 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:38091",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38091_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 403311 T1320 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 403312 T1320 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 403314 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 403318 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 404310 T1322 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 404311 T1322 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 404311 T1322 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 404311 T1322 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 404312 T1322 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 404312 T1322 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/collection1/'
[junit4] 2> 404313 T1322 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 404313 T1322 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 404314 T1322 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 404359 T1322 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 404426 T1322 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 404428 T1322 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 404436 T1322 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 404842 T1322 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 404845 T1322 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 404847 T1322 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 404851 T1322 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 404867 T1322 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 404867 T1322 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 404868 T1322 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-002/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/
[junit4] 2> 404868 T1322 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c69f81
[junit4] 2> 404868 T1322 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data
[junit4] 2> 404869 T1322 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/index/
[junit4] 2> 404869 T1322 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 404870 T1322 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/index
[junit4] 2> 404870 T1322 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=76.595703125, floorSegmentMB=2.1552734375, forceMergeDeletesPctAllowed=2.7232747902335372, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 404877 T1322 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 404877 T1322 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 404880 T1322 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 404881 T1322 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 404881 T1322 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 404881 T1322 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 404882 T1322 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 404882 T1322 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 404882 T1322 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 404883 T1322 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 404883 T1322 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 404884 T1322 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 404884 T1322 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 404884 T1322 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 404884 T1322 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 404885 T1322 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 404885 T1322 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 404886 T1322 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 404886 T1322 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 404889 T1322 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 404892 T1322 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 404892 T1322 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 404893 T1322 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@dadb0
[junit4] 2> 404894 T1322 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 404894 T1322 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 404894 T1322 oass.SolrIndexSearcher.<init> Opening Searcher@1e2e122[collection1] main
[junit4] 2> 404894 T1322 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 404896 T1322 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 404896 T1322 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 404896 T1322 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 404897 T1322 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 404897 T1322 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 404898 T1322 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 404898 T1322 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 404898 T1322 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 404898 T1322 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 404902 T1323 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e2e122[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 404904 T1322 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 404905 T1326 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:38091 collection:control_collection shard:shard1
[junit4] 2> 404905 T1295 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 404905 T1326 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 404906 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 404909 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 404910 T1328 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a0d36 name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 404910 T1326 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 404910 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 404912 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 404913 T1326 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 404913 T1326 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 404913 T1295 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C918 name=collection1 org.apache.solr.core.SolrCore@9a7d96 url=https://127.0.0.1:38091/collection1 node=127.0.0.1:38091_ C918_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:38091, core=collection1, node_name=127.0.0.1:38091_}
[junit4] 2> 404913 T1326 C918 P38091 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:38091/collection1/
[junit4] 2> 404914 T1326 C918 P38091 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 404914 T1326 C918 P38091 oasc.SyncStrategy.syncToMe https://127.0.0.1:38091/collection1/ has no replicas
[junit4] 2> 404914 T1326 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:38091/collection1/ shard1
[junit4] 2> 404914 T1326 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 404915 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 404917 T1295 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 404919 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 404923 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 404923 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 404926 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 404928 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 405029 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 405029 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 405079 T1326 oasc.ZkController.register We are https://127.0.0.1:38091/collection1/ and leader is https://127.0.0.1:38091/collection1/
[junit4] 2> 405079 T1326 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:38091
[junit4] 2> 405080 T1326 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 405080 T1326 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 405080 T1326 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 405083 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 405084 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 405084 T1326 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 405084 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 405085 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 405086 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:38091",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:38091_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 405088 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 405185 T1295 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 405186 T1295 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 405189 T1295 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 405190 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 405190 T1295 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:43144
[junit4] 2> 405193 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 405193 T1295 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 405193 T1295 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003
[junit4] 2> 405194 T1295 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/'
[junit4] 2> 405195 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 405209 T1295 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/solr.xml
[junit4] 2> 405257 T1295 oasc.CoreContainer.<init> New CoreContainer 18676107
[junit4] 2> 405258 T1295 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/]
[junit4] 2> 405259 T1295 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 405260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 405260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 405260 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 405261 T1295 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 405261 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 405261 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 405262 T1295 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 405262 T1295 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 405264 T1295 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 405265 T1295 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 405265 T1295 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 405265 T1295 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42195/solr
[junit4] 2> 405266 T1295 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 405267 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 405268 T1339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@153b40 name:ZooKeeperConnection Watcher:127.0.0.1:42195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 405269 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 405270 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 405271 T1341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@142806b name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 405272 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 405276 T1295 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 406279 T1295 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43144_
[junit4] 2> 406281 T1295 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43144_
[junit4] 2> 406292 T1342 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 406293 T1342 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 406294 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 406294 T1342 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 406294 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 406295 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 406296 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 406296 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:43144",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43144_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 406296 T1320 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 406297 T1320 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 406298 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 406400 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 406400 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 406400 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 407294 T1342 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 407295 T1342 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 407295 T1342 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 407296 T1342 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 407297 T1342 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 407297 T1342 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/collection1/'
[junit4] 2> 407298 T1342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 407298 T1342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 407298 T1342 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 407345 T1342 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 407419 T1342 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 407420 T1342 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 407428 T1342 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 407833 T1342 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 407836 T1342 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 407838 T1342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 407842 T1342 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 407857 T1342 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 407858 T1342 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 407858 T1342 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-003/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/
[junit4] 2> 407858 T1342 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c69f81
[junit4] 2> 407859 T1342 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1
[junit4] 2> 407859 T1342 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/index/
[junit4] 2> 407859 T1342 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 407860 T1342 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/index
[junit4] 2> 407861 T1342 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=76.595703125, floorSegmentMB=2.1552734375, forceMergeDeletesPctAllowed=2.7232747902335372, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 407920 T1342 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 407921 T1342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 407925 T1342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 407925 T1342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 407926 T1342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 407926 T1342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 407926 T1342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 407926 T1342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 407927 T1342 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 407927 T1342 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 407927 T1342 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 407928 T1342 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 407929 T1342 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 407929 T1342 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 407929 T1342 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 407930 T1342 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 407930 T1342 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 407931 T1342 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 407932 T1342 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 407934 T1342 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 407937 T1342 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 407937 T1342 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 407938 T1342 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1cb3cc4
[junit4] 2> 407939 T1342 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 407939 T1342 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 407940 T1342 oass.SolrIndexSearcher.<init> Opening Searcher@16f2a24[collection1] main
[junit4] 2> 407940 T1342 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 407941 T1342 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 407941 T1342 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 407942 T1342 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 407942 T1342 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 407942 T1342 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 407942 T1342 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 407943 T1342 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 407943 T1342 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 407943 T1342 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 407948 T1343 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16f2a24[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 407952 T1342 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 407953 T1346 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:43144 collection:collection1 shard:shard3
[junit4] 2> 407953 T1295 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 407954 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 407959 T1346 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 407964 T1346 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 407967 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 407968 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 407968 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 407968 T1346 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 407969 T1346 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 407969 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C919 name=collection1 org.apache.solr.core.SolrCore@91c511 url=https://127.0.0.1:43144/collection1 node=127.0.0.1:43144_ C919_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:43144, core=collection1, node_name=127.0.0.1:43144_}
[junit4] 2> 407969 T1346 C919 P43144 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:43144/collection1/
[junit4] 2> 407970 T1346 C919 P43144 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 407970 T1346 C919 P43144 oasc.SyncStrategy.syncToMe https://127.0.0.1:43144/collection1/ has no replicas
[junit4] 2> 407970 T1346 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:43144/collection1/ shard3
[junit4] 2> 407971 T1346 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 407971 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 407972 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 407972 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 407972 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 407978 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 407979 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 407983 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 408086 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408086 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408086 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408130 T1346 oasc.ZkController.register We are https://127.0.0.1:43144/collection1/ and leader is https://127.0.0.1:43144/collection1/
[junit4] 2> 408130 T1346 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:43144
[junit4] 2> 408130 T1346 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 408131 T1346 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 408131 T1346 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 408132 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 408133 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 408133 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 408134 T1346 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 408135 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 408135 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:43144",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:43144_",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 408137 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 408239 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408239 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408239 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 408260 T1295 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 408261 T1295 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 408264 T1295 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 408265 T1295 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:41413
[junit4] 2> 408267 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 408268 T1295 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 408268 T1295 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004
[junit4] 2> 408268 T1295 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/'
[junit4] 2> 408283 T1295 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/solr.xml
[junit4] 2> 408332 T1295 oasc.CoreContainer.<init> New CoreContainer 19093458
[junit4] 2> 408332 T1295 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/]
[junit4] 2> 408334 T1295 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 408334 T1295 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 408334 T1295 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 408335 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 408335 T1295 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 408335 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 408336 T1295 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 408336 T1295 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 408336 T1295 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 408339 T1295 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 408339 T1295 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 408339 T1295 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 408340 T1295 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:42195/solr
[junit4] 2> 408340 T1295 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 408341 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 408342 T1357 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1a87c30 name:ZooKeeperConnection Watcher:127.0.0.1:42195 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 408343 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 408345 T1295 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 408346 T1359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d7089 name:ZooKeeperConnection Watcher:127.0.0.1:42195/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 408346 T1295 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 408352 T1295 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 409355 T1295 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41413_
[junit4] 2> 409356 T1295 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41413_
[junit4] 2> 409370 T1360 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 409370 T1360 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 409371 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 409371 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 409372 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 409371 T1360 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 409373 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 409374 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41413",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41413_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 409374 T1320 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 409374 T1320 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 409379 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 409481 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 409481 T1359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 409481 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 409481 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 410372 T1360 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 410373 T1360 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 410374 T1360 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 410374 T1360 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 410375 T1360 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 410375 T1360 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/collection1/'
[junit4] 2> 410377 T1360 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 410377 T1360 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 410378 T1360 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 410467 T1360 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 410552 T1360 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 410554 T1360 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 410568 T1360 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 410956 T1360 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 410959 T1360 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 410960 T1360 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 410964 T1360 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 410979 T1360 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 410979 T1360 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 410980 T1360 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-004/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/
[junit4] 2> 410980 T1360 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@c69f81
[junit4] 2> 410980 T1360 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2
[junit4] 2> 410981 T1360 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/index/
[junit4] 2> 410981 T1360 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 410982 T1360 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/index
[junit4] 2> 410983 T1360 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=76.595703125, floorSegmentMB=2.1552734375, forceMergeDeletesPctAllowed=2.7232747902335372, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 410986 T1360 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 410986 T1360 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 410990 T1360 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 410991 T1360 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 410991 T1360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 410991 T1360 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 410992 T1360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 410992 T1360 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 410992 T1360 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 410993 T1360 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 410993 T1360 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 410994 T1360 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 410994 T1360 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 410995 T1360 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 410995 T1360 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 410996 T1360 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 410996 T1360 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 410997 T1360 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 410997 T1360 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 411000 T1360 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 411003 T1360 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 411003 T1360 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 411004 T1360 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1577a0b
[junit4] 2> 411005 T1360 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/solr.cloud.ChaosMonkeySafeLeaderTest-4E584460E7D43F56-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 411005 T1360 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 411006 T1360 oass.SolrIndexSearcher.<init> Opening Searcher@36feec[collection1] main
[junit4] 2> 411006 T1360 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 411007 T1360 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 411007 T1360 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 411007 T1360 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 411008 T1360 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 411008 T1360 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 411008 T1360 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 411009 T1360 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 411009 T1360 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 411009 T1360 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 411014 T1361 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@36feec[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 411018 T1360 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 411019 T1364 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:41413 collection:collection1 shard:shard2
[junit4] 2> 411019 T1295 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
[junit4] 2> 411020 T1295 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 411019 T1364 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 411024 T1364 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 411025 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411026 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411026 T1364 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 411026 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411026 T1364 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 411027 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C920 name=collection1 org.apache.solr.core.SolrCore@cd954c url=https://127.0.0.1:41413/collection1 node=127.0.0.1:41413_ C920_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:41413, core=collection1, node_name=127.0.0.1:41413_}
[junit4] 2> 411027 T1364 C920 P41413 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:41413/collection1/
[junit4] 2> 411027 T1364 C920 P41413 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 411028 T1364 C920 P41413 oasc.SyncStrategy.syncToMe https://127.0.0.1:41413/collection1/ has no replicas
[junit4] 2> 411028 T1364 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:41413/collection1/ shard2
[junit4] 2> 411028 T1364 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 411029 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411031 T1359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411032 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411031 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411031 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411037 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411039 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 411041 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411143 T1359 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411143 T1341 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411143 T1328 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411143 T1319 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 411189 T1364 oasc.ZkController.register We are https://127.0.0.1:41413/collection1/ and leader is https://127.0.0.1:41413/collection1/
[junit4] 2> 411189 T1364 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:41413
[junit4] 2> 411190 T1364 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 411190 T1364 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 411190 T1364 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 411193 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411193 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411193 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 411194 T1320 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 411195 T1320 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:41413",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41413_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 411193 T1364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 411198 T1319 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChi
[...truncated too long message...]
erseer$ClusterStateUpdater.checkIfIamStillLeader ERROR could not read the data org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1155)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:277)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:306)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.access$300(Overseer.java:85)
[junit4] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater$1.run(Overseer.java:289)
[junit4] 2>
[junit4] 2> 897276 T3165 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 897276 T3165 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 898091 T3680 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 898091 T3680 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard3/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 898092 T3680 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 900276 T3165 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.cloud.OverseerTest-4E584460E7D43F56-001
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=no_NO_NY, timezone=Africa/Conakry
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.7.0_55 (32-bit)/cpus=8,threads=1,free=212712688,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [DistribCursorPagingTest, TestDistributedMissingSort, TestDocBasedVersionConstraints, CursorPagingTest, PathHierarchyTokenizerFactoryTest, TestFieldResource, TestInfoStreamLogging, SortByFunctionTest, TestSolrDeletionPolicy2, TestRecovery, DirectUpdateHandlerTest, SolrRequestParserTest, ModifyConfFileTest, LegacyHTMLStripCharFilterTest, ConvertedLegacyTest, BasicZkTest, SimplePostToolTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestAddFieldRealTimeGet, TestRequestStatusCollectionAPI, TestFiltering, AlternateDirectoryTest, TestAtomicUpdateErrorCases, TestNoOpRegenerator, HdfsRecoveryZkTest, TestDFRSimilarityFactory, TestDefaultSearchFieldResource, XmlUpdateRequestHandlerTest, TestNonDefinedSimilarityFactory, TestUpdate, SolrXmlInZkTest, TestCollationField, TestSerializedLuceneMatchVersion, TestCodecSupport, IndexSchemaRuntimeFieldTest, TestFastOutputStream, HighlighterConfigTest, XsltUpdateRequestHandlerTest, TestQuerySenderListener, DeleteReplicaTest, TestDistribDocBasedVersion, TestStressLucene, RangeFacetTest, DistributedExpandComponentTest, SolrCoreCheckLockOnStartupTest, ResourceLoaderTest, BadIndexSchemaTest, OpenCloseCoreStressTest, MultiTermTest, TestIndexSearcher, TestCursorMarkWithoutUniqueKey, PluginInfoTest, ZkNodePropsTest, ChaosMonkeySafeLeaderTest, TestSchemaSimilarityResource, SpellCheckComponentTest, CoreMergeIndexesAdminHandlerTest, RequestHandlersTest, TestSolrQueryParserDefaultOperatorResource, CurrencyFieldXmlFileTest, NotRequiredUniqueKeyTest, TestDocumentBuilder, TestAnalyzedSuggestions, MinimalSchemaTest, DistributedQueryComponentOptimizationTest, TestPhraseSuggestions, OutputWriterTest, CoreContainerCoreInitFailuresTest, DefaultValueUpdateProcessorTest, TestSolrXMLSerializer, DOMUtilTest, SignatureUpdateProcessorFactoryTest, DebugComponentTest, TestManagedResourceStorage, TestBinaryResponseWriter, FullSolrCloudDistribCmdsTest, TestSchemaResource, SolrPluginUtilsTest, HdfsSyncSliceTest, TestFoldingMultitermQuery, TestWordDelimiterFilterFactory, IndexBasedSpellCheckerTest, TestOmitPositions, StatsComponentTest, TestDistributedGrouping, FieldFacetTest, NoCacheHeaderTest, TestArbitraryIndexDir, ShardRoutingCustomTest, TestCSVLoader, CollectionsAPIDistributedZkTest, PingRequestHandlerTest, TestStressReorder, TestComplexPhraseQParserPlugin, HdfsBasicDistributedZk2Test, HdfsUnloadDistributedZkTest, TestSolr4Spatial, TestExceedMaxTermLength, TestIBSimilarityFactory, TestReload, TermVectorComponentDistributedTest, OverseerTest]
[junit4] Completed on J1 in 55.45s, 9 tests, 1 error <<< FAILURES!
[...truncated 600 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 404 suites, 1686 tests, 1 error, 1 failure, 37 ignored (16 assumptions)
Total time: 61 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_55 -client -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_05) - Build #
10331 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10331/
Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseG1GC
4 tests failed.
REGRESSION: org.apache.solr.TestRandomDVFaceting.testRandomFaceting
Error Message:
Error while processing facet fields: java.lang.AssertionError
Stack Trace:
org.apache.solr.common.SolrException: Error while processing facet fields: java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([C0897BF0159BCA7B:CDE15B25406202C4]:0)
at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:595)
at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:260)
at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:84)
at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:221)
at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:1964)
at org.apache.solr.util.TestHarness.query(TestHarness.java:295)
at org.apache.solr.util.TestHarness.query(TestHarness.java:278)
at org.apache.solr.TestRandomDVFaceting.doFacetTests(TestRandomDVFaceting.java:226)
at org.apache.solr.TestRandomDVFaceting.doFacetTests(TestRandomDVFaceting.java:139)
at org.apache.solr.TestRandomDVFaceting.testRandomFaceting(TestRandomDVFaceting.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.AssertionError
at org.apache.solr.request.DocValuesFacets.getCounts(DocValuesFacets.java:106)
at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:432)
at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:561)
at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:553)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.request.SimpleFacets$2.execute(SimpleFacets.java:507)
at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:577)
... 50 more
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=3657, name=Thread-1614, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3657, name=Thread-1614, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: collection already exists: awholynewstresscollection_collection1_0
at __randomizedtesting.SeedInfo.seed([C0897BF0159BCA7B]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:554)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:210)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:206)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:340)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:301)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1504)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1525)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:989)
REGRESSION: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
Didn't see all replicas come up within 10000 ms! ClusterState: live nodes:[127.0.0.1:33046_, 127.0.0.1:53478_, 127.0.0.1:50500_] collections:{control_collection=DocCollection(control_collection)={ "replicationFactor":"1", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{"core_node1":{ "state":"active", "base_url":"http://127.0.0.1:33046", "core":"collection1", "node_name":"127.0.0.1:33046_", "leader":"true"}}}}, "router":{"name":"compositeId"}, "autoCreated":"true", "maxShardsPerNode":"1"}, collection1=DocCollection(collection1)={ "replicationFactor":"1", "shards":{ "shard1":{ "range":"80000000-ffffffff", "state":"active", "replicas":{"core_node2":{ "state":"active", "base_url":"http://127.0.0.1:53478", "core":"collection1", "node_name":"127.0.0.1:53478_", "leader":"true"}}}, "shard2":{ "range":"0-7fffffff", "state":"active", "replicas":{"core_node1":{ "state":"active", "base_url":"http://127.0.0.1:50500", "core":"collection1", "node_name":"127.0.0.1:50500_", "leader":"true"}}}}, "router":{"name":"compositeId"}, "autoCreated":"true", "maxShardsPerNode":"1"}, c8n_1x2=DocCollection(c8n_1x2)={ "replicationFactor":"2", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node1":{ "state":"active", "base_url":"http://127.0.0.1:53478", "core":"c8n_1x2_shard1_replica1", "node_name":"127.0.0.1:53478_", "leader":"true"}, "core_node2":{ "state":"active", "base_url":"http://127.0.0.1:33046", "core":"c8n_1x2_shard1_replica2", "node_name":"127.0.0.1:33046_"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1"}, c8n_1x3=DocCollection(c8n_1x3)={ "replicationFactor":"3", "shards":{"shard1":{ "range":"80000000-7fffffff", "state":"active", "replicas":{ "core_node1":{ "state":"recovering", "base_url":"http://127.0.0.1:53478", "core":"c8n_1x3_shard1_replica1", "node_name":"127.0.0.1:53478_"}, "core_node2":{ "state":"active", "base_url":"http://127.0.0.1:50500", "core":"c8n_1x3_shard1_replica2", "node_name":"127.0.0.1:50500_", "leader":"true"}, "core_node3":{ "state":"recovering", "base_url":"http://127.0.0.1:33046", "core":"c8n_1x3_shard1_replica3", "node_name":"127.0.0.1:33046_"}}}}, "router":{"name":"compositeId"}, "maxShardsPerNode":"1"}}
Stack Trace:
java.lang.AssertionError: Didn't see all replicas come up within 10000 ms! ClusterState: live nodes:[127.0.0.1:33046_, 127.0.0.1:53478_, 127.0.0.1:50500_] collections:{control_collection=DocCollection(control_collection)={
"replicationFactor":"1",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{"core_node1":{
"state":"active",
"base_url":"http://127.0.0.1:33046",
"core":"collection1",
"node_name":"127.0.0.1:33046_",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"autoCreated":"true",
"maxShardsPerNode":"1"}, collection1=DocCollection(collection1)={
"replicationFactor":"1",
"shards":{
"shard1":{
"range":"80000000-ffffffff",
"state":"active",
"replicas":{"core_node2":{
"state":"active",
"base_url":"http://127.0.0.1:53478",
"core":"collection1",
"node_name":"127.0.0.1:53478_",
"leader":"true"}}},
"shard2":{
"range":"0-7fffffff",
"state":"active",
"replicas":{"core_node1":{
"state":"active",
"base_url":"http://127.0.0.1:50500",
"core":"collection1",
"node_name":"127.0.0.1:50500_",
"leader":"true"}}}},
"router":{"name":"compositeId"},
"autoCreated":"true",
"maxShardsPerNode":"1"}, c8n_1x2=DocCollection(c8n_1x2)={
"replicationFactor":"2",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node1":{
"state":"active",
"base_url":"http://127.0.0.1:53478",
"core":"c8n_1x2_shard1_replica1",
"node_name":"127.0.0.1:53478_",
"leader":"true"},
"core_node2":{
"state":"active",
"base_url":"http://127.0.0.1:33046",
"core":"c8n_1x2_shard1_replica2",
"node_name":"127.0.0.1:33046_"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1"}, c8n_1x3=DocCollection(c8n_1x3)={
"replicationFactor":"3",
"shards":{"shard1":{
"range":"80000000-7fffffff",
"state":"active",
"replicas":{
"core_node1":{
"state":"recovering",
"base_url":"http://127.0.0.1:53478",
"core":"c8n_1x3_shard1_replica1",
"node_name":"127.0.0.1:53478_"},
"core_node2":{
"state":"active",
"base_url":"http://127.0.0.1:50500",
"core":"c8n_1x3_shard1_replica2",
"node_name":"127.0.0.1:50500_",
"leader":"true"},
"core_node3":{
"state":"recovering",
"base_url":"http://127.0.0.1:33046",
"core":"c8n_1x3_shard1_replica3",
"node_name":"127.0.0.1:33046_"}}}},
"router":{"name":"compositeId"},
"maxShardsPerNode":"1"}}
at __randomizedtesting.SeedInfo.seed([C0897BF0159BCA7B:416FF5E862C4AA47]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.HttpPartitionTest.ensureAllReplicasAreActive(HttpPartitionTest.java:495)
at org.apache.solr.cloud.HttpPartitionTest.testRf3(HttpPartitionTest.java:229)
at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:145)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.OverseerTest.testShardAssignment
Error Message:
java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:54541 within 30000 ms
Stack Trace:
org.apache.solr.common.SolrException: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:54541 within 30000 ms
at __randomizedtesting.SeedInfo.seed([C0897BF0159BCA7B:B99174A06AC04E27]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:151)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:102)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:97)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:84)
at org.apache.solr.cloud.AbstractZkTestCase.tryCleanPath(AbstractZkTestCase.java:181)
at org.apache.solr.cloud.AbstractZkTestCase.tryCleanSolrZkNode(AbstractZkTestCase.java:177)
at org.apache.solr.cloud.OverseerTest.testShardAssignment(OverseerTest.java:216)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.TimeoutException: Could not connect to ZooKeeper 127.0.0.1:54541 within 30000 ms
at org.apache.solr.common.cloud.ConnectionManager.waitForConnected(ConnectionManager.java:223)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:143)
... 46 more
Build Log:
[...truncated 10952 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/init-core-data-001
[junit4] 2> 426681 T2391 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 426683 T2391 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 426683 T2391 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 426684 T2392 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 426784 T2391 oasc.ZkTestServer.run start zk server on port:53429
[junit4] 2> 426785 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 438884 T2395 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 12098ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 438886 T2393 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x14611f052d00000, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 438888 T2398 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@664a1882 name:ZooKeeperConnection Watcher:127.0.0.1:53429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 438888 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 438889 T2391 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 438894 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 438895 T2400 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f1de847 name:ZooKeeperConnection Watcher:127.0.0.1:53429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 438896 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 438896 T2391 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 438900 T2391 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 438902 T2391 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 438905 T2391 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 438909 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 438910 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 438918 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 438919 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 438925 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 438926 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 438928 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 438928 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 438930 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 438930 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 438931 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 438932 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 438933 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 438933 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 438935 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 438935 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 438937 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 438938 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 438941 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 438941 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 438943 T2391 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 438943 T2391 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 439164 T2391 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 439167 T2391 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:37956
[junit4] 2> 439167 T2391 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 439167 T2391 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 439168 T2391 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002
[junit4] 2> 439168 T2391 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/'
[junit4] 2> 439178 T2391 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/solr.xml
[junit4] 2> 439194 T2391 oasc.CoreContainer.<init> New CoreContainer 499701471
[junit4] 2> 439194 T2391 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/]
[junit4] 2> 439195 T2391 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 439195 T2391 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 439195 T2391 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 439195 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 439195 T2391 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 439196 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 439196 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 439196 T2391 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 439196 T2391 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 439197 T2391 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 439197 T2391 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 439197 T2391 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 439198 T2391 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53429/solr
[junit4] 2> 439198 T2391 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 439198 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 439199 T2411 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51d0c88a name:ZooKeeperConnection Watcher:127.0.0.1:53429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 439200 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 439201 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 439202 T2413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78d7f1b name:ZooKeeperConnection Watcher:127.0.0.1:53429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 439202 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 439203 T2391 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 439205 T2391 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 439209 T2391 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 439213 T2391 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 439215 T2391 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 439218 T2391 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 439219 T2391 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33046_
[junit4] 2> 439220 T2391 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33046_
[junit4] 2> 439230 T2391 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 439233 T2391 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 439237 T2391 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33046_
[junit4] 2> 439238 T2391 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 439240 T2391 oasc.Overseer.start Overseer (id=91780566286860292-127.0.0.1:33046_-n_0000000000) starting
[junit4] 2> 439243 T2391 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 439253 T2415 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 439253 T2391 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 439256 T2391 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 439258 T2391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 439260 T2414 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 439263 T2416 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 439263 T2416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 439264 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439264 T2416 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 439266 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 439266 T2414 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:33046",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33046_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 439267 T2414 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 439267 T2414 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 439270 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 439271 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440265 T2416 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 440265 T2416 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 440266 T2416 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 440266 T2416 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 440268 T2416 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440268 T2416 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/collection1/'
[junit4] 2> 440269 T2416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 440269 T2416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 440270 T2416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 440301 T2416 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 440312 T2416 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 440313 T2416 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 440317 T2416 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 440401 T2416 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 440410 T2416 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 440411 T2416 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 440418 T2416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 440420 T2416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 440421 T2416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 440422 T2416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 440422 T2416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 440422 T2416 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 440423 T2416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 440423 T2416 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 440423 T2416 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 440423 T2416 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 440423 T2416 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-002/collection1/, dataDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/control/data/
[junit4] 2> 440423 T2416 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bbcc066
[junit4] 2> 440424 T2416 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/control/data
[junit4] 2> 440424 T2416 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/control/data/index/
[junit4] 2> 440424 T2416 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 440425 T2416 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/control/data/index
[junit4] 2> 440425 T2416 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 440425 T2416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@77f4cfe7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@62ae26d8),segFN=segments_1,generation=1}
[junit4] 2> 440425 T2416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 440427 T2416 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 440427 T2416 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 440428 T2416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 440428 T2416 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 440428 T2416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 440428 T2416 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 440428 T2416 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 440429 T2416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 440429 T2416 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 440429 T2416 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 440429 T2416 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 440429 T2416 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 440429 T2416 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 440430 T2416 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 440430 T2416 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 440430 T2416 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 440430 T2416 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 440432 T2416 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 440433 T2416 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 440433 T2416 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 440434 T2416 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2802006751381825]
[junit4] 2> 440434 T2416 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@77f4cfe7 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@62ae26d8),segFN=segments_1,generation=1}
[junit4] 2> 440434 T2416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 440434 T2416 oass.SolrIndexSearcher.<init> Opening Searcher@5b2d1fd6[collection1] main
[junit4] 2> 440434 T2416 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 440435 T2416 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 440435 T2416 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 440436 T2416 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 440436 T2416 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 440436 T2416 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 440437 T2416 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 440437 T2416 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 440437 T2416 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 440437 T2416 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 440439 T2417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5b2d1fd6[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 440439 T2416 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 440440 T2420 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33046 collection:control_collection shard:shard1
[junit4] 2> 440440 T2391 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 440441 T2391 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 440441 T2420 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 440443 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 440444 T2423 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61ee1d8f name:ZooKeeperConnection Watcher:127.0.0.1:53429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440444 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 440445 T2391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 440445 T2420 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 440446 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440447 T2391 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 440447 T2420 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 440447 T2420 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 440447 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C425 name=collection1 org.apache.solr.core.SolrCore@7a3b449a url=http://127.0.0.1:33046/collection1 node=127.0.0.1:33046_ C425_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:33046, core=collection1, node_name=127.0.0.1:33046_}
[junit4] 2> 440447 T2420 C425 P33046 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33046/collection1/
[junit4] 2> 440448 T2420 C425 P33046 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 440448 T2420 C425 P33046 oasc.SyncStrategy.syncToMe http://127.0.0.1:33046/collection1/ has no replicas
[junit4] 2> 440448 T2420 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33046/collection1/ shard1
[junit4] 2> 440448 T2420 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 440449 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440452 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440454 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440556 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440556 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440603 T2420 oasc.ZkController.register We are http://127.0.0.1:33046/collection1/ and leader is http://127.0.0.1:33046/collection1/
[junit4] 2> 440603 T2420 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33046
[junit4] 2> 440604 T2420 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 440604 T2420 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 440604 T2420 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 440605 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440605 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440606 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440606 T2420 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 440607 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 440607 T2414 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:33046",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:33046_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 440609 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 440674 T2391 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 440675 T2391 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 440676 T2391 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49774
[junit4] 2> 440677 T2391 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 440677 T2391 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 440677 T2391 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003
[junit4] 2> 440678 T2391 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/'
[junit4] 2> 440687 T2391 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/solr.xml
[junit4] 2> 440695 T2391 oasc.CoreContainer.<init> New CoreContainer 886166893
[junit4] 2> 440695 T2391 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/]
[junit4] 2> 440696 T2391 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 440696 T2391 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 440696 T2391 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 440696 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 440697 T2391 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 440697 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 440697 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 440697 T2391 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 440697 T2391 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 440698 T2391 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 440698 T2391 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 440698 T2391 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 440699 T2391 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53429/solr
[junit4] 2> 440699 T2391 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 440700 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 440701 T2434 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66dd2516 name:ZooKeeperConnection Watcher:127.0.0.1:53429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440701 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 440703 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 440704 T2436 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4173a09d name:ZooKeeperConnection Watcher:127.0.0.1:53429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 440704 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 440708 T2391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 440710 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440710 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 440710 T2436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 441711 T2391 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50500_
[junit4] 2> 441714 T2391 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50500_
[junit4] 2> 441724 T2437 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 441725 T2437 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 441731 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 441731 T2437 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 441731 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 441732 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 441734 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 441735 T2414 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50500",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50500_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 441735 T2414 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 441736 T2414 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 441739 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 441842 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 441842 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 441842 T2436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 442732 T2437 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 442732 T2437 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 442733 T2437 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 442733 T2437 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 442735 T2437 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 442735 T2437 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/collection1/'
[junit4] 2> 442736 T2437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 442736 T2437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 442737 T2437 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 442759 T2437 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 442768 T2437 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 442769 T2437 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 442773 T2437 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 442866 T2437 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 442869 T2437 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 442871 T2437 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 442877 T2437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 442879 T2437 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 442880 T2437 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 442881 T2437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 442881 T2437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 442881 T2437 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 442882 T2437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 442882 T2437 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 442882 T2437 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 442882 T2437 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 442882 T2437 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-003/collection1/, dataDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty1/
[junit4] 2> 442883 T2437 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bbcc066
[junit4] 2> 442883 T2437 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty1
[junit4] 2> 442883 T2437 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty1/index/
[junit4] 2> 442883 T2437 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 442884 T2437 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty1/index
[junit4] 2> 442884 T2437 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 442884 T2437 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@12c53103 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49520b23),segFN=segments_1,generation=1}
[junit4] 2> 442884 T2437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 442887 T2437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 442888 T2437 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 442888 T2437 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 442888 T2437 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 442888 T2437 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 442889 T2437 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 442889 T2437 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 442889 T2437 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 442889 T2437 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 442889 T2437 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 442890 T2437 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 442890 T2437 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 442892 T2437 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 442893 T2437 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 442893 T2437 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 442893 T2437 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=15, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2802006751381825]
[junit4] 2> 442894 T2437 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@12c53103 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@49520b23),segFN=segments_1,generation=1}
[junit4] 2> 442894 T2437 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 442894 T2437 oass.SolrIndexSearcher.<init> Opening Searcher@74ba60b1[collection1] main
[junit4] 2> 442894 T2437 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 442895 T2437 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 442895 T2437 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 442896 T2437 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 442896 T2437 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 442896 T2437 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 442896 T2437 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 442896 T2437 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 442897 T2437 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 442897 T2437 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 442898 T2438 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@74ba60b1[collection1] main{UninvertingDirectoryReader()}
[junit4] 2> 442900 T2437 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 442901 T2441 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50500 collection:collection1 shard:shard2
[junit4] 2> 442901 T2391 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 442901 T2391 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 442901 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 442907 T2441 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 442910 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 442910 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 442910 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 442911 T2441 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 442911 T2441 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 442911 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C426 name=collection1 org.apache.solr.core.SolrCore@3414d2d4 url=http://127.0.0.1:50500/collection1 node=127.0.0.1:50500_ C426_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:50500, core=collection1, node_name=127.0.0.1:50500_}
[junit4] 2> 442911 T2441 C426 P50500 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50500/collection1/
[junit4] 2> 442912 T2441 C426 P50500 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 442912 T2441 C426 P50500 oasc.SyncStrategy.syncToMe http://127.0.0.1:50500/collection1/ has no replicas
[junit4] 2> 442912 T2441 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50500/collection1/ shard2
[junit4] 2> 442913 T2441 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 442913 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 442916 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 442917 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 443023 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443023 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443023 T2436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443067 T2441 oasc.ZkController.register We are http://127.0.0.1:50500/collection1/ and leader is http://127.0.0.1:50500/collection1/
[junit4] 2> 443067 T2441 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50500
[junit4] 2> 443067 T2441 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 443067 T2441 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 443067 T2441 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 443068 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 443069 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 443069 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 443069 T2441 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 443069 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 443070 T2414 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:50500",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50500_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 443071 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 443136 T2391 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 443137 T2391 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 443140 T2391 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52834
[junit4] 2> 443142 T2391 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 443142 T2391 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 443143 T2391 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004
[junit4] 2> 443143 T2391 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/'
[junit4] 2> 443156 T2391 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/solr.xml
[junit4] 2> 443174 T2391 oasc.CoreContainer.<init> New CoreContainer 1879472265
[junit4] 2> 443174 T2391 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/]
[junit4] 2> 443175 T2391 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 443175 T2391 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 443175 T2391 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 443176 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 443176 T2391 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 443176 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 443177 T2391 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 443176 T2436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443176 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443176 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 443177 T2391 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 443178 T2391 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 443179 T2391 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 443179 T2391 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 443179 T2391 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 443180 T2391 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53429/solr
[junit4] 2> 443180 T2391 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 443181 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 443182 T2453 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@88ec169 name:ZooKeeperConnection Watcher:127.0.0.1:53429 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 443182 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 443184 T2391 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 443185 T2455 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10a392cf name:ZooKeeperConnection Watcher:127.0.0.1:53429/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 443185 T2391 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 443191 T2391 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 444194 T2391 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53478_
[junit4] 2> 444195 T2391 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53478_
[junit4] 2> 444205 T2456 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 444205 T2456 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 444207 T2456 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 444207 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 444208 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 444208 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 444209 T2414 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 444211 T2414 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:53478",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:53478_",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 444211 T2414 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 444212 T2414 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 444215 T2413 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 444318 T2436 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 444318 T2423 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 444318 T2455 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 444318 T2413 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 445208 T2456 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 445208 T2456 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 445209 T2456 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 445209 T2456 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 445210 T2456 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 445211 T2456 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/collection1/'
[junit4] 2> 445212 T2456 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 445212 T2456 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 445213 T2456 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 445237 T2456 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 445246 T2456 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 445247 T2456 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 445251 T2456 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 445343 T2456 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 445347 T2456 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 445348 T2456 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 445354 T2456 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 445356 T2456 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 445357 T2456 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 445358 T2456 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 445358 T2456 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 445359 T2456 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 445359 T2456 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 445359 T2456 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 445360 T2456 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 445360 T2456 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 445360 T2456 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-004/collection1/, dataDir=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty2/
[junit4] 2> 445360 T2456 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6bbcc066
[junit4] 2> 445361 T2456 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty2
[junit4] 2> 445361 T2456 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty2/index/
[junit4] 2> 445362 T2456 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 445362 T2456 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-C0897BF0159BCA7B-001/tempDir-001/jetty2/index
[junit4] 2> 445362 T2456 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=36, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 445363 T2456 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@5aab9f82 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6412d2ac),segFN=segments_1,generation=1}
[junit4] 2> 445363 T2456 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 445367 T2456 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 445367 T2456 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 445367 T2456 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 445368 T2456 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 445368 T2456 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 445368 T2456 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 445368 T2456 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 445369 T2456 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 445369 T2456 oasc.SolrCore.loadUpdateProcessorChains no u
[...truncated too long message...]
DVFaceting.testRandomFaceting <<<
[junit4] > Throwable #1: org.apache.solr.common.SolrException: Error while processing facet fields: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([C0897BF0159BCA7B:CDE15B25406202C4]:0)
[junit4] > at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:595)
[junit4] > at org.apache.solr.request.SimpleFacets.getFacetCounts(SimpleFacets.java:260)
[junit4] > at org.apache.solr.handler.component.FacetComponent.process(FacetComponent.java:84)
[junit4] > at org.apache.solr.handler.component.SearchHandler.handleRequestBody(SearchHandler.java:221)
[junit4] > at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:135)
[junit4] > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1964)
[junit4] > at org.apache.solr.util.TestHarness.query(TestHarness.java:295)
[junit4] > at org.apache.solr.util.TestHarness.query(TestHarness.java:278)
[junit4] > at org.apache.solr.TestRandomDVFaceting.doFacetTests(TestRandomDVFaceting.java:226)
[junit4] > at org.apache.solr.TestRandomDVFaceting.doFacetTests(TestRandomDVFaceting.java:139)
[junit4] > at org.apache.solr.TestRandomDVFaceting.testRandomFaceting(TestRandomDVFaceting.java:122)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > Caused by: java.lang.AssertionError
[junit4] > at org.apache.solr.request.DocValuesFacets.getCounts(DocValuesFacets.java:106)
[junit4] > at org.apache.solr.request.SimpleFacets.getTermCounts(SimpleFacets.java:432)
[junit4] > at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:561)
[junit4] > at org.apache.solr.request.SimpleFacets$3.call(SimpleFacets.java:553)
[junit4] > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
[junit4] > at org.apache.solr.request.SimpleFacets$2.execute(SimpleFacets.java:507)
[junit4] > at org.apache.solr.request.SimpleFacets.getFacetFieldCounts(SimpleFacets.java:577)
[junit4] > ... 50 more
[junit4] 2> 1094328 T4675 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 1094329 T4675 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1200368711
[junit4] 2> 1094329 T4675 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@28201d74
[junit4] 2> 1094329 T4675 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=9,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=6,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=7,cumulative_deletesById=0,cumulative_deletesByQuery=3,cumulative_errors=0}
[junit4] 2> 1094329 T4675 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 1094330 T4675 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 1094330 T4675 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 1094330 T4675 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 1094330 T4675 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 1094331 T4675 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001;done=false>>]
[junit4] 2> 1094331 T4675 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001
[junit4] 2> 1094331 T4675 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001/index;done=false>>]
[junit4] 2> 1094331 T4675 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001/init-core-data-001/index
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solr.TestRandomDVFaceting-C0897BF0159BCA7B-001
[junit4] 2> NOTE: test params are: codec=Lucene46: {foo_i=PostingsFormat(name=NestedPulsing), small2_is=PostingsFormat(name=NestedPulsing), small4_ss=PostingsFormat(name=NestedPulsing), small3_ss=PostingsFormat(name=Direct), score_f=PostingsFormat(name=SimpleText), small_i=PostingsFormat(name=SimpleText), small2_s=PostingsFormat(name=Direct), id=PostingsFormat(name=Direct), small2_ss=PostingsFormat(name=Lucene41VarGapFixedInterval), small3_is=PostingsFormat(name=SimpleText), small_s=PostingsFormat(name=Direct), small2_i=PostingsFormat(name=SimpleText)}, docValues:{foo_i_dv=DocValuesFormat(name=SimpleText), small2_ss_dv=DocValuesFormat(name=SimpleText), id_dv=DocValuesFormat(name=Disk), small2_s_dv=DocValuesFormat(name=Lucene45), small2_i_dv=DocValuesFormat(name=Disk), small3_is_dv=DocValuesFormat(name=Disk), small2_is_dv=DocValuesFormat(name=Memory), small4_ss_dv=DocValuesFormat(name=Memory), small_s_dv=DocValuesFormat(name=Disk), score_f_dv=DocValuesFormat(name=Lucene45), small_i_dv=DocValuesFormat(name=Lucene45), small3_ss_dv=DocValuesFormat(name=Lucene45)}, sim=DefaultSimilarity, locale=el, timezone=GMT
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=1,free=147612576,total=536870912
[junit4] 2> NOTE: All tests run in this JVM: [DebugComponentTest, TestFuzzyAnalyzedSuggestions, PreAnalyzedUpdateProcessorTest, FileUtilsTest, TestRangeQuery, IndexBasedSpellCheckerTest, TestZkChroot, DirectSolrSpellCheckerTest, BasicZkTest, ChangedSchemaMergeTest, TestRecoveryHdfs, OpenCloseCoreStressTest, TestManagedStopFilterFactory, TestStressReorder, DeleteInactiveReplicaTest, OverseerRolesTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestSolrXmlPersistence, UniqFieldsUpdateProcessorFactoryTest, TestAddFieldRealTimeGet, TestIndexSearcher, TestSolrCoreProperties, TestHashPartitioner, MinimalSchemaTest, AliasIntegrationTest, TestDistributedGrouping, ResourceLoaderTest, ParsingFieldUpdateProcessorsTest, ResponseHeaderTest, TestSolrXMLSerializer, DefaultValueUpdateProcessorTest, CurrencyFieldOpenExchangeTest, BlockDirectoryTest, TestSolrXml, TestSweetSpotSimilarityFactory, HardAutoCommitTest, TestJmxIntegration, TestLazyCores, SSLMigrationTest, SortByFunctionTest, TestLRUCache, TestSchemaNameResource, DeleteReplicaTest, TestWordDelimiterFilterFactory, XmlUpdateRequestHandlerTest, DocumentAnalysisRequestHandlerTest, PathHierarchyTokenizerFactoryTest, BasicDistributedZk2Test, AsyncMigrateRouteKeyTest, TestQuerySenderListener, TestSolrJ, QueryFacetTest, TestDocumentBuilder, TestComplexPhraseQParserPlugin, TestSchemaSimilarityResource, TestFiltering, TestHighlightDedupGrouping, TestModifyConfFiles, TestQueryTypes, TestReload, TestDistribDocBasedVersion, SolrIndexConfigTest, TestDistributedMissingSort, SpellCheckComponentTest, SolrCmdDistributorTest, BJQParserTest, FieldFacetExtrasTest, TestFieldResource, TestCSVLoader, RequestHandlersTest, TestCollationField, CurrencyFieldXmlFileTest, TestOmitPositions, DirectSolrConnectionTest, TestSchemaResource, MultiTermTest, SpellCheckCollatorTest, ShardRoutingCustomTest, BadCopyFieldTest, CoreContainerCoreInitFailuresTest, FunctionTest, TestIndexingPerformance, TestComponentsName, TestRandomFaceting, TestAnalyzedSuggestions, SuggesterTSTTest, PluginInfoTest, ZkSolrClientTest, TestPartialUpdateDeduplication, DistribDocExpirationUpdateProcessorTest, SystemInfoHandlerTest, TestRecovery, TestStressLucene, StatsComponentTest, TestAtomicUpdateErrorCases, TestLMDirichletSimilarityFactory, TestFreeTextSuggestions, CollectionsAPIDistributedZkTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, ClusterStateUpdateTest, TestRandomDVFaceting]
[junit4] Completed on J1 in 0.44s, 1 test, 1 error <<< FAILURES!
[...truncated 596 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 404 suites, 1686 tests, 3 errors, 1 failure, 37 ignored (16 assumptions)
Total time: 56 minutes 30 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:+UseCompressedOops -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure