You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/05/10 03:04:41 UTC
[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_05) - Build #
10271 - Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10271/
Java: 64bit/jdk1.8.0_05 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
shard3 is not consistent. Got 50 from https://127.0.0.1:34633/brccw/collection1lastClient and got 51 from https://127.0.0.1:43999/brccw/collection1
Stack Trace:
java.lang.AssertionError: shard3 is not consistent. Got 50 from https://127.0.0.1:34633/brccw/collection1lastClient and got 51 from https://127.0.0.1:43999/brccw/collection1
at __randomizedtesting.SeedInfo.seed([4B9AB25AA8ACF571:CA7C3C42DFF3954D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1130)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1109)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:150)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
REGRESSION: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([4B9AB25AA8ACF571:CA7C3C42DFF3954D]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1140)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1109)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 20504 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/init-core-data-001
[junit4] 2> 766570 T4405 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 766571 T4405 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /brccw/
[junit4] 2> 766574 T4405 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 766574 T4405 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 766574 T4406 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 766674 T4405 oasc.ZkTestServer.run start zk server on port:53453
[junit4] 2> 766675 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766813 T4412 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b2d5c50 name:ZooKeeperConnection Watcher:127.0.0.1:53453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 766813 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 766813 T4405 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 766817 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766818 T4414 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@8adb505 name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 766818 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 766818 T4405 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 766820 T4405 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 766821 T4405 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 766822 T4405 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 766823 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 766823 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 766826 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 766826 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 766828 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 766828 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 766830 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 766830 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 766832 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 766833 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 766835 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 766835 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 766837 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 766838 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 766839 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 766839 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 766840 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 766841 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 766842 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 766842 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 766843 T4405 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 766844 T4405 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 766845 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 766846 T4416 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@24e4325f name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 766846 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 767069 T4405 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 767072 T4405 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 767122 T4405 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51139
[junit4] 2> 767124 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 767124 T4405 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 767124 T4405 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002
[junit4] 2> 767124 T4405 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/'
[junit4] 2> 767134 T4405 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/solr.xml
[junit4] 2> 767147 T4405 oasc.CoreContainer.<init> New CoreContainer 716101437
[junit4] 2> 767147 T4405 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/]
[junit4] 2> 767147 T4405 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 767148 T4405 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 767148 T4405 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 767148 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 767148 T4405 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 767149 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 767149 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 767149 T4405 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 767149 T4405 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 767151 T4405 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 767151 T4405 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 767151 T4405 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 767152 T4405 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53453/solr
[junit4] 2> 767152 T4405 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 767153 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 767154 T4427 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@708dda86 name:ZooKeeperConnection Watcher:127.0.0.1:53453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 767154 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 767155 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 767156 T4429 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f34aee6 name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 767156 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 767157 T4405 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 767159 T4405 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 767161 T4405 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 767164 T4405 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 767166 T4405 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 767168 T4405 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 767169 T4405 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51139_brccw
[junit4] 2> 767170 T4405 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51139_brccw
[junit4] 2> 767171 T4405 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 767172 T4405 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 767174 T4405 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51139_brccw
[junit4] 2> 767174 T4405 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 767175 T4405 oasc.Overseer.start Overseer (id=91729638400327684-127.0.0.1:51139_brccw-n_0000000000) starting
[junit4] 2> 767176 T4405 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 767181 T4431 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 767181 T4405 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 767181 T4431 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:51139_brccw
[junit4] 2> 767183 T4405 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 767184 T4405 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 767186 T4430 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 767187 T4432 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 767187 T4432 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 767188 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 767188 T4432 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 767188 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 767189 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:51139/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51139_brccw",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 767189 T4430 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 767189 T4430 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 767190 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 767194 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 768188 T4432 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 768188 T4432 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 768189 T4432 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 768189 T4432 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 768190 T4432 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 768190 T4432 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/collection1/'
[junit4] 2> 768191 T4432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 768191 T4432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 768191 T4432 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 768207 T4432 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 768219 T4432 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 768220 T4432 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 768224 T4432 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 768320 T4432 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 768322 T4432 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 768322 T4432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 768324 T4432 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 768334 T4432 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 768334 T4432 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 768335 T4432 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-002/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/
[junit4] 2> 768335 T4432 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e30f1d2
[junit4] 2> 768335 T4432 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data
[junit4] 2> 768336 T4432 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/index/
[junit4] 2> 768336 T4432 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 768336 T4432 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/index
[junit4] 2> 768336 T4432 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=87.9931640625, floorSegmentMB=2.107421875, forceMergeDeletesPctAllowed=14.818193501526522, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 768340 T4432 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 768341 T4432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 768342 T4432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 768343 T4432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 768343 T4432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 768343 T4432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 768343 T4432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 768343 T4432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 768344 T4432 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 768344 T4432 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 768344 T4432 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 768344 T4432 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 768344 T4432 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 768345 T4432 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 768345 T4432 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 768345 T4432 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 768345 T4432 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 768345 T4432 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 768346 T4432 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 768347 T4432 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 768348 T4432 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 768348 T4432 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 768349 T4432 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 768349 T4432 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 768350 T4432 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 768350 T4432 oass.SolrIndexSearcher.<init> Opening Searcher@640e4926[collection1] main
[junit4] 2> 768350 T4432 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 768351 T4432 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 768351 T4432 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 768351 T4432 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 768352 T4432 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 768352 T4432 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 768352 T4432 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 768352 T4432 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 768353 T4432 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 768353 T4432 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 768354 T4433 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@640e4926[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 768355 T4432 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 768356 T4436 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:51139/brccw collection:control_collection shard:shard1
[junit4] 2> 768356 T4405 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 768356 T4436 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 768356 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 768358 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 768359 T4436 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 768359 T4438 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@26d3ac56 name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 768360 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 768360 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768360 T4405 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 768360 T4436 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 768361 T4436 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 768361 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C2466 name=collection1 org.apache.solr.core.SolrCore@1cb8bc66 url=https://127.0.0.1:51139/brccw/collection1 node=127.0.0.1:51139_brccw C2466_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:51139/brccw, core=collection1, node_name=127.0.0.1:51139_brccw}
[junit4] 2> 768361 T4436 C2466 P51139 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:51139/brccw/collection1/
[junit4] 2> 768361 T4436 C2466 P51139 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 768362 T4436 C2466 P51139 oasc.SyncStrategy.syncToMe https://127.0.0.1:51139/brccw/collection1/ has no replicas
[junit4] 2> 768362 T4436 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:51139/brccw/collection1/ shard1
[junit4] 2> 768362 T4436 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 768362 T4405 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 768364 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768365 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768367 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768468 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 768468 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 768516 T4436 oasc.ZkController.register We are https://127.0.0.1:51139/brccw/collection1/ and leader is https://127.0.0.1:51139/brccw/collection1/
[junit4] 2> 768516 T4436 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:51139/brccw
[junit4] 2> 768517 T4436 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 768517 T4436 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 768517 T4436 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 768518 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768518 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768518 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768518 T4436 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 768519 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 768520 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:51139/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:51139_brccw",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 768524 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 768597 T4405 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 768598 T4405 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 768600 T4405 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 768601 T4405 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:37151
[junit4] 2> 768602 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 768603 T4405 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 768603 T4405 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003
[junit4] 2> 768603 T4405 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/'
[junit4] 2> 768613 T4405 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/solr.xml
[junit4] 2> 768620 T4405 oasc.CoreContainer.<init> New CoreContainer 1755974528
[junit4] 2> 768621 T4405 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/]
[junit4] 2> 768621 T4405 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 768622 T4405 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 768622 T4405 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 768622 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 768622 T4405 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 768622 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 768623 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 768623 T4405 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 768623 T4405 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 768625 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 768625 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 768625 T4405 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 768626 T4405 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 768626 T4405 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 768626 T4405 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53453/solr
[junit4] 2> 768627 T4405 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 768627 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 768628 T4449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@51e95c9c name:ZooKeeperConnection Watcher:127.0.0.1:53453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 768629 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 768630 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 768631 T4451 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15874dbc name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 768631 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 768636 T4405 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 769638 T4405 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37151_brccw
[junit4] 2> 769640 T4405 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:37151_brccw
[junit4] 2> 769645 T4452 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 769645 T4452 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 769646 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 769646 T4452 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 769646 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 769646 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 769646 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 769647 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:37151/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37151_brccw",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 769647 T4430 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 769647 T4430 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 769649 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 769751 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 769751 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 769751 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 770646 T4452 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 770646 T4452 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 770647 T4452 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 770647 T4452 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 770648 T4452 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 770648 T4452 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/collection1/'
[junit4] 2> 770648 T4452 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 770649 T4452 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 770649 T4452 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 770683 T4452 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 770692 T4452 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 770693 T4452 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 770697 T4452 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 770796 T4452 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 770797 T4452 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 770798 T4452 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 770801 T4452 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 770815 T4452 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 770815 T4452 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 770815 T4452 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-003/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/
[junit4] 2> 770815 T4452 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e30f1d2
[junit4] 2> 770816 T4452 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1
[junit4] 2> 770816 T4452 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/index/
[junit4] 2> 770817 T4452 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 770817 T4452 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/index
[junit4] 2> 770818 T4452 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=87.9931640625, floorSegmentMB=2.107421875, forceMergeDeletesPctAllowed=14.818193501526522, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 770821 T4452 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 770822 T4452 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 770824 T4452 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 770824 T4452 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 770824 T4452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 770824 T4452 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 770825 T4452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 770825 T4452 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 770825 T4452 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 770825 T4452 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 770825 T4452 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 770826 T4452 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 770826 T4452 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 770826 T4452 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 770826 T4452 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 770826 T4452 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 770827 T4452 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 770827 T4452 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 770827 T4452 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 770829 T4452 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 770830 T4452 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 770830 T4452 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 770830 T4452 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 770831 T4452 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 770831 T4452 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 770831 T4452 oass.SolrIndexSearcher.<init> Opening Searcher@492c0f49[collection1] main
[junit4] 2> 770832 T4452 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 770832 T4452 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 770832 T4452 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 770833 T4452 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 770833 T4452 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 770833 T4452 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 770834 T4452 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 770834 T4452 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 770834 T4452 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 770834 T4452 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 770836 T4453 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@492c0f49[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 770837 T4452 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 770838 T4456 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:37151/brccw collection:collection1 shard:shard2
[junit4] 2> 770838 T4405 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 770838 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 770838 T4456 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 770844 T4456 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 770845 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770845 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770845 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770845 T4456 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 770846 T4456 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2467 name=collection1 org.apache.solr.core.SolrCore@31dee924 url=https://127.0.0.1:37151/brccw/collection1 node=127.0.0.1:37151_brccw C2467_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:37151/brccw, core=collection1, node_name=127.0.0.1:37151_brccw}
[junit4] 2> 770846 T4456 C2467 P37151 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:37151/brccw/collection1/
[junit4] 2> 770846 T4456 C2467 P37151 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 770846 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 770846 T4456 C2467 P37151 oasc.SyncStrategy.syncToMe https://127.0.0.1:37151/brccw/collection1/ has no replicas
[junit4] 2> 770847 T4456 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:37151/brccw/collection1/ shard2
[junit4] 2> 770847 T4456 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 770848 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770851 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770853 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 770954 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 770954 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 770954 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 771002 T4456 oasc.ZkController.register We are https://127.0.0.1:37151/brccw/collection1/ and leader is https://127.0.0.1:37151/brccw/collection1/
[junit4] 2> 771002 T4456 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:37151/brccw
[junit4] 2> 771002 T4456 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 771002 T4456 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 771003 T4456 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 771004 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 771005 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 771005 T4456 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 771005 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 771005 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 771006 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:37151/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:37151_brccw",
[junit4] 2> "shard":"shard2",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 771007 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 771071 T4405 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 771072 T4405 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 771074 T4405 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 771075 T4405 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:34633
[junit4] 2> 771076 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 771077 T4405 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 771077 T4405 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004
[junit4] 2> 771077 T4405 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/'
[junit4] 2> 771086 T4405 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/solr.xml
[junit4] 2> 771103 T4405 oasc.CoreContainer.<init> New CoreContainer 1804844046
[junit4] 2> 771103 T4405 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/]
[junit4] 2> 771104 T4405 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 771104 T4405 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 771104 T4405 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 771105 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 771105 T4405 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 771105 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 771105 T4405 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 771105 T4405 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 771106 T4405 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 771107 T4405 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 771108 T4405 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 771108 T4405 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 771108 T4405 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:53453/solr
[junit4] 2> 771108 T4405 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 771109 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 771113 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 771113 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 771113 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 771113 T4467 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@882e7f6 name:ZooKeeperConnection Watcher:127.0.0.1:53453 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 771113 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 771115 T4405 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 771116 T4469 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a46ed2 name:ZooKeeperConnection Watcher:127.0.0.1:53453/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 771116 T4405 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 771119 T4405 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 772121 T4405 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34633_brccw
[junit4] 2> 772122 T4405 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34633_brccw
[junit4] 2> 772127 T4470 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 772127 T4470 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 772128 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 772128 T4470 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 772128 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 772128 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 772129 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 772129 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34633/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34633_brccw",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 772129 T4430 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 772129 T4430 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 772132 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 772235 T4469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 772235 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 772235 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 772235 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773128 T4470 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 773128 T4470 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 773129 T4470 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 773129 T4470 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 773130 T4470 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 773130 T4470 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/collection1/'
[junit4] 2> 773131 T4470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 773131 T4470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 773131 T4470 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 773147 T4470 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 773165 T4470 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 773166 T4470 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 773170 T4470 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 773263 T4470 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 773265 T4470 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 773265 T4470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 773267 T4470 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 773278 T4470 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 773278 T4470 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 773278 T4470 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-004/collection1/, dataDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/
[junit4] 2> 773278 T4470 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1e30f1d2
[junit4] 2> 773279 T4470 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2
[junit4] 2> 773279 T4470 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/index/
[junit4] 2> 773279 T4470 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 773280 T4470 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/index
[junit4] 2> 773280 T4470 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=40, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=87.9931640625, floorSegmentMB=2.107421875, forceMergeDeletesPctAllowed=14.818193501526522, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 773283 T4470 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 773283 T4470 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 773285 T4470 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 773286 T4470 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 773287 T4470 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 773287 T4470 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 773287 T4470 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 773287 T4470 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 773288 T4470 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 773288 T4470 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 773288 T4470 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 773288 T4470 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 773289 T4470 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 773289 T4470 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 773290 T4470 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 773291 T4470 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 773291 T4470 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 773292 T4470 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=37, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 773292 T4470 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-001/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 773293 T4470 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 773293 T4470 oass.SolrIndexSearcher.<init> Opening Searcher@6947ac62[collection1] main
[junit4] 2> 773293 T4470 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 773294 T4470 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 773294 T4470 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 773294 T4470 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 773294 T4470 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 773295 T4470 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 773295 T4470 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 773295 T4470 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 773296 T4470 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 773296 T4470 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 773297 T4471 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6947ac62[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 773299 T4470 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 773299 T4474 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:34633/brccw collection:collection1 shard:shard3
[junit4] 2> 773300 T4405 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 773300 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 773300 T4474 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 773303 T4474 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 773304 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773305 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773305 T4474 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 773305 T4474 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 773305 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C2468 name=collection1 org.apache.solr.core.SolrCore@50f9feed url=https://127.0.0.1:34633/brccw/collection1 node=127.0.0.1:34633_brccw C2468_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:34633/brccw, core=collection1, node_name=127.0.0.1:34633_brccw}
[junit4] 2> 773305 T4474 C2468 P34633 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:34633/brccw/collection1/
[junit4] 2> 773306 T4474 C2468 P34633 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 773306 T4474 C2468 P34633 oasc.SyncStrategy.syncToMe https://127.0.0.1:34633/brccw/collection1/ has no replicas
[junit4] 2> 773306 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 773306 T4474 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:34633/brccw/collection1/ shard3
[junit4] 2> 773306 T4474 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 773309 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773311 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773313 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773415 T4469 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773420 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773415 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773415 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773462 T4474 oasc.ZkController.register We are https://127.0.0.1:34633/brccw/collection1/ and leader is https://127.0.0.1:34633/brccw/collection1/
[junit4] 2> 773462 T4474 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:34633/brccw
[junit4] 2> 773462 T4474 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 773462 T4474 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 773463 T4474 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 773464 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773465 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773465 T4474 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 773465 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773465 T4430 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 773466 T4430 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:34633/brccw",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34633_brccw",
[junit4] 2> "shard":"shard3",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 773467 T4429 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 773543 T4405 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 773544 T4405 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 773546 T4405 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 773547 T4405 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:43526
[junit4] 2> 773548 T4405 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 773549 T4405 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 773549 T4405 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-005
[junit4] 2> 773549 T4405 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-005/'
[junit4] 2> 773560 T4405 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-005/solr.xml
[junit4] 2> 773568 T4405 oasc.CoreContainer.<init> New CoreContainer 1354802981
[junit4] 2> 773568 T4405 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.ChaosMonkeySafeLeaderTest-4B9AB25AA8ACF571-001/tempDir-005/]
[junit4] 2> 773569 T4429 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773569 T4438 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773569 T4451 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 773569 T4469 oascc.ZkStateReader$2
[...truncated too long message...]
ceTest-4B9AB25AA8ACF571-001/tempDir-001/jetty4/index;done=false>>]
[junit4] 2> 873758 T4943 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.SyncSliceTest-4B9AB25AA8ACF571-001/tempDir-001/jetty4/index
[junit4] 2> 873758 T4943 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./solr.cloud.SyncSliceTest-4B9AB25AA8ACF571-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=./solr.cloud.SyncSliceTest-4B9AB25AA8ACF571-001/tempDir-001/jetty4;done=false>>]
[junit4] 2> 873758 T4943 oasc.CachingDirectoryFactory.close Closing directory: ./solr.cloud.SyncSliceTest-4B9AB25AA8ACF571-001/tempDir-001/jetty4
[junit4] 2> 873759 T4943 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard1/election/91729641827991565-core_node4-n_0000000015
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:177)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:174)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:71)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:200)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 873760 T4943 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 873760 T4943 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 873761 T4943 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 873761 T4943 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-4B9AB25AA8ACF571-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene46), sim=DefaultSimilarity, locale=en_MT, timezone=Europe/London
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/Oracle Corporation 1.8.0_05 (64-bit)/cpus=8,threads=1,free=60170512,total=295985152
[junit4] 2> NOTE: All tests run in this JVM: [TestStressUserVersions, TestManagedSchema, TestMaxScoreQueryParser, BlockDirectoryTest, TestReplicationHandler, SpatialFilterTest, RAMDirectoryFactoryTest, SpellPossibilityIteratorTest, TestInitQParser, TestFileDictionaryLookup, MoreLikeThisHandlerTest, BadComponentTest, TestSolrQueryParserDefaultOperatorResource, TestDistributedMissingSort, TestStressVersions, DirectUpdateHandlerOptimizeTest, TestCloudInspectUtil, RecoveryZkTest, TestHighlightDedupGrouping, RegexBoostProcessorTest, TestLuceneMatchVersion, QueryEqualityTest, TestSerializedLuceneMatchVersion, HdfsCollectionsAPIDistributedZkTest, PolyFieldTest, ShardSplitTest, UpdateParamsTest, InfoHandlerTest, TestCollapseQParserPlugin, TestDocSet, FieldFacetTest, TimeZoneUtilsTest, BasicDistributedZkTest, TestPerFieldSimilarity, DistribCursorPagingTest, SolrInfoMBeanTest, SearchHandlerTest, TestConfig, HdfsDirectoryTest, TestCursorMarkWithoutUniqueKey, BinaryUpdateRequestHandlerTest, TestStandardQParsers, TestJmxMonitoredMap, TestNonNRTOpen, UnloadDistributedZkTest, MigrateRouteKeyTest, DistributedQueryElevationComponentTest, TestFieldSortValues, DocValuesMissingTest, TestNRTOpen, LoggingHandlerTest, TestElisionMultitermQuery, ShowFileRequestHandlerTest, TestLFUCache, ReturnFieldsTest, TestExceedMaxTermLength, TestReversedWildcardFilterFactory, SampleTest, IndexSchemaTest, FieldFacetExtrasTest, TestRealTimeGet, TestValueSourceCache, QueryFacetTest, CustomCollectionTest, TestAddFieldRealTimeGet, TestCollationFieldDocValues, DocValuesTest, TestDefaultSimilarityFactory, PrimitiveFieldTypeTest, ChangedSchemaMergeTest, MBeansHandlerTest, TestRemoteStreaming, SuggestComponentTest, TestCoreContainer, TestSearcherReuse, TestSurroundQueryParser, CSVRequestHandlerTest, TestFaceting, SuggesterFSTTest, SolrIndexSplitterTest, UpdateRequestProcessorFactoryTest, TestDynamicFieldCollectionResource, TestManagedStopFilterFactory, PreAnalyzedFieldTest, ModifyConfFileTest, TestDistribDocBasedVersion, DistributedSpellCheckComponentTest, DocumentBuilderTest, SliceStateTest, HdfsChaosMonkeySafeLeaderTest, TestBM25SimilarityFactory, QueryElevationComponentTest, TriLevelCompositeIdRoutingTest, OverseerTest, ExternalFileFieldSortTest, ZkControllerTest, ChaosMonkeySafeLeaderTest, SyncSliceTest]
[junit4] Completed on J0 in 55.63s, 1 test, 1 error <<< FAILURES!
[...truncated 614 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:920: There were test failures: 400 suites, 1679 tests, 1 error, 1 failure, 37 ignored (16 assumptions)
Total time: 60 minutes 52 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.8.0_05 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_55) - Build #
10274 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10274/
Java: 32bit/jdk1.7.0_55 -server -XX:+UseParallelGC
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
ERROR: SolrIndexSearcher opens=2 closes=1
Stack Trace:
java.lang.AssertionError: ERROR: SolrIndexSearcher opens=2 closes=1
at __randomizedtesting.SeedInfo.seed([292842B8F0023D51]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.SolrTestCaseJ4.endTrackingSearchers(SolrTestCaseJ4.java:436)
at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:184)
at sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:790)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
15 threads leaked from SUITE scope at org.apache.solr.cloud.HttpPartitionTest: 1) Thread[id=5487, name=searcherExecutor-2832-thread-1, state=WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=5484, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-SendThread(127.0.0.1:51439), state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) 3) Thread[id=5476, name=qtp169517-5476 Acceptor0 SelectChannelConnector@127.0.0.1:49903, state=BLOCKED, group=TGRP-HttpPartitionTest] at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:224) at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=5481, name=qtp169517-5481, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=5475, name=qtp169517-5475 Selector1, state=RUNNABLE, group=TGRP-HttpPartitionTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 6) Thread[id=5492, name=Thread-2414, state=TIMED_WAITING, group=Overseer state updater.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:119) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:87) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:583) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:207) at java.lang.Thread.run(Thread.java:745) 7) Thread[id=5488, name=Thread-2412, state=WAITING, group=TGRP-HttpPartitionTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:944) 8) Thread[id=5480, name=qtp169517-5480, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=5474, name=qtp169517-5474 Selector0, state=RUNNABLE, group=TGRP-HttpPartitionTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 10) Thread[id=5473, name=HashSessionScavenger-169, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) at java.util.TimerThread.run(Timer.java:505) 11) Thread[id=5485, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-EventThread, state=WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494) 12) Thread[id=5477, name=qtp169517-5477 Acceptor1 SelectChannelConnector@127.0.0.1:49903, state=RUNNABLE, group=TGRP-HttpPartitionTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241) at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 13) Thread[id=5479, name=qtp169517-5479, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745) 14) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 15) Thread[id=5478, name=qtp169517-5478, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 15 threads leaked from SUITE scope at org.apache.solr.cloud.HttpPartitionTest:
1) Thread[id=5487, name=searcherExecutor-2832-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=5484, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-SendThread(127.0.0.1:51439), state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
3) Thread[id=5476, name=qtp169517-5476 Acceptor0 SelectChannelConnector@127.0.0.1:49903, state=BLOCKED, group=TGRP-HttpPartitionTest]
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:224)
at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=5481, name=qtp169517-5481, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=5475, name=qtp169517-5475 Selector1, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
6) Thread[id=5492, name=Thread-2414, state=TIMED_WAITING, group=Overseer state updater.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:119)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:87)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:274)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.amILeader(Overseer.java:583)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:207)
at java.lang.Thread.run(Thread.java:745)
7) Thread[id=5488, name=Thread-2412, state=WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
8) Thread[id=5480, name=qtp169517-5480, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
9) Thread[id=5474, name=qtp169517-5474 Selector0, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
10) Thread[id=5473, name=HashSessionScavenger-169, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:552)
at java.util.TimerThread.run(Timer.java:505)
11) Thread[id=5485, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-EventThread, state=WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
12) Thread[id=5477, name=qtp169517-5477 Acceptor1 SelectChannelConnector@127.0.0.1:49903, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:241)
at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:109)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
13) Thread[id=5479, name=qtp169517-5479, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
14) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
15) Thread[id=5478, name=qtp169517-5478, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([292842B8F0023D51]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=5475, name=qtp169517-5475 Selector1, state=RUNNABLE, group=TGRP-HttpPartitionTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 2) Thread[id=5488, name=Thread-2412, state=WAITING, group=TGRP-HttpPartitionTest] at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:503) at org.apache.solr.core.CloserThread.run(CoreContainer.java:944) 3) Thread[id=5477, name=qtp169517-5477 Acceptor1 SelectChannelConnector@127.0.0.1:49903, state=RUNNABLE, group=TGRP-HttpPartitionTest] at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 4) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) 5) Thread[id=5484, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-SendThread(127.0.0.1:51439), state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101) at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003) 6) Thread[id=5473, name=HashSessionScavenger-169, state=TIMED_WAITING, group=TGRP-HttpPartitionTest] at java.lang.Object.wait(Native Method) at java.util.TimerThread.mainLoop(Timer.java:552) at java.util.TimerThread.run(Timer.java:505) 7) Thread[id=5476, name=qtp169517-5476 Acceptor0 SelectChannelConnector@127.0.0.1:49903, state=BLOCKED, group=TGRP-HttpPartitionTest] at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 8) Thread[id=5474, name=qtp169517-5474 Selector0, state=RUNNABLE, group=TGRP-HttpPartitionTest] at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98) at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569) at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608) at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543) at java.lang.Thread.run(Thread.java:745) 9) Thread[id=5487, name=searcherExecutor-2832-thread-1, state=WAITING, group=TGRP-HttpPartitionTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=5475, name=qtp169517-5475 Selector1, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
2) Thread[id=5488, name=Thread-2412, state=WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:503)
at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
3) Thread[id=5477, name=qtp169517-5477 Acceptor1 SelectChannelConnector@127.0.0.1:49903, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
4) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
5) Thread[id=5484, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-SendThread(127.0.0.1:51439), state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
6) Thread[id=5473, name=HashSessionScavenger-169, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
at java.lang.Object.wait(Native Method)
at java.util.TimerThread.mainLoop(Timer.java:552)
at java.util.TimerThread.run(Timer.java:505)
7) Thread[id=5476, name=qtp169517-5476 Acceptor0 SelectChannelConnector@127.0.0.1:49903, state=BLOCKED, group=TGRP-HttpPartitionTest]
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
8) Thread[id=5474, name=qtp169517-5474 Selector0, state=RUNNABLE, group=TGRP-HttpPartitionTest]
at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
at java.lang.Thread.run(Thread.java:745)
9) Thread[id=5487, name=searcherExecutor-2832-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at __randomizedtesting.SeedInfo.seed([292842B8F0023D51]:0)
REGRESSION: org.apache.solr.cloud.HttpPartitionTest.testDistribSearch
Error Message:
Address already in use
Stack Trace:
java.net.BindException: Address already in use
at __randomizedtesting.SeedInfo.seed([292842B8F0023D51:A8CECCA0875D5D6D]:0)
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.AbstractPlainSocketImpl.bind(AbstractPlainSocketImpl.java:376)
at java.net.ServerSocket.bind(ServerSocket.java:376)
at org.apache.solr.cloud.SocketProxy.open(SocketProxy.java:101)
at org.apache.solr.cloud.SocketProxy.<init>(SocketProxy.java:79)
at org.apache.solr.cloud.HttpPartitionTest.createJetty(HttpPartitionTest.java:125)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:361)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:305)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:863)
at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11566 lines...]
[junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/init-core-data-001
[junit4] 2> 1167890 T5440 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /lkw/b
[junit4] 2> 1167893 T5440 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1167893 T5440 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1167894 T5441 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1167994 T5440 oasc.ZkTestServer.run start zk server on port:51439
[junit4] 2> 1167995 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1177166 T5444 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 9170ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1177169 T5447 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c7d5a name:ZooKeeperConnection Watcher:127.0.0.1:51439 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1177170 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1177171 T5440 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1177178 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1177179 T5449 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4bdfa6 name:ZooKeeperConnection Watcher:127.0.0.1:51439/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1177180 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1177180 T5440 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1177182 T5440 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1177183 T5440 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1177185 T5440 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1177187 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1177188 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1177192 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1177192 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1177195 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1177196 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1177198 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1177199 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1177201 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1177202 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1177204 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1177205 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1177206 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1177207 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1177209 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1177209 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1177211 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1177212 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1177214 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1177215 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1177216 T5440 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1177217 T5440 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1177476 T5440 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1177480 T5440 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49901
[junit4] 2> 1177480 T5440 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1177480 T5440 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1177481 T5440 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002
[junit4] 2> 1177481 T5440 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/'
[junit4] 2> 1177494 T5440 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/solr.xml
[junit4] 2> 1177529 T5440 oasc.CoreContainer.<init> New CoreContainer 494906
[junit4] 2> 1177530 T5440 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/]
[junit4] 2> 1177530 T5440 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1177531 T5440 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1177531 T5440 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1177531 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1177532 T5440 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1177532 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1177532 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1177532 T5440 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1177533 T5440 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1177533 T5440 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1177534 T5440 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1177534 T5440 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1177534 T5440 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51439/solr
[junit4] 2> 1177535 T5440 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1177535 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1177538 T5460 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c8fcb3 name:ZooKeeperConnection Watcher:127.0.0.1:51439 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1177538 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1177540 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1177542 T5462 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d021c8 name:ZooKeeperConnection Watcher:127.0.0.1:51439/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1177542 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1177543 T5440 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1177547 T5440 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1177549 T5440 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1177550 T5440 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1177552 T5440 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1177554 T5440 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1177555 T5440 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49902_lkw%2Fb
[junit4] 2> 1177556 T5440 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49902_lkw%2Fb
[junit4] 2> 1177557 T5440 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1177558 T5440 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1177567 T5440 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49902_lkw%2Fb
[junit4] 2> 1177568 T5440 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1177571 T5440 oasc.Overseer.start Overseer (id=91734465467777027-127.0.0.1:49902_lkw%2Fb-n_0000000000) starting
[junit4] 2> 1177575 T5440 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1177588 T5464 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1177589 T5440 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1177589 T5464 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:49902_lkw%2Fb
[junit4] 2> 1177592 T5440 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1177595 T5440 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1177598 T5463 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1177605 T5465 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1177605 T5465 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1177606 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1177606 T5465 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1177608 T5463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1177609 T5463 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49902/lkw/b",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49902_lkw%2Fb",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1177609 T5463 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1177610 T5463 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1177613 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1177614 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1178607 T5465 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1178608 T5465 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1178608 T5465 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1178608 T5465 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1178609 T5465 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1178609 T5465 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/collection1/'
[junit4] 2> 1178610 T5465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 1178610 T5465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 1178610 T5465 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 1178647 T5465 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1178682 T5465 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1178683 T5465 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1178689 T5465 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1178970 T5465 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1178975 T5465 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1178977 T5465 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1178985 T5465 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1178987 T5465 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1178990 T5465 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1178991 T5465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1178991 T5465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1178992 T5465 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1178993 T5465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1178993 T5465 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1178993 T5465 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1178993 T5465 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1178993 T5465 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-002/collection1/, dataDir=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/control/data/
[junit4] 2> 1178994 T5465 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e23f40
[junit4] 2> 1178994 T5465 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/control/data
[junit4] 2> 1178994 T5465 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/control/data/index/
[junit4] 2> 1178995 T5465 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1178995 T5465 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/control/data/index
[junit4] 2> 1178995 T5465 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=42.076171875, floorSegmentMB=1.263671875, forceMergeDeletesPctAllowed=23.138843387595916, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1178996 T5465 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1d5e37f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ee3163),segFN=segments_1,generation=1}
[junit4] 2> 1178996 T5465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1179000 T5465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1179001 T5465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1179001 T5465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1179001 T5465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1179002 T5465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1179002 T5465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1179002 T5465 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1179003 T5465 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1179003 T5465 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1179003 T5465 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1179004 T5465 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1179004 T5465 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1179004 T5465 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1179005 T5465 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1179006 T5465 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1179006 T5465 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1179007 T5465 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1179011 T5465 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1179013 T5465 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1179013 T5465 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1179014 T5465 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=30.1220703125, floorSegmentMB=0.828125, forceMergeDeletesPctAllowed=21.675007518877507, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.509931440980044
[junit4] 2> 1179014 T5465 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1d5e37f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1ee3163),segFN=segments_1,generation=1}
[junit4] 2> 1179015 T5465 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1179015 T5465 oass.SolrIndexSearcher.<init> Opening Searcher@1f109b0[collection1] main
[junit4] 2> 1179015 T5465 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1179016 T5465 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1179016 T5465 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1179017 T5465 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1179017 T5465 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1179017 T5465 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1179017 T5465 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1179018 T5465 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1179018 T5465 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1179018 T5465 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1179020 T5466 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1f109b0[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1179021 T5465 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1179022 T5469 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49902/lkw/b collection:control_collection shard:shard1
[junit4] 2> 1179022 T5440 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1179022 T5440 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1179023 T5469 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1179026 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1179026 T5472 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b3022 name:ZooKeeperConnection Watcher:127.0.0.1:51439/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1179027 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1179027 T5440 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1179028 T5469 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1179029 T5440 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1179029 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179029 T5469 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1179029 T5469 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C1359 name=collection1 org.apache.solr.core.SolrCore@d9fd30 url=http://127.0.0.1:49902/lkw/b/collection1 node=127.0.0.1:49902_lkw%2Fb C1359_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:49902/lkw/b, core=collection1, node_name=127.0.0.1:49902_lkw%2Fb}
[junit4] 2> 1179030 T5469 C1359 P49902 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49902/lkw/b/collection1/
[junit4] 2> 1179030 T5463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1179030 T5469 C1359 P49902 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1179030 T5469 C1359 P49902 oasc.SyncStrategy.syncToMe http://127.0.0.1:49902/lkw/b/collection1/ has no replicas
[junit4] 2> 1179030 T5469 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49902/lkw/b/collection1/ shard1
[junit4] 2> 1179031 T5469 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1179032 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179034 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179039 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179141 T5472 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1179141 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1179185 T5469 oasc.ZkController.register We are http://127.0.0.1:49902/lkw/b/collection1/ and leader is http://127.0.0.1:49902/lkw/b/collection1/
[junit4] 2> 1179186 T5469 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49902/lkw/b
[junit4] 2> 1179186 T5469 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1179186 T5469 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1179186 T5469 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1179187 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179188 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179188 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179188 T5469 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1179189 T5463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1179190 T5463 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:49902/lkw/b",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49902_lkw%2Fb",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1179191 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1179253 T5440 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1179253 T5440 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1179255 T5440 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49903
[junit4] 2> 1179255 T5440 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1179256 T5440 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1179256 T5440 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003
[junit4] 2> 1179256 T5440 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/'
[junit4] 2> 1179267 T5440 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/solr.xml
[junit4] 2> 1179293 T5472 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1179293 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1179301 T5440 oasc.CoreContainer.<init> New CoreContainer 12749493
[junit4] 2> 1179302 T5440 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/]
[junit4] 2> 1179303 T5440 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1179303 T5440 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1179303 T5440 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1179303 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1179304 T5440 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1179304 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1179304 T5440 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1179305 T5440 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1179305 T5440 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1179305 T5440 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1179306 T5440 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1179306 T5440 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1179306 T5440 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:51439/solr
[junit4] 2> 1179307 T5440 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1179307 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1179309 T5483 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20779e name:ZooKeeperConnection Watcher:127.0.0.1:51439 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1179309 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1179310 T5440 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1179312 T5485 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@db7b9a name:ZooKeeperConnection Watcher:127.0.0.1:51439/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1179312 T5440 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1179317 T5440 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1180320 T5440 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49904_lkw%2Fb
[junit4] 2> 1180321 T5440 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49904_lkw%2Fb
[junit4] 2> 1180336 T5486 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1180337 T5486 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1180339 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1180339 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1180339 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1180339 T5486 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1180342 T5463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1180343 T5463 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:49904/lkw/b",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:49904_lkw%2Fb",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1180344 T5463 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 1180344 T5463 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1180350 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1180453 T5472 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1180453 T5485 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1180453 T5462 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1181340 T5486 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1181341 T5486 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1181341 T5486 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1181342 T5486 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1181342 T5486 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1181343 T5486 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/collection1/'
[junit4] 2> 1181343 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 1181344 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 1181344 T5486 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 1181380 T5486 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1181416 T5486 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1181417 T5486 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1181423 T5486 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1181703 T5486 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1181708 T5486 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1181710 T5486 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1181718 T5486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1181721 T5486 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1181723 T5486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1181724 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1181724 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1181724 T5486 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1181725 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1181725 T5486 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1181725 T5486 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1181726 T5486 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1181726 T5486 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-003/collection1/, dataDir=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/jetty1/
[junit4] 2> 1181726 T5486 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@e23f40
[junit4] 2> 1181727 T5486 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/jetty1
[junit4] 2> 1181727 T5486 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/jetty1/index/
[junit4] 2> 1181727 T5486 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1181727 T5486 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.HttpPartitionTest-292842B8F0023D51-001/tempDir-001/jetty1/index
[junit4] 2> 1181728 T5486 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=30, maxMergedSegmentMB=42.076171875, floorSegmentMB=1.263671875, forceMergeDeletesPctAllowed=23.138843387595916, segmentsPerTier=30.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1181728 T5486 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@186c41d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@154c86e),segFN=segments_1,generation=1}
[junit4] 2> 1181728 T5486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1181732 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1181732 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1181732 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1181732 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1181733 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1181733 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1181733 T5486 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1181733 T5486 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1181734 T5486 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1181734 T5486 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1181735 T5486 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1181735 T5486 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1181735 T5486 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1181735 T5486 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1181736 T5486 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1181736 T5486 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1181737 T5486 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1181739 T5486 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1181741 T5486 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1181742 T5486 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1181742 T5486 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=30.1220703125, floorSegmentMB=0.828125, forceMergeDeletesPctAllowed=21.675007518877507, segmentsPerTier=23.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.509931440980044
[junit4] 2> 1181743 T5486 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@186c41d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@154c86e),segFN=segments_1,generation=1}
[junit4] 2> 1181743 T5486 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1181743 T5486 oass.SolrIndexSearcher.<init> Opening Searcher@295dea[collection1] main
[junit4] 2> 1181743 T5486 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1181744 T5486 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1181745 T5486 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1181745 T5486 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1181745 T5486 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1181745 T5486 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1181746 T5486 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1181746 T5486 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1181746 T5486 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1181747 T5486 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1181749 T5487 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@295dea[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1181752 T5486 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1181752 T5490 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49904/lkw/b collection:collection1 shard:shard1
[junit4] 2> 1181753 T5440 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4] 2> 1181753 T5440 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1181753 T5490 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1181759 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1181760 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181760 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181760 T5490 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1181761 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1181760 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181761 T5463 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C1360 name=collection1 org.apache.solr.core.SolrCore@e6ded1 url=http://127.0.0.1:49904/lkw/b/collection1 node=127.0.0.1:49904_lkw%2Fb C1360_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:49904/lkw/b, core=collection1, node_name=127.0.0.1:49904_lkw%2Fb}
[junit4] 2> 1181761 T5490 C1360 P49904 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49904/lkw/b/collection1/
[junit4] 2> 1181762 T5490 C1360 P49904 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1181762 T5490 C1360 P49904 oasc.SyncStrategy.syncToMe http://127.0.0.1:49904/lkw/b/collection1/ has no replicas
[junit4] 2> 1181762 T5490 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49904/lkw/b/collection1/ shard1
[junit4] 2> 1181762 T5490 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1181763 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181765 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181767 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1181775 T5440 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:49902/lkw/b
[junit4] 2> 1181777 T5440 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 49902
[junit4] 2> 1181778 T5440 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=494906
[junit4] 2> 1181778 T5440 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1181779 T5440 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1181781 T5462 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer
[...truncated too long message...]
at java.lang.Thread.run(Thread.java:745)
[junit4] > 14) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 15) Thread[id=5478, name=qtp169517-5478, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
[junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:342)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:526)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$600(QueuedThreadPool.java:44)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:572)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([292842B8F0023D51]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=5475, name=qtp169517-5475 Selector1, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
[junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] > at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] > at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 2) Thread[id=5488, name=Thread-2412, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.lang.Object.wait(Object.java:503)
[junit4] > at org.apache.solr.core.CloserThread.run(CoreContainer.java:944)
[junit4] > 3) Thread[id=5477, name=qtp169517-5477 Acceptor1 SelectChannelConnector@127.0.0.1:49903, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] > at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
[junit4] > at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:934)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 4) Thread[id=5490, name=coreZkRegister-2828-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 5) Thread[id=5484, name=TEST-HttpPartitionTest.testDistribSearch-seed#[292842B8F0023D51]-SendThread(127.0.0.1:51439), state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
[junit4] > 6) Thread[id=5473, name=HashSessionScavenger-169, state=TIMED_WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at java.lang.Object.wait(Native Method)
[junit4] > at java.util.TimerThread.mainLoop(Timer.java:552)
[junit4] > at java.util.TimerThread.run(Timer.java:505)
[junit4] > 7) Thread[id=5476, name=qtp169517-5476 Acceptor0 SelectChannelConnector@127.0.0.1:49903, state=BLOCKED, group=TGRP-HttpPartitionTest]
[junit4] > at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 8) Thread[id=5474, name=qtp169517-5474 Selector0, state=RUNNABLE, group=TGRP-HttpPartitionTest]
[junit4] > at sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
[junit4] > at sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269)
[junit4] > at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:79)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
[junit4] > at org.eclipse.jetty.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:569)
[junit4] > at org.eclipse.jetty.io.nio.SelectorManager$1.run(SelectorManager.java:290)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > 9) Thread[id=5487, name=searcherExecutor-2832-thread-1, state=WAITING, group=TGRP-HttpPartitionTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)
[junit4] > at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] > at __randomizedtesting.SeedInfo.seed([292842B8F0023D51]:0)
[junit4] Completed on J0 in 158.44s, 1 test, 1 failure, 3 errors <<< FAILURES!
[...truncated 190 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:920: There were test failures: 400 suites, 1679 tests, 3 suite-level errors, 1 error, 276 ignored (16 assumptions)
Total time: 78 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_55 -server -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.7.0_55) - Build #
10273 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10273/
Java: 32bit/jdk1.7.0_55 -client -XX:+UseConcMarkSweepGC
1 tests failed.
FAILED: org.apache.solr.cloud.SyncSliceTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
at __randomizedtesting.SeedInfo.seed([B9C60E57BAA541DE:3820804FCDFA21E2]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1140)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1109)
at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:745)
Build Log:
[...truncated 11155 lines...]
[junit4] Suite: org.apache.solr.cloud.SyncSliceTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/init-core-data-001
[junit4] 2> 1030116 T4314 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
[junit4] 2> 1030116 T4314 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /_wn/z
[junit4] 2> 1030120 T4314 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> 1030120 T4314 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1030121 T4315 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1030221 T4314 oasc.ZkTestServer.run start zk server on port:45464
[junit4] 2> 1030222 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1032729 T4318 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 2506ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1032732 T4321 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@177ddc name:ZooKeeperConnection Watcher:127.0.0.1:45464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1032733 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1032734 T4314 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1032740 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1032742 T4323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a34519 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1032743 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1032743 T4314 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1032748 T4314 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1032752 T4314 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1032755 T4314 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1032759 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1032760 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1032767 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1032768 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1032773 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1032774 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1032779 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1032780 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1032784 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1032785 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1032790 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1032791 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1032795 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1032796 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1032802 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1032803 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1032806 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1032807 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1032812 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1032812 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1032816 T4314 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1032817 T4314 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1032822 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1032824 T4325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@19ef9d6 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1032825 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1033092 T4314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1033096 T4314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1033102 T4314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:54362
[junit4] 2> 1033105 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1033105 T4314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1033106 T4314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002
[junit4] 2> 1033107 T4314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/'
[junit4] 2> 1033128 T4314 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/solr.xml
[junit4] 2> 1033172 T4314 oasc.CoreContainer.<init> New CoreContainer 6225127
[junit4] 2> 1033172 T4314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/]
[junit4] 2> 1033173 T4314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1033174 T4314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1033174 T4314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1033174 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1033175 T4314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1033175 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1033176 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1033176 T4314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1033176 T4314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1033178 T4314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1033179 T4314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1033179 T4314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1033179 T4314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45464/solr
[junit4] 2> 1033180 T4314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1033181 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1033182 T4336 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@94732f name:ZooKeeperConnection Watcher:127.0.0.1:45464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1033183 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1033186 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1033188 T4338 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1ba48be name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1033188 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1033191 T4314 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1033196 T4314 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1033201 T4314 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
[junit4] 2> 1033207 T4314 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
[junit4] 2> 1033211 T4314 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
[junit4] 2> 1033216 T4314 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1033218 T4314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54362__wn%2Fz
[junit4] 2> 1033220 T4314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54362__wn%2Fz
[junit4] 2> 1033274 T4314 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1033279 T4314 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1033283 T4314 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:54362__wn%2Fz
[junit4] 2> 1033284 T4314 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1033285 T4314 oasc.Overseer.start Overseer (id=91731132905553924-127.0.0.1:54362__wn%2Fz-n_0000000000) starting
[junit4] 2> 1033287 T4314 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1033293 T4340 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1033293 T4314 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1033294 T4340 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes at 127.0.0.1:54362__wn%2Fz
[junit4] 2> 1033296 T4314 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1033298 T4314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1033300 T4339 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1033304 T4341 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
[junit4] 2> 1033305 T4341 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1033305 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1033305 T4341 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1033306 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1033307 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:54362/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54362__wn%2Fz",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1033307 T4339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1033307 T4339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1033309 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1033310 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1034306 T4341 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1034307 T4341 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1034308 T4341 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1034308 T4341 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1034310 T4341 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1034311 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/collection1/'
[junit4] 2> 1034312 T4341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/collection1/lib/.svn/' to classloader
[junit4] 2> 1034312 T4341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/collection1/lib/classes/' to classloader
[junit4] 2> 1034313 T4341 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/collection1/lib/README' to classloader
[junit4] 2> 1034379 T4341 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1034423 T4341 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1034425 T4341 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1034446 T4341 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1034800 T4341 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1034806 T4341 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1034809 T4341 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1034819 T4341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1034822 T4341 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1034825 T4341 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1034826 T4341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1034826 T4341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1034826 T4341 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1034827 T4341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1034827 T4341 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1034827 T4341 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
[junit4] 2> 1034828 T4341 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1034828 T4341 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-002/collection1/, dataDir=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/control/data/
[junit4] 2> 1034828 T4341 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ae5558
[junit4] 2> 1034829 T4341 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/control/data
[junit4] 2> 1034829 T4341 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/control/data/index/
[junit4] 2> 1034829 T4341 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1034829 T4341 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/control/data/index
[junit4] 2> 1034830 T4341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=29.7421875, floorSegmentMB=0.6455078125, forceMergeDeletesPctAllowed=27.622885070011847, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6009893587987888
[junit4] 2> 1034831 T4341 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@104fc4d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@157ec14; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1034831 T4341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1034834 T4341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1034834 T4341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1034835 T4341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1034835 T4341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1034835 T4341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1034836 T4341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1034836 T4341 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1034837 T4341 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1034837 T4341 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1034837 T4341 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1034838 T4341 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1034838 T4341 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1034839 T4341 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1034839 T4341 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1034840 T4341 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1034840 T4341 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1034841 T4341 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1034843 T4341 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1034846 T4341 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1034846 T4341 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1034847 T4341 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1460295881, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1034847 T4341 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@104fc4d lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@157ec14; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1034848 T4341 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1034848 T4341 oass.SolrIndexSearcher.<init> Opening Searcher@14c3640[collection1] main
[junit4] 2> 1034848 T4341 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1034849 T4341 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1034850 T4341 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1034850 T4341 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1034850 T4341 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1034850 T4341 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1034851 T4341 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1034851 T4341 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1034851 T4341 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1034852 T4341 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1034854 T4342 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@14c3640[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1034856 T4341 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1034857 T4345 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:54362/_wn/z collection:control_collection shard:shard1
[junit4] 2> 1034858 T4314 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1034859 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1034859 T4345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1034864 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1034865 T4347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc4938 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1034866 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1034867 T4314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1034867 T4345 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1034868 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1034868 T4314 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1034869 T4345 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1034869 T4345 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1034869 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> ASYNC NEW_CORE C4964 name=collection1 org.apache.solr.core.SolrCore@7fc688 url=https://127.0.0.1:54362/_wn/z/collection1 node=127.0.0.1:54362__wn%2Fz C4964_STATE=coll:control_collection core:collection1 props:{state=down, base_url=https://127.0.0.1:54362/_wn/z, core=collection1, node_name=127.0.0.1:54362__wn%2Fz}
[junit4] 2> 1034869 T4345 C4964 P54362 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:54362/_wn/z/collection1/
[junit4] 2> 1034870 T4345 C4964 P54362 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1034870 T4345 C4964 P54362 oasc.SyncStrategy.syncToMe https://127.0.0.1:54362/_wn/z/collection1/ has no replicas
[junit4] 2> 1034870 T4345 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:54362/_wn/z/collection1/ shard1
[junit4] 2> 1034871 T4345 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1035138 T4314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1035139 T4314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1035143 T4314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1035144 T4314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:34646
[junit4] 2> 1035147 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1035147 T4314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1035148 T4314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003
[junit4] 2> 1035148 T4314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/'
[junit4] 2> 1035162 T4314 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/solr.xml
[junit4] 2> 1035218 T4314 oasc.CoreContainer.<init> New CoreContainer 21541112
[junit4] 2> 1035218 T4314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/]
[junit4] 2> 1035220 T4314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1035221 T4314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1035221 T4314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1035222 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1035222 T4314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1035222 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1035223 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1035223 T4314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1035224 T4314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1035227 T4314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1035227 T4314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1035228 T4314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1035228 T4314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45464/solr
[junit4] 2> 1035229 T4314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1035230 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1041538 T4316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145e4fab7ae0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1041638 T4347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc4938 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:Disconnected type:None path:null path:null type:None
[junit4] 2> 1041639 T4347 oascc.ConnectionManager.process zkClient has disconnected
[junit4] 2> 1043408 T4347 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fc4938 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1045455 T4318 oazsp.FileTxnLog.commit WARN fsync-ing the write ahead log in SyncThread:0 took 10584ms which will adversely effect operation latency. See the ZooKeeper troubleshooting guide
[junit4] 2> 1045464 T4358 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1421d2e name:ZooKeeperConnection Watcher:127.0.0.1:45464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1045464 T4318 oazs.NIOServerCnxn.sendBuffer ERROR Unexpected Exception: java.nio.channels.CancelledKeyException
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.ensureValid(SelectionKeyImpl.java:73)
[junit4] 2> at sun.nio.ch.SelectionKeyImpl.interestOps(SelectionKeyImpl.java:77)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendBuffer(NIOServerCnxn.java:151)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.sendResponse(NIOServerCnxn.java:1081)
[junit4] 2> at org.apache.zookeeper.server.FinalRequestProcessor.processRequest(FinalRequestProcessor.java:170)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.flush(SyncRequestProcessor.java:200)
[junit4] 2> at org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:131)
[junit4] 2>
[junit4] 2> 1045465 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1045467 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045468 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045468 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045468 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1045472 T4360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16a2476 name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1045473 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1045475 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045477 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1045480 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045482 T4314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1045582 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045582 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045582 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045628 T4345 oasc.ZkController.register We are https://127.0.0.1:54362/_wn/z/collection1/ and leader is https://127.0.0.1:54362/_wn/z/collection1/
[junit4] 2> 1045628 T4345 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:54362/_wn/z
[junit4] 2> 1045629 T4345 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1045629 T4345 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
[junit4] 2> 1045629 T4345 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1045630 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045631 T4345 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1045631 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045631 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045632 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1045632 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:54362/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:54362__wn%2Fz",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1045634 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1045737 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045737 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1045738 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1046485 T4314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34646__wn%2Fz
[junit4] 2> 1046488 T4314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34646__wn%2Fz
[junit4] 2> 1046506 T4361 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1046507 T4361 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1046508 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1046508 T4361 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1046509 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1046510 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1046511 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1046512 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:34646/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34646__wn%2Fz",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1046513 T4339 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1]
[junit4] 2> 1046514 T4339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1046518 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1046621 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1046621 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1046621 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1047509 T4361 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1047510 T4361 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1047510 T4361 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1047511 T4361 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1047511 T4361 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1047511 T4361 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/collection1/'
[junit4] 2> 1047512 T4361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/collection1/lib/.svn/' to classloader
[junit4] 2> 1047513 T4361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/collection1/lib/classes/' to classloader
[junit4] 2> 1047513 T4361 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/collection1/lib/README' to classloader
[junit4] 2> 1047566 T4361 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1047628 T4361 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1047629 T4361 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1047639 T4361 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1048117 T4361 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1048125 T4361 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1048129 T4361 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1048140 T4361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1048144 T4361 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1048149 T4361 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1048150 T4361 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1048150 T4361 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1048150 T4361 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1048151 T4361 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1048151 T4361 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1048152 T4361 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1048152 T4361 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1048152 T4361 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-003/collection1/, dataDir=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty1/
[junit4] 2> 1048152 T4361 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ae5558
[junit4] 2> 1048153 T4361 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty1
[junit4] 2> 1048153 T4361 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty1/index/
[junit4] 2> 1048154 T4361 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1048154 T4361 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty1/index
[junit4] 2> 1048154 T4361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=29.7421875, floorSegmentMB=0.6455078125, forceMergeDeletesPctAllowed=27.622885070011847, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6009893587987888
[junit4] 2> 1048155 T4361 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@156fc93 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8230a3; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1048156 T4361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1048160 T4361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1048161 T4361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1048161 T4361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1048161 T4361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1048162 T4361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1048162 T4361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1048162 T4361 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1048163 T4361 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1048163 T4361 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1048164 T4361 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1048164 T4361 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1048165 T4361 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1048165 T4361 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1048165 T4361 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1048166 T4361 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1048166 T4361 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1048167 T4361 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1048170 T4361 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1048173 T4361 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1048173 T4361 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1048176 T4361 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1460295881, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1048178 T4361 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@156fc93 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@8230a3; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1048178 T4361 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1048178 T4361 oass.SolrIndexSearcher.<init> Opening Searcher@1baee4e[collection1] main
[junit4] 2> 1048178 T4361 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1048179 T4361 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1048180 T4361 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1048180 T4361 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1048180 T4361 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1048181 T4361 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1048181 T4361 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1048182 T4361 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1048182 T4361 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1048182 T4361 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1048187 T4362 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1baee4e[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1048193 T4361 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1048193 T4365 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:34646/_wn/z collection:collection1 shard:shard1
[junit4] 2> 1048194 T4314 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1048194 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1048194 T4365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1048198 T4365 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1048200 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048200 T4365 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1048200 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048200 T4365 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> 1048200 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> ASYNC NEW_CORE C4965 name=collection1 org.apache.solr.core.SolrCore@1e2a2d url=https://127.0.0.1:34646/_wn/z/collection1 node=127.0.0.1:34646__wn%2Fz C4965_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:34646/_wn/z, core=collection1, node_name=127.0.0.1:34646__wn%2Fz}
[junit4] 2> 1048201 T4365 C4965 P34646 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:34646/_wn/z/collection1/
[junit4] 2> 1048201 T4365 C4965 P34646 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1048201 T4365 C4965 P34646 oasc.SyncStrategy.syncToMe https://127.0.0.1:34646/_wn/z/collection1/ has no replicas
[junit4] 2> 1048202 T4365 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:34646/_wn/z/collection1/ shard1
[junit4] 2> 1048202 T4365 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1048202 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1048205 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048206 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048206 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048206 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048211 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1048213 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048315 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048315 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048315 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048359 T4365 oasc.ZkController.register We are https://127.0.0.1:34646/_wn/z/collection1/ and leader is https://127.0.0.1:34646/_wn/z/collection1/
[junit4] 2> 1048359 T4365 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:34646/_wn/z
[junit4] 2> 1048360 T4365 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1048360 T4365 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
[junit4] 2> 1048360 T4365 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1048362 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048362 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048362 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048362 T4365 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1048364 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1048364 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"https://127.0.0.1:34646/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:34646__wn%2Fz",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1048366 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1048472 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048472 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048472 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1048549 T4314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1048550 T4314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1048555 T4314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1048557 T4314 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:41170
[junit4] 2> 1048560 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1048560 T4314 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1048561 T4314 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004
[junit4] 2> 1048561 T4314 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/'
[junit4] 2> 1048580 T4314 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/solr.xml
[junit4] 2> 1048651 T4314 oasc.CoreContainer.<init> New CoreContainer 11454794
[junit4] 2> 1048652 T4314 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/]
[junit4] 2> 1048653 T4314 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1048654 T4314 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to:
[junit4] 2> 1048654 T4314 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1048654 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1048655 T4314 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1048655 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1048656 T4314 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1048656 T4314 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1048656 T4314 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1048659 T4314 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1048659 T4314 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1048660 T4314 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1048660 T4314 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:45464/solr
[junit4] 2> 1048661 T4314 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1048662 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1048663 T4376 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1bb883a name:ZooKeeperConnection Watcher:127.0.0.1:45464 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1048663 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1048667 T4316 oazs.NIOServerCnxn.doIO WARN caught end of stream exception EndOfStreamException: Unable to read additional data from client sessionid 0x145e4fab7ae0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
[junit4] 2> at java.lang.Thread.run(Thread.java:745)
[junit4] 2>
[junit4] 2> 1048668 T4314 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1048669 T4378 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1013d8e name:ZooKeeperConnection Watcher:127.0.0.1:45464/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1048669 T4314 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1048681 T4314 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1049688 T4314 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41170__wn%2Fz
[junit4] 2> 1049689 T4314 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:41170__wn%2Fz
[junit4] 2> 1049701 T4379 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
[junit4] 2> 1049701 T4379 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1049702 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1049702 T4379 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1049702 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1049703 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1049704 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1049705 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:41170/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41170__wn%2Fz",
[junit4] 2> "shard":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1049705 T4339 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=1
[junit4] 2> 1049706 T4339 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1049709 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1049810 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1049810 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1049810 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1049810 T4378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1050703 T4379 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1050703 T4379 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1050704 T4379 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1050704 T4379 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1050705 T4379 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1050705 T4379 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/collection1/'
[junit4] 2> 1050706 T4379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/collection1/lib/.svn/' to classloader
[junit4] 2> 1050706 T4379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/collection1/lib/classes/' to classloader
[junit4] 2> 1050707 T4379 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/collection1/lib/README' to classloader
[junit4] 2> 1050749 T4379 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 1050797 T4379 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1050798 T4379 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1050806 T4379 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1051277 T4379 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1051283 T4379 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1051285 T4379 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1051294 T4379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1051297 T4379 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1051300 T4379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1051301 T4379 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1051302 T4379 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1051302 T4379 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1051303 T4379 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1051304 T4379 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1051304 T4379 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
[junit4] 2> 1051305 T4379 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1051305 T4379 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-004/collection1/, dataDir=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty2/
[junit4] 2> 1051305 T4379 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@1ae5558
[junit4] 2> 1051306 T4379 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty2
[junit4] 2> 1051307 T4379 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty2/index/
[junit4] 2> 1051307 T4379 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1051307 T4379 oasc.CachingDirectoryFactory.get return new directory for ./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001/tempDir-001/jetty2/index
[junit4] 2> 1051308 T4379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=13, maxMergedSegmentMB=29.7421875, floorSegmentMB=0.6455078125, forceMergeDeletesPctAllowed=27.622885070011847, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6009893587987888
[junit4] 2> 1051309 T4379 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@5fb6df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12331ac; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1051309 T4379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1051314 T4379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1051314 T4379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1051315 T4379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1051315 T4379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1051316 T4379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1051316 T4379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1051316 T4379 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1051317 T4379 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1051317 T4379 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1051317 T4379 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1051318 T4379 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1051318 T4379 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1051319 T4379 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1051320 T4379 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1051320 T4379 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1051321 T4379 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1051322 T4379 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1051324 T4379 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1051327 T4379 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1051328 T4379 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1051328 T4379 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1460295881, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 1051329 T4379 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(NRTCachingDirectory(RAMDirectory@5fb6df lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@12331ac; maxCacheMB=0.9775390625 maxMergeSizeMB=0.12109375)),segFN=segments_1,generation=1}
[junit4] 2> 1051329 T4379 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1051329 T4379 oass.SolrIndexSearcher.<init> Opening Searcher@1d7334b[collection1] main
[junit4] 2> 1051330 T4379 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1051330 T4379 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
[junit4] 2> 1051331 T4379 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
[junit4] 2> 1051331 T4379 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1051331 T4379 oasr.RestManager.init Initializing RestManager with initArgs: {}
[junit4] 2> 1051332 T4379 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1051332 T4379 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
[junit4] 2> 1051332 T4379 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1051333 T4379 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 1051333 T4379 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 1051337 T4380 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d7334b[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1051340 T4379 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1051341 T4383 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:41170/_wn/z collection:collection1 shard:shard1
[junit4] 2> 1051342 T4314 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0
[junit4] 2> 1051342 T4314 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1051343 T4383 oasc.ZkController.register We are https://127.0.0.1:41170/_wn/z/collection1/ and leader is https://127.0.0.1:34646/_wn/z/collection1/
[junit4] 2> 1051344 T4383 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:41170/_wn/z
[junit4] 2> 1051344 T4383 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4] 2> 1051344 T4383 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4] 2> ASYNC NEW_CORE C4966 name=collection1 org.apache.solr.core.SolrCore@6bd3e1 url=https://127.0.0.1:41170/_wn/z/collection1 node=127.0.0.1:41170__wn%2Fz C4966_STATE=coll:collection1 core:collection1 props:{state=down, base_url=https://127.0.0.1:41170/_wn/z, core=collection1, node_name=127.0.0.1:41170__wn%2Fz}
[junit4] 2> 1051344 T4384 C4966 P41170 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4] 2> 1051345 T4383 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1051345 T4384 C4966 P41170 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4] 2> 1051345 T4384 C4966 P41170 oasc.RecoveryStrategy.doRecovery Publishing state of core collection1 as recovering, leader is https://127.0.0.1:34646/_wn/z/collection1/ and I am https://127.0.0.1:41170/_wn/z/collection1/
[junit4] 2> 1051345 T4384 C4966 P41170 oasc.ZkController.publish publishing core=collection1 state=recovering collection=collection1
[junit4] 2> 1051345 T4384 C4966 P41170 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1051350 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1051350 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1051350 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1051351 T4339 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1051351 T4384 C4966 P41170 oasc.RecoveryStrategy.sendPrepRecoveryCmd Sending prep recovery command to https://127.0.0.1:34646/_wn/z; WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1%3A41170__wn%252Fz&coreNodeName=core_node2&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true
[junit4] 2> 1051352 T4339 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "base_url":"https://127.0.0.1:41170/_wn/z",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:41170__wn%2Fz",
[junit4] 2> "shard":"shard1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1051354 T4338 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1051355 T4347 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1051355 T4338 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1051355 T4360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1051356 T4378 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1051416 T4353 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
[junit4] 2> 1051417 T4353 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1051418 T4353 oasha.CoreAdminHandler.handleWaitForStateAction Will wait a max of 183 seconds to see collection1 (shard1 of collection1) have state: recovering
[junit4] 2> 1051418 T4353 oasha.CoreAdminHandler.handleWaitForStateAction In WaitForState(recovering): collection=collection1, shard=shard1, isLeader? true, live=true, currentState=recovering, localState=active, nodeName=127.0.0.1:41170__wn%2Fz, coreNodeName=core_node2, onlyIfActiveCheckResult=false, nodeProps: core_node2:{"state":"recovering","base_url":"https://127.0.0.1:41170/_wn/z","core":"collection1","node_name":"127.0.0.1:41170__wn%2Fz"}
[junit4] 2> 1051419 T4353 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: core_node2, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
[junit4] 2> 1051419 T4353 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={version=2&core=collection1&onlyIfLeader=true&wt=javabin&onlyIfLeaderActive=true&checkLive=true&nodeName=127.0.0.1:41170__wn%252Fz&action=PREPRECOVERY&coreNodeName=core_node2&state=recovering} status=0 QTime=3
[junit4] 2> 1051673 T4314 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1051674 T4314 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1051694 T4314 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
[junit4] 2> 1051696 T4314 oejs.AbstractConnector.doStart Started S
[...truncated too long message...]
rdLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:267)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.rejoinLeaderElection(ElectionContext.java:437)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:208)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:142)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:110)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1101957 T4419 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 1101957 T4419 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1101958 T4419 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1101958 T4419 oasc.LeaderElector$ElectionWatcher.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1472)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:260)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:257)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:94)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:303)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
[junit4] 2>
[junit4] 2> 1101968 T4314 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/_wn/z,null}
[junit4] 2> 1102020 T4314 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4] 2> 1102022 T4314 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45464 45464
[junit4] 2> 1102232 T4315 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:45464 45464
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=SyncSliceTest -Dtests.method=testDistribSearch -Dtests.seed=B9C60E57BAA541DE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sl_SI -Dtests.timezone=Mexico/BajaNorte -Dtests.file.encoding=UTF-8
[junit4] ERROR 72.1s J0 | SyncSliceTest.testDistribSearch <<<
[junit4] > Throwable #1: org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request
[junit4] > at __randomizedtesting.SeedInfo.seed([B9C60E57BAA541DE:3820804FCDFA21E2]:0)
[junit4] > at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:317)
[junit4] > at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:636)
[junit4] > at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:91)
[junit4] > at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1140)
[junit4] > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1109)
[junit4] > at org.apache.solr.cloud.SyncSliceTest.doTest(SyncSliceTest.java:236)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:865)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] 2> 1102247 T4314 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.cloud.SyncSliceTest-B9C60E57BAA541DE-001
[junit4] 2> 72138 T4313 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=sl_SI, timezone=Mexico/BajaNorte
[junit4] 2> NOTE: Linux 3.8.0-39-generic i386/Oracle Corporation 1.7.0_55 (32-bit)/cpus=8,threads=1,free=252958608,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [DistributedQueryElevationComponentTest, TestFileDictionaryLookup, CachingDirectoryFactoryTest, CoreAdminHandlerTest, CopyFieldTest, ClusterStateUpdateTest, TestRestManager, TestReplicationHandler, PrimitiveFieldTypeTest, TestExtendedDismaxParser, SolrIndexSplitterTest, LukeRequestHandlerTest, TestManagedSynonymFilterFactory, TestDocSet, LoggingHandlerTest, SchemaVersionSpecificBehaviorTest, ReturnFieldsTest, MBeansHandlerTest, ShardSplitTest, RecoveryZkTest, BadCopyFieldTest, AnalysisErrorHandlingTest, SolrTestCaseJ4Test, TimeZoneUtilsTest, EchoParamsTest, BadComponentTest, TestAnalyzeInfixSuggestions, TestInitQParser, AnalysisAfterCoreReloadTest, SoftAutoCommitTest, UpdateParamsTest, TestPerFieldSimilarity, TestSearchPerf, ScriptEngineTest, TestNoOpRegenerator, TestLuceneMatchVersion, TestRecoveryHdfs, QueryEqualityTest, TestFieldSortValues, TriLevelCompositeIdRoutingTest, TestManagedResource, DocValuesMissingTest, TestUtils, SolrInfoMBeanTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesTest, TestSchemaVersionResource, TestSuggestSpellingConverter, TestSolrXml, URLClassifyProcessorTest, FieldFacetExtrasTest, CursorMarkTest, HttpPartitionTest, TermsComponentTest, TestRandomDVFaceting, AliasIntegrationTest, CoreMergeIndexesAdminHandlerTest, TestPHPSerializedResponseWriter, TestPostingsSolrHighlighter, ResponseLogComponentTest, SpellingQueryConverterTest, TestSort, TestHighlightDedupGrouping, TestTrie, SuggestComponentTest, TestCustomSort, ShowFileRequestHandlerTest, TestLFUCache, SolrCoreTest, CustomCollectionTest, SliceStateUpdateTest, TermVectorComponentTest, UpdateRequestProcessorFactoryTest, SampleTest, TestSolrIndexConfig, ZkControllerTest, TestSurroundQueryParser, TestFieldTypeResource, OverseerStatusTest, DistributedQueryComponentCustomSortTest, TestCloudInspectUtil, AtomicUpdatesTest, ChaosMonkeyNothingIsSafeTest, BinaryUpdateRequestHandlerTest, ClusterStateTest, OverseerCollectionProcessorTest, DocExpirationUpdateProcessorFactoryTest, WordBreakSolrSpellCheckerTest, SimpleFacetsTest, TestPseudoReturnFields, HdfsCollectionsAPIDistributedZkTest, TestCopyFieldCollectionResource, TestJmxMonitoredMap, TestStressVersions, TestStandardQParsers, ZkCLITest, HdfsSyncSliceTest, UnloadDistributedZkTest, SyncSliceTest]
[junit4] Completed on J0 in 72.68s, 1 test, 1 error <<< FAILURES!
[...truncated 588 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:447: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:920: There were test failures: 400 suites, 1679 tests, 1 error, 37 ignored (16 assumptions)
Total time: 63 minutes 49 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/jdk1.7.0_55 -client -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (64bit/ibm-j9-jdk7) - Build #
10272 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/10272/
Java: 64bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
2 tests failed.
REGRESSION: org.apache.solr.schema.ModifyConfFileTest.testConfigWrite
Error Message:
should have detected an error early! Expected: a string containing "\"</dataDir>\"" got: "Invalid solr config file: org.xml.sax.SAXParseException: 元素类型“dataDir”必须用匹配的结束标记“</dataDir>”终止。"
Stack Trace:
java.lang.AssertionError: should have detected an error early!
Expected: a string containing "\"</dataDir>\""
got: "Invalid solr config file: org.xml.sax.SAXParseException: 元素类型“dataDir”必须用匹配的结束标记“</dataDir>”终止。"
at __randomizedtesting.SeedInfo.seed([7BA000229CBF6C28:CD9B2D2AA0B61CED]:0)
at org.junit.Assert.assertThat(Assert.java:780)
at org.apache.solr.schema.ModifyConfFileTest.testConfigWrite(ModifyConfFileTest.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:94)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:619)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:853)
REGRESSION: org.apache.solr.update.AutoCommitTest.testMaxTime
Error Message:
Exception during query
Stack Trace:
java.lang.RuntimeException: Exception during query
at __randomizedtesting.SeedInfo.seed([7BA000229CBF6C28:E1547DC00225F014]:0)
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:719)
at org.apache.solr.update.AutoCommitTest.testMaxTime(AutoCommitTest.java:227)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:94)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:619)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
at java.lang.Thread.run(Thread.java:853)
Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=0]
xml response was: <?xml version="1.0" encoding="UTF-8"?>
<response>
<lst name="responseHeader"><int name="status">0</int><int name="QTime">1405</int></lst><result name="response" numFound="1" start="0"><doc><int name="id">529</int><arr name="range_facet_l"><long>529</long></arr><arr name="field_t"><str>what's inside?</str></arr><arr name="subject"><str>info</str></arr><long name="_version_">1467686022647119872</long><date name="timestamp">2014-05-10T04:01:04.347Z</date><int name="intDefault">42</int><arr name="multiDefault"><str>muLti-Default</str></arr></doc></result>
</response>
request was:start=0&qt=standard&q=id:529&version=2.2&rows=20
at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:712)
... 42 more
Build Log:
[...truncated 11139 lines...]
[junit4] Suite: org.apache.solr.update.AutoCommitTest
[junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001
[junit4] 2> 434228 T1997 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
[junit4] 2> 434228 T1997 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 434229 T1997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 434230 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 434230 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 434231 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 434271 T1997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 434321 T1997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 434322 T1997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 434328 T1997 oass.IndexSchema.readSchema [null] Schema name=test
[junit4] 2> 434701 T1997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 434709 T1997 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 434713 T1997 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 434727 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 434732 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 434737 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 434739 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 434739 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 434740 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 434740 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 434741 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 434741 T1997 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 434742 T1997 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr
[junit4] 2> 434742 T1997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/'
[junit4] 2> 434800 T1997 oasc.CoreContainer.<init> New CoreContainer 593457264
[junit4] 2> 434800 T1997 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/]
[junit4] 2> 434802 T1997 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
[junit4] 2> 434802 T1997 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
[junit4] 2> 434803 T1997 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
[junit4] 2> 434803 T1997 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 434804 T1997 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 434804 T1997 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 434805 T1997 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 434805 T1997 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 434805 T1997 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 434810 T1997 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 434810 T1997 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 434811 T1997 oasc.CoreContainer.load Host Name:
[junit4] 2> 434816 T1998 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 434817 T1998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 434817 T1998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 434817 T1998 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 434859 T1998 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 434922 T1998 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 434923 T1998 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 434929 T1998 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 435192 T1998 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 435198 T1998 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 435201 T1998 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 435207 T1998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 435210 T1998 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 435213 T1998 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 435214 T1998 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 435214 T1998 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 435214 T1998 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 435215 T1998 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 435215 T1998 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 435215 T1998 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/
[junit4] 2> 435215 T1998 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 435216 T1998 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/
[junit4] 2> 435216 T1998 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cf4c8f8
[junit4] 2> 435217 T1998 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001
[junit4] 2> 435217 T1998 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index/
[junit4] 2> 435217 T1998 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index' doesn't exist. Creating new index...
[junit4] 2> 435218 T1998 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index
[junit4] 2> 435218 T1998 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=30, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=40.845703125, floorSegmentMB=0.6845703125, forceMergeDeletesPctAllowed=17.20052578213322, segmentsPerTier=32.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 435219 T1998 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_1,generation=1}
[junit4] 2> 435219 T1998 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 435219 T1998 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 435222 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 435222 T1998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 435222 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 435223 T1998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 435223 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 435223 T1998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 435223 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 435224 T1998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 435224 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 435224 T1998 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 435225 T1998 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 435225 T1998 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 435225 T1998 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 435226 T1998 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 435226 T1998 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 435226 T1998 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 435227 T1998 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 435227 T1998 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 435227 T1998 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 435228 T1998 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 435228 T1998 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 435228 T1998 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 435228 T1998 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 435229 T1998 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 435229 T1998 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 435229 T1998 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435229 T1998 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435230 T1998 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435230 T1998 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435230 T1998 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435231 T1998 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435231 T1998 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435231 T1998 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435232 T1998 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 435232 T1998 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 435233 T1998 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 435240 T1998 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 435242 T1998 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 435242 T1998 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 435242 T1998 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5023370720406509]
[junit4] 2> 435243 T1998 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_1,generation=1}
[junit4] 2> 435243 T1998 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 435244 T1998 oass.SolrIndexSearcher.<init> Opening Searcher@89864d69[collection1] main
[junit4] 2> 435244 T1998 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 435244 T1998 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 435245 T1998 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 435245 T1998 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 435245 T1998 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 435245 T1998 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 435375 T1998 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 435397 T1999 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@89864d69[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 435399 T1998 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 435401 T1997 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 435404 T1997 oas.SolrTestCaseJ4.setUp ###Starting testMaxTime
[junit4] 2> ASYNC NEW_CORE C1728 name=collection1 org.apache.solr.core.SolrCore@a8d5c035
[junit4] 2> 435406 T1997 C1728 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1467686021168627712)} 0 1
[junit4] 2> 435410 T1997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 435411 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 435412 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 435413 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 435467 T1997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 435541 T1997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 435542 T1997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 435551 T1997 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 435890 T1997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 435895 T1997 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 435897 T1997 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 435903 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 435907 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 435910 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 435911 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 435911 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 435912 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 435912 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 435913 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 435913 T1997 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/
[junit4] 2> 435913 T1997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/
[junit4] 2> 435914 T1997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cf4c8f8
[junit4] 2> 435914 T1997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index/
[junit4] 2> 435915 T1997 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 435918 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 435918 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 435919 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 435919 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 435919 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 435920 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 435920 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 435921 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 435921 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 435921 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 435922 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 435922 T1997 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 435923 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 435923 T1997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 435924 T1997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 435924 T1997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 435925 T1997 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 435925 T1997 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 435925 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 435926 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 435926 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 435927 T1997 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 435927 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 435928 T1997 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 435928 T1997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 435929 T1997 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435929 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435930 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435930 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435931 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435931 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435932 T1997 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435932 T1997 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 435933 T1997 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 435933 T1997 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 435934 T1997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 435936 T1997 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 435937 T1997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 435938 T1997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 435938 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@c4f715f1[collection1] main
[junit4] 2> 435939 T1997 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 435939 T1997 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 435940 T1997 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 435940 T1997 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 435940 T1997 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 435941 T1997 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 435942 T1997 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 435949 T2002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c4f715f1[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 435954 T1997 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 435954 T1997 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 435955 T1997 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4] 2> 435955 T1997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=73.53515625, floorSegmentMB=0.73828125, forceMergeDeletesPctAllowed=27.049600689280624, segmentsPerTier=22.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.525677588553502
[junit4] 2> 435956 T1997 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_1,generation=1}
[junit4] 2> 435956 T1997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 435957 T1997 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 435957 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@7326c37c[collection1] main
[junit4] 2> 435958 T1997 oasc.CoreContainer.registerCore replacing core: collection1
[junit4] 2> 435958 T1997 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@a8d5c035
[junit4] 2> 435959 T2002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7326c37c[collection1] main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 435964 T1997 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=1,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 435965 T1997 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 436816 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[529 (1467686022647119872)]} 0 848
[junit4] 2> 437817 T2003 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 437819 T2003 oass.SolrIndexSearcher.<init> Opening Searcher@40cc915d[collection1] main
[junit4] 2> 437820 T2003 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 437821 T2002 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40cc915d[collection1] main{StandardDirectoryReader(segments_1:3:nrt _0(5.0):C1)}
[junit4] 2> ASYNC NEW_CORE C1729 name=collection1 org.apache.solr.core.SolrCore@86eb4051
[junit4] 2> 438222 T1997 C1729 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:529&version=2.2&rows=20} hits=1 status=0 QTime=1405
[junit4] 2> 438343 T1997 oas.SolrTestCaseJ4.assertQ ERROR REQUEST FAILED: xpath=//result[@numFound=0]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">1405</int></lst><result name="response" numFound="1" start="0"><doc><int name="id">529</int><arr name="range_facet_l"><long>529</long></arr><arr name="field_t"><str>what's inside?</str></arr><arr name="subject"><str>info</str></arr><long name="_version_">1467686022647119872</long><date name="timestamp">2014-05-10T04:01:04.347Z</date><int name="intDefault">42</int><arr name="multiDefault"><str>muLti-Default</str></arr></doc></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:start=0&qt=standard&q=id:529&version=2.2&rows=20
[junit4] 2> 438344 T1997 oasc.SolrException.log ERROR REQUEST FAILED: start=0&qt=standard&q=id:529&version=2.2&rows=20:java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=0]
[junit4] 2> xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] 2> <response>
[junit4] 2> <lst name="responseHeader"><int name="status">0</int><int name="QTime">1405</int></lst><result name="response" numFound="1" start="0"><doc><int name="id">529</int><arr name="range_facet_l"><long>529</long></arr><arr name="field_t"><str>what's inside?</str></arr><arr name="subject"><str>info</str></arr><long name="_version_">1467686022647119872</long><date name="timestamp">2014-05-10T04:01:04.347Z</date><int name="intDefault">42</int><arr name="multiDefault"><str>muLti-Default</str></arr></doc></result>
[junit4] 2> </response>
[junit4] 2>
[junit4] 2> request was:start=0&qt=standard&q=id:529&version=2.2&rows=20
[junit4] 2> at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:712)
[junit4] 2> at org.apache.solr.update.AutoCommitTest.testMaxTime(AutoCommitTest.java:227)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit4] 2> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:94)
[junit4] 2> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
[junit4] 2> at java.lang.reflect.Method.invoke(Method.java:619)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
[junit4] 2> at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:793)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:453)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
[junit4] 2> at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
[junit4] 2> at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
[junit4] 2> at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
[junit4] 2> at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
[junit4] 2> at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
[junit4] 2> at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
[junit4] 2> at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:360)
[junit4] 2> at java.lang.Thread.run(Thread.java:853)
[junit4] 2>
[junit4] 2> 438345 T1997 oas.SolrTestCaseJ4.tearDown ###Ending testMaxTime
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=AutoCommitTest -Dtests.method=testMaxTime -Dtests.seed=7BA000229CBF6C28 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de_CH -Dtests.timezone=Antarctica/Rothera -Dtests.file.encoding=UTF-8
[junit4] ERROR 2.95s J0 | AutoCommitTest.testMaxTime <<<
[junit4] > Throwable #1: java.lang.RuntimeException: Exception during query
[junit4] > at __randomizedtesting.SeedInfo.seed([7BA000229CBF6C28:E1547DC00225F014]:0)
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:719)
[junit4] > at org.apache.solr.update.AutoCommitTest.testMaxTime(AutoCommitTest.java:227)
[junit4] > at java.lang.Thread.run(Thread.java:853)
[junit4] > Caused by: java.lang.RuntimeException: REQUEST FAILED: xpath=//result[@numFound=0]
[junit4] > xml response was: <?xml version="1.0" encoding="UTF-8"?>
[junit4] > <response>
[junit4] > <lst name="responseHeader"><int name="status">0</int><int name="QTime">1405</int></lst><result name="response" numFound="1" start="0"><doc><int name="id">529</int><arr name="range_facet_l"><long>529</long></arr><arr name="field_t"><str>what's inside?</str></arr><arr name="subject"><str>info</str></arr><long name="_version_">1467686022647119872</long><date name="timestamp">2014-05-10T04:01:04.347Z</date><int name="intDefault">42</int><arr name="multiDefault"><str>muLti-Default</str></arr></doc></result>
[junit4] > </response>
[junit4] > request was:start=0&qt=standard&q=id:529&version=2.2&rows=20
[junit4] > at org.apache.solr.SolrTestCaseJ4.assertQ(SolrTestCaseJ4.java:712)
[junit4] > ... 42 more
[junit4] 2> 438352 T1997 oas.SolrTestCaseJ4.setUp ###Starting testMaxDocs
[junit4] 2> 438353 T1997 C1729 oass.SolrIndexSearcher.<init> Opening Searcher@7859fcde[collection1] realtime
[junit4] 2> 438354 T1997 C1729 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1467686024258781184)} 0 2
[junit4] 2> 438842 T1997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 438843 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 438843 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 438844 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 438883 T1997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 438944 T1997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 438944 T1997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 438950 T1997 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 439227 T1997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 439231 T1997 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 439234 T1997 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 439238 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 439241 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 439245 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 439245 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 439246 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 439247 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 439247 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 439248 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 439248 T1997 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/
[junit4] 2> 439249 T1997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/
[junit4] 2> 439249 T1997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cf4c8f8
[junit4] 2> 439250 T1997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index/
[junit4] 2> 439250 T1997 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 439253 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 439253 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 439253 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 439254 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 439254 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 439254 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 439255 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 439255 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 439256 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 439256 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 439257 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 439257 T1997 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 439257 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 439258 T1997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 439258 T1997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 439259 T1997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 439259 T1997 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 439260 T1997 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 439260 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 439261 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 439261 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 439262 T1997 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 439262 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 439262 T1997 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 439263 T1997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 439263 T1997 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439264 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439264 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439265 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439265 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439266 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439266 T1997 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439267 T1997 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 439267 T1997 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 439268 T1997 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 439269 T1997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 439271 T1997 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 439272 T1997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 439273 T1997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 439274 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@3e0a2a4a[collection1] main
[junit4] 2> 439274 T1997 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 439275 T1997 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 439275 T1997 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 439275 T1997 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 439276 T1997 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 439276 T1997 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 439277 T1997 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 439283 T2004 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3e0a2a4a[collection1] main{StandardDirectoryReader(segments_1:5:nrt)}
[junit4] 2> 439288 T1997 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 439288 T1997 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 439289 T1997 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4] 2> 439289 T1997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_1,generation=1}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_2,generation=2}
[junit4] 2> 439290 T1997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 439290 T1997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=15, maxMergedSegmentMB=5.2802734375, floorSegmentMB=1.6484375, forceMergeDeletesPctAllowed=22.97666603925803, segmentsPerTier=49.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 439292 T1997 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_2,generation=2}
[junit4] 2> 439292 T1997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4] 2> 439293 T1997 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 439293 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@1ec0f43d[collection1] main
[junit4] 2> 439294 T1997 oasc.CoreContainer.registerCore replacing core: collection1
[junit4] 2> 439294 T1997 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@86eb4051
[junit4] 2> 439295 T2004 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1ec0f43d[collection1] main{StandardDirectoryReader(segments_2:5:nrt)}
[junit4] 2> 439301 T1997 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommit maxTime=1000ms,soft autocommits=1,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=1,adds=0,deletesById=0,deletesByQuery=1,errors=0,cumulative_adds=1,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 439302 T1997 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 439339 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[0 (1467686025292677120)]} 0 35
[junit4] 2> 439339 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[1 (1467686025293725696)]} 0 35
[junit4] 2> 439340 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[2 (1467686025294774272)]} 0 35
[junit4] 2> 439341 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[3 (1467686025295822848)]} 0 35
[junit4] 2> 439342 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[4 (1467686025295822849)]} 0 35
[junit4] 2> 439342 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[5 (1467686025296871424)]} 0 35
[junit4] 2> 439343 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[6 (1467686025297920000)]} 0 35
[junit4] 2> 439344 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[7 (1467686025298968576)]} 0 35
[junit4] 2> 439345 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[8 (1467686025298968577)]} 0 35
[junit4] 2> 439345 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[9 (1467686025300017152)]} 0 35
[junit4] 2> 439346 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[10 (1467686025301065728)]} 0 35
[junit4] 2> 439347 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[11 (1467686025302114304)]} 0 35
[junit4] 2> 439348 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[12 (1467686025302114305)]} 0 35
[junit4] 2> 439348 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[13 (1467686025303162880)]} 0 35
[junit4] 2> ASYNC NEW_CORE C1730 name=collection1 org.apache.solr.core.SolrCore@d68ccd42
[junit4] 2> 439349 T1997 C1730 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:1&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 439362 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[14 (1467686025316794368)]} 0 35
[junit4] 2> 439363 T2005 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 439364 T2005 oass.SolrIndexSearcher.<init> Opening Searcher@9a309b5c[collection1] main
[junit4] 2> 439365 T2005 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 439366 T2004 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9a309b5c[collection1] main{StandardDirectoryReader(segments_2:7:nrt _1(5.0):C15)}
[junit4] 2> 439613 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[15 (1467686025581035520)]} 0 35
[junit4] 2> 439614 T1997 C1730 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:14&version=2.2&rows=20} hits=1 status=0 QTime=0
[junit4] 2> 439616 T1997 C1730 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:15&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 439617 T1997 oas.SolrTestCaseJ4.tearDown ###Ending testMaxDocs
[junit4] 2> 439622 T1997 oas.SolrTestCaseJ4.setUp ###Starting testCommitWithin
[junit4] 2> 439624 T1997 C1730 oass.SolrIndexSearcher.<init> Opening Searcher@dcb4e63f[collection1] realtime
[junit4] 2> 439625 T1997 C1730 oasup.LogUpdateProcessor.finish [collection1] webapp=null path=null params={} {deleteByQuery=*:* (-1467686025590472704)} 0 3
[junit4] 2> 439627 T1997 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/'
[junit4] 2> 439628 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/.svn/' to classloader
[junit4] 2> 439629 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/classes/' to classloader
[junit4] 2> 439629 T1997 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/lib/README' to classloader
[junit4] 2> 439677 T1997 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_5_0
[junit4] 2> 439733 T1997 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 439733 T1997 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 439738 T1997 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 440002 T1997 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 440007 T1997 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 440009 T1997 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 440015 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 440018 T1997 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 440021 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 440022 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 440022 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 440023 T1997 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 440023 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 440023 T1997 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 440024 T1997 oasc.CoreContainer.reload Reloading SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/
[junit4] 2> 440024 T1997 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/core/src/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/
[junit4] 2> 440025 T1997 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3cf4c8f8
[junit4] 2> 440025 T1997 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index/
[junit4] 2> 440026 T1997 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4] 2> 440028 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 440029 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 440029 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 440029 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4] 2> 440030 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 440030 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 440031 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "uniq-fields"
[junit4] 2> 440031 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4] 2> 440031 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 440032 T1997 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 440032 T1997 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 440033 T1997 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 440033 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 440033 T1997 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 440034 T1997 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 440034 T1997 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 440035 T1997 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4] 2> 440035 T1997 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4] 2> 440036 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 440036 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 440037 T1997 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 440037 T1997 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4] 2> 440037 T1997 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4] 2> 440038 T1997 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4] 2> 440038 T1997 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 440039 T1997 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440039 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440040 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440040 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440041 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440041 T1997 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440042 T1997 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440042 T1997 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4] 2> 440043 T1997 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4] 2> 440043 T1997 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4] 2> 440044 T1997 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 440046 T1997 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4] 2> 440047 T1997 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 440048 T1997 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 440048 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@c4aa4b6a[collection1] main
[junit4] 2> 440049 T1997 oasr.RestManager.init Initializing RestManager with initArgs: {storageIO=org.apache.solr.rest.ManagedResourceStorage$InMemoryStorageIO}
[junit4] 2> 440049 T1997 oasr.ManagedResourceStorage.load Reading _rest_managed.json using InMemoryStorage
[junit4] 2> 440050 T1997 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
[junit4] 2> 440050 T1997 oasr.ManagedResource.notifyObserversDuringInit WARN No registered observers for /rest/managed
[junit4] 2> 440050 T1997 oasr.RestManager.init Initializing 0 registered ManagedResources
[junit4] 2> 440051 T1997 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4] 2> 440052 T1997 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 440060 T2006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c4aa4b6a[collection1] main{StandardDirectoryReader(segments_2:11:nrt)}
[junit4] 2> 440063 T1997 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4] 2> 440063 T1997 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4] 2> 440064 T1997 oasu.DefaultSolrCoreState.newIndexWriter Closing old IndexWriter... core=collection1
[junit4] 2> 440064 T1997 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_2,generation=2}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_3,generation=3}
[junit4] 2> 440065 T1997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 440065 T1997 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1148286869, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 440066 T1997 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_3,generation=3}
[junit4] 2> 440066 T1997 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4] 2> 440067 T1997 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4] 2> 440067 T1997 oass.SolrIndexSearcher.<init> Opening Searcher@af1e147c[collection1] main
[junit4] 2> 440068 T1997 oasc.CoreContainer.registerCore replacing core: collection1
[junit4] 2> 440068 T1997 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@d68ccd42
[junit4] 2> 440069 T2006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@af1e147c[collection1] main{StandardDirectoryReader(segments_3:11:nrt)}
[junit4] 2> 440075 T1997 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommit maxDocs=14,soft autocommits=1,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=16,adds=1,deletesById=0,deletesByQuery=1,errors=0,cumulative_adds=16,cumulative_deletesById=0,cumulative_deletesByQuery=1,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 440077 T1997 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 440104 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[529 (1467686026094837760)]} 0 26
[junit4] 2> ASYNC NEW_CORE C1731 name=collection1 org.apache.solr.core.SolrCore@1573ff69
[junit4] 2> 440105 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:529&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 444104 T2007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 444106 T2007 oass.SolrIndexSearcher.<init> Opening Searcher@5e3b1392[collection1] main
[junit4] 2> 444106 T2007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 444108 T2006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5e3b1392[collection1] main{StandardDirectoryReader(segments_3:13:nrt _3(5.0):C1)}
[junit4] 2> 444109 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[530 (1467686030294384640)]} 0 26
[junit4] 2> 444110 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:530&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 444111 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[529 (-1467686030297530368)]} 0 26
[junit4] 2> 444112 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:529&version=2.2&rows=20} hits=1 status=0 QTime=0
[junit4] 2> 445111 T2007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 445113 T2007 oass.SolrIndexSearcher.<init> Opening Searcher@da9e5a3a[collection1] main
[junit4] 2> 445113 T2007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 445115 T2006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@da9e5a3a[collection1] main{StandardDirectoryReader(segments_3:17:nrt _4(5.0):C1)}
[junit4] 2> 445363 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:529&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 445365 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:530&version=2.2&rows=20} hits=1 status=0 QTime=0
[junit4] 2> 445368 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031614541824)]} 0 26
[junit4] 2> 445368 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031615590400)]} 0 26
[junit4] 2> 445369 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031616638976)]} 0 26
[junit4] 2> 445370 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031616638977)]} 0 26
[junit4] 2> 445370 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031617687552)]} 0 26
[junit4] 2> 445371 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031618736128)]} 0 26
[junit4] 2> 445371 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031618736129)]} 0 26
[junit4] 2> 445372 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031619784704)]} 0 26
[junit4] 2> 445373 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031619784705)]} 0 26
[junit4] 2> 445373 T1997 oasup.LogUpdateProcessor.finish [collection1] {add=[500 (1467686031620833280)]} 0 26
[junit4] 2> 445374 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:500&version=2.2&rows=20} hits=0 status=0 QTime=0
[junit4] 2> 445376 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031623979008)]} 0 26
[junit4] 2> 445377 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031623979009)]} 0 26
[junit4] 2> 445377 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031625027584)]} 0 26
[junit4] 2> 445378 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031626076160)]} 0 26
[junit4] 2> 445379 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031627124736)]} 0 26
[junit4] 2> 445379 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031627124737)]} 0 26
[junit4] 2> 445380 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031628173312)]} 0 26
[junit4] 2> 445381 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031628173313)]} 0 26
[junit4] 2> 445381 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031629221888)]} 0 26
[junit4] 2> 445382 T1997 oasup.LogUpdateProcessor.finish [collection1] {delete=[530 (-1467686031630270464)]} 0 26
[junit4] 2> 445383 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:530&version=2.2&rows=20} hits=1 status=0 QTime=1
[junit4] 2> 446376 T2007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
[junit4] 2> 446378 T2007 oass.SolrIndexSearcher.<init> Opening Searcher@ae421594[collection1] main
[junit4] 2> 446379 T2007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4] 2> 446380 T2006 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@ae421594[collection1] main{StandardDirectoryReader(segments_3:21:nrt _5(5.0):C10/9:delGen=1)}
[junit4] 2> 446385 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:500&version=2.2&rows=20} hits=1 status=0 QTime=0
[junit4] 2> 446387 T1997 C1731 oasc.SolrCore.execute [collection1] webapp=null path=null params={start=0&qt=standard&q=id:530&version=2.2&rows=20} hits=0 status=0 QTime=1
[junit4] 2> 446388 T1997 oas.SolrTestCaseJ4.tearDown ###Ending testCommitWithin
[junit4] 2> 446389 T1997 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> 446390 T1997 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=593457264
[junit4] 2> 446390 T1997 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@1573ff69
[junit4] 2> 446402 T1997 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=3,autocommits=0,soft autocommits=3,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=12,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=12,cumulative_deletesById=11,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 446403 T1997 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 446403 T1997 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 446404 T1997 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 446404 T1997 C1731 oasu.DirectUpdateHandler2.closeWriter Committing on IndexWriter close.
[junit4] 2> 446405 T1997 C1731 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_3,generation=3}
[junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirectoryWrapper(RAMDirectory@1e83ae17 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5f4b4297)),segFN=segments_4,generation=4}
[junit4] 2> 446406 T1997 C1731 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
[junit4] 2> 446407 T1997 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4] 2> 446408 T1997 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 446408 T1997 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001;done=false>>]
[junit4] 2> 446409 T1997 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001
[junit4] 2> 446410 T1997 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index;done=false>>]
[junit4] 2> 446410 T1997 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001/init-core-data-001/index
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J0/./solr.update.AutoCommitTest-7BA000229CBF6C28-001
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=de_CH, timezone=Antarctica/Rothera
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/IBM Corporation 1.7.0 (64-bit)/cpus=8,threads=1,free=65805984,total=159776768
[junit4] 2> NOTE: All tests run in this JVM: [TestDefaultSimilarityFactory, ZkControllerTest, TestNRTOpen, SynonymTokenizerTest, TestShortCircuitedRequests, BinaryUpdateRequestHandlerTest, EchoParamsTest, TestValueSourceCache, ShardSplitTest, BadComponentTest, TestOverriddenPrefixQueryForCustomFieldType, RecoveryZkTest, TestFunctionQuery, CustomCollectionTest, TestAddFieldRealTimeGet, TestBM25SimilarityFactory, TestFastLRUCache, RAMDirectoryFactoryTest, TestConfigSets, HdfsCollectionsAPIDistributedZkTest, SoftAutoCommitTest, TestJoin, AliasIntegrationTest, TestSchemaVersionResource, TestFileDictionaryLookup, HdfsWriteToMultipleCollectionsTest, SolrTestCaseJ4Test, AnalysisErrorHandlingTest, OverseerStatusTest, DistributedQueryElevationComponentTest, TestConfig, TestPostingsSolrHighlighter, TestRealTimeGet, TestSuggestSpellingConverter, TriLevelCompositeIdRoutingTest, LoggingHandlerTest, TestSolrXmlPersistence, TestJmxMonitoredMap, TestLMJelinekMercerSimilarityFactory, CopyFieldTest, QueryEqualityTest, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, ResponseLogComponentTest, TestTrie, TestFieldSortValues, TestInitQParser, TestManagedSynonymFilterFactory, DocExpirationUpdateProcessorFactoryTest, SyncSliceTest, BasicDistribute
[...truncated too long message...]
pdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
[junit4] 2> 600921 T3257 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4] 2> 600921 T3257 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4] 2> 600922 T3257 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4] 2> 600922 T3257 oasc.SolrCore.closeSearcher [core1] Closing main searcher on request.
[junit4] 2> 600923 T3257 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4] 2> 600923 T3257 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data;done=false>>]
[junit4] 2> 600924 T3257 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data
[junit4] 2> 600924 T3257 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data/index;done=false>>]
[junit4] 2> 600924 T3257 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001/tempDir-002/core1/data/index
[junit4] 2> 600925 T3257 oas.SolrTestCaseJ4.tearDown ###Ending testConfigWrite
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ModifyConfFileTest -Dtests.method=testConfigWrite -Dtests.seed=7BA000229CBF6C28 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh -Dtests.timezone=Atlantic/Cape_Verde -Dtests.file.encoding=UTF-8
[junit4] FAILURE 0.56s J1 | ModifyConfFileTest.testConfigWrite <<<
[junit4] > Throwable #1: java.lang.AssertionError: should have detected an error early!
[junit4] > Expected: a string containing "\"</dataDir>\""
[junit4] > got: "Invalid solr config file: org.xml.sax.SAXParseException: 元素类型“dataDir”必须用匹配的结束标记“</dataDir>”终止。"
[junit4] > at __randomizedtesting.SeedInfo.seed([7BA000229CBF6C28:CD9B2D2AA0B61CED]:0)
[junit4] > at org.apache.solr.schema.ModifyConfFileTest.testConfigWrite(ModifyConfFileTest.java:100)
[junit4] > at java.lang.Thread.run(Thread.java:853)
[junit4] 2> 600934 T3257 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build/solr-core/test/J1/./solr.schema.ModifyConfFileTest-7BA000229CBF6C28-001
[junit4] 2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=301), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=301)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=zh, timezone=Atlantic/Cape_Verde
[junit4] 2> NOTE: Linux 3.8.0-39-generic amd64/IBM Corporation 1.7.0 (64-bit)/cpus=8,threads=1,free=24234216,total=180486144
[junit4] 2> NOTE: All tests run in this JVM: [TestStressRecovery, TestSolrCoreProperties, TestSerializedLuceneMatchVersion, OpenCloseCoreStressTest, StandardRequestHandlerTest, DisMaxRequestHandlerTest, TestAnalyzedSuggestions, FieldFacetTest, AddBlockUpdateTest, BadIndexSchemaTest, TestFieldCollectionResource, SimplePostToolTest, HdfsChaosMonkeySafeLeaderTest, IndexSchemaRuntimeFieldTest, DirectSolrSpellCheckerTest, TestNonDefinedSimilarityFactory, TestCloudManagedSchema, ResourceLoaderTest, TestDocumentBuilder, LeaderElectionIntegrationTest, TestSchemaSimilarityResource, TestHighFrequencyDictionaryFactory, TestDistributedMissingSort, TestSchemaNameResource, TestLMDirichletSimilarityFactory, TestUniqueKeyFieldResource, AddSchemaFieldsUpdateProcessorFactoryTest, TestCloudManagedSchemaAddField, TestRangeQuery, ZkSolrClientTest, TestRequestStatusCollectionAPI, CollectionsAPIAsyncDistributedZkTest, DistanceFunctionTest, TestSchemaResource, DocumentAnalysisRequestHandlerTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, AbstractAnalyticsStatsTest, TestIBSimilarityFactory, TestCoreDiscovery, TestBinaryResponseWriter, TestCSVLoader, ChaosMonkeySafeLeaderTest, DistributedQueryComponentOptimizationTest, DateMathParserTest, CursorPagingTest, RangeFacetTest, SolrCoreCheckLockOnStartupTest, DocValuesMultiTest, SolrRequestParserTest, EnumFieldTest, TestDFRSimilarityFactory, JSONWriterTest, TestCollectionAPI, MinimalSchemaTest, TestRandomMergePolicy, TestQueryTypes, TestRTGBase, TestDistributedSearch, TestExceedMaxTermLength, DistributedExpandComponentTest, TestStressLucene, TestManagedResourceStorage, TestStressReorder, StressHdfsTest, PingRequestHandlerTest, CoreContainerCoreInitFailuresTest, XsltUpdateRequestHandlerTest, TestLazyCores, HighlighterConfigTest, BJQParserTest, TestComponentsName, DirectUpdateHandlerTest, DirectSolrConnectionTest, TestSolrQueryParserDefaultOperatorResource, TestInfoStreamLogging, SuggesterTSTTest, TestFiltering, DeleteShardTest, DefaultValueUpdateProcessorTest, DistributedSuggestComponentTest, HdfsDirectoryTest, CoreAdminCreateDiscoverTest, TestSolrQueryParserResource, SolrPluginUtilsTest, SSLMigrationTest, SpellCheckCollatorTest, SolrXmlInZkTest, TestComplexPhraseQParserPlugin, DateFieldTest, TestFoldingMultitermQuery, HighlighterTest, PathHierarchyTokenizerFactoryTest, TestZkChroot, FileUtilsTest, MigrateRouteKeyTest, TestWordDelimiterFilterFactory, TestFastWriter, InfoHandlerTest, TestFreeTextSuggestions, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OverseerTest, BasicZkTest, TestRandomFaceting, TestHashPartitioner, TestReload, SimpleFacetsTest, TestSolr4Spatial, TestGroupingSearch, TestIndexSearcher, ShowFileRequestHandlerTest, CurrencyFieldXmlFileTest, AnalysisAfterCoreReloadTest, DocValuesTest, SuggesterTest, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, TestUpdate, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, SolrInfoMBeanTest, DebugComponentTest, TestSurroundQueryParser, LukeRequestHandlerTest, TestOmitPositions, RequestHandlersTest, TermVectorComponentTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, FastVectorHighlighterTest, TestJmxIntegration, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, JsonLoaderTest, CSVRequestHandlerTest, TestLFUCache, UpdateParamsTest, TestSolrIndexConfig, SolrIndexConfigTest, MultiTermTest, SampleTest, TestBinaryField, NumericFieldsTest, OutputWriterTest, ExternalFileFieldSortTest, NotRequiredUniqueKeyTest, TestPhraseSuggestions, TestCodecSupport, TestSweetSpotSimilarityFactory, TimeZoneUtilsTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, PrimUtilsTest, DOMUtilTest, ClusterStateTest, TestUtils, TestCursorMarkWithoutUniqueKey, FieldFacetExtrasTest, AssignTest, AsyncMigrateRouteKeyTest, ConnectionManagerTest, TestModifyConfFiles, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, HdfsUnloadDistributedZkTest, QueryResultKeyTest, TestNonNRTOpen, TestReloadAndDeleteDocs, TestShardHandlerFactory, TestSolrXml, TestSolrXmlPersistor, CoreAdminRequestStatusTest, DistributedDebugComponentTest, DistributedQueryComponentCustomSortTest, SuggestComponentTest, TestClassNameShortening, TestCopyFieldCollectionResource, TestDynamicFieldCollectionResource, TestFieldResource, TestManagedStopFilterFactory, BadCopyFieldTest, ChangedSchemaMergeTest, DocValuesMissingTest, ModifyConfFileTest]
[junit4] Completed on J1 in 0.58s, 1 test, 1 failure <<< FAILURES!
[...truncated 59 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:460: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/build.xml:45: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/extra-targets.xml:37: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:1296: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux@2/lucene/common-build.xml:920: There were test failures: 400 suites, 1679 tests, 1 error, 1 failure, 91 ignored (16 assumptions)
Total time: 44 minutes 11 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure