You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2013/06/05 06:42:06 UTC
[JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build #
5989 - Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5989/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
4 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
Error Message:
Suite timeout exceeded (>= 7200000 msec).
Stack Trace:
java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990]:0)
REGRESSION: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:43980/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:43980/onenodecollectioncore returned non ok status:404, message:Can not find: /onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990:76AAF11C12B909AC]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
Test abandoned because suite timeout was reached.
Stack Trace:
java.lang.Exception: Test abandoned because suite timeout was reached.
at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990]:0)
REGRESSION: org.apache.solr.core.TestJmxIntegration.testJmxRegistration
Error Message:
No SolrDynamicMBeans found
Stack Trace:
java.lang.AssertionError: No SolrDynamicMBeans found
at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990:799D1B3E08A731F5]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.core.TestJmxIntegration.testJmxRegistration(TestJmxIntegration.java:94)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
Build Log:
[...truncated 9185 lines...]
[junit4:junit4] Suite: org.apache.solr.core.TestJmxIntegration
[junit4:junit4] 2> 13654 T34 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248
[junit4:junit4] 2> 13655 T34 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4] 2> 13670 T34 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4] 2> 13672 T34 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 13811 T34 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 13908 T34 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 13909 T34 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 14013 T34 oass.IndexSchema.readSchema [null] Schema name=test
[junit4:junit4] 2> 14889 T34 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 14904 T34 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 14908 T34 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 14932 T34 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14939 T34 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 14945 T34 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14946 T34 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14947 T34 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 14972 T34 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 14973 T34 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 14974 T34 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 14975 T34 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 14976 T34 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr
[junit4:junit4] 2> 14976 T34 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/'
[junit4:junit4] 2> 14991 T34 oasc.CoreContainer.<init> New CoreContainer 200708685
[junit4:junit4] 2> 15094 T34 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15095 T34 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/
[junit4:junit4] 2> 15095 T34 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
[junit4:junit4] 2> 15096 T34 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 15097 T34 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248
[junit4:junit4] 2> 15098 T34 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index/
[junit4:junit4] 2> 15099 T34 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 15116 T34 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index
[junit4:junit4] 2> 15119 T34 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@4a968fa7 lockFactory=org.apache.lucene.store.NativeFSLockFactory@eefec3c0)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 15120 T34 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 15121 T34 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 15123 T34 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 15123 T34 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 15124 T34 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 15125 T34 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 15126 T34 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 15127 T34 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 15128 T34 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 15129 T34 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 15130 T34 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 15130 T34 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 15136 T34 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 15137 T34 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 15138 T34 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 15139 T34 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 15139 T34 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 15140 T34 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 15141 T34 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15142 T34 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15142 T34 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15143 T34 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15144 T34 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15145 T34 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15146 T34 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15146 T34 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 15147 T34 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 15148 T34 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 15151 T34 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 15174 T34 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 15177 T34 oasc.SolrCore.initDeprecatedSupport WARN adding ShowFileRequestHandler with hidden files: [SOLRCONFIG-MANAGED-SCHEMA.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SOLRCONFIG-MANAGED-SCHEMA-NAMED-SCHEMA.XML.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NONTEXT-ANALYZER.XML, SCHEMA-BEHAVIOR.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, STOP-2.TXT, SCHEMA11.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, SCHEMA15.XML, BAD-SOLRCONFIG-UNEXPECTED-SCHEMA-ATTRIBUTE.XML, SOLRCONFIG-NATIVELOCK.XML, SCHEMA-SIM.XML, CONDITIONAL.UPDATEPROCESSOR.JS, SCHEMA-DOCVALUES.XML, SCHEMA-ID-AND-VERSION-FIELDS-ONLY.XML, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SOLRCONFIG-REPEATER.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-CHARFILTERS.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, SCHEMA-EFF.XML, SOLRCONFIG_CODEC.XML, SOLRCONFIG-MUTABLE-MANAGED-SCHEMA.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML, HYPHENATION.DTD, TRIVIAL.UPDATEPROCESSOR1.JS, SOLRCONFIG-MERGEPOLICY.XML, SOLRCONFIG-PHRASESUGGEST.XML, SOLRCONFIG-SLAVE1.XML, SOLRCONFIG-BASIC.XML, SCHEMA-LMJELINEKMERCER.XML, BAD-MP-SOLRCONFIG.XML, JASUGGEST.TXT, BAD-SCHEMA-DUP-FIELD.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-TFIDF.XML, SCHEMA-REPLICATION1.XML, STOPWITHBOM.TXT, SOLRCONFIG-ELEVATE.XML, SYNONYMS.TXT, SOLRCONFIG-QUERYSENDER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, WDFTYPES.TXT, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SOLRCONFIG-DELPOLICY1.XML, BAD_SOLRCONFIG.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, HUNSPELL-TEST.DIC, SCHEMA-NUMERIC.XML, SCHEMA-LUCENEMATCHVERSION.XML, KEEP-2.TXT, SCHEMA-STOP-KEEP.XML, SCHEMA-IB.XML, STOP-SNOWBALL.TXT, SCHEMA-ONE-FIELD-NO-DYNAMIC-FIELD.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, SCHEMA-DOCVALUESMULTI.XML, SOLRCONFIG-INDEXCONFIG.XML, SOLRCONFIG-SLAVE.XML, SCHEMA-CLASS-NAME-SHORTENING-ON-SERIALIZATION.XML, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, STOPWORDSWRONGENCODING.TXT, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, STOPTYPES-1.TXT, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESFACETING.XML, SOLRCONFIG-TLOG.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, DA_COMPOUNDDICTIONARY.TXT, SOLRCONFIG-TERMINDEX.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, BAD-SCHEMA-NON-GLOB-COPYFIELD-SOURCE-MATCHING-NOTHING-SHOULD-FAIL-TEST.XML, SCHEMASURROUND.XML, OPEN-EXCHANGE-RATES.JSON, BAD-SCHEMA-DUP-FIELDTYPE.XML, PHRASESUGGEST.TXT, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, SOLRCONFIG-MASTER2.XML, OLD_SYNONYMS.TXT, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SCHEMA-LMDIRICHLET.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, SCHEMA-REVERSED.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, SCHEMA-FOLDING.XML, SOLRCONFIG-CACHING.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD-CURRENCY.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SCHEMA-BM25.XML, SOLRCONFIG-ENABLEPLUGIN.XML, STOP-1.TXT, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, SCHEMA-REST.XML, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, SCHEMA12.XML, SOLRCONFIG-TRANSFORMERS.XML, SCHEMA-COPYFIELD-TEST.XML, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, CURRENCY.XML, DA_UTF8.XML, FUZZYSUGGEST.TXT, SCHEMA-POSTINGSHIGHLIGHT.XML, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SOLRCONFIG-SOLR-749.XML, STOPWORDS.TXT, BAD-SCHEMA-BOGUS-ANALYSIS-PARAMETERS.XML, HUNSPELL-TEST.AFF, SOLRCONFIG-TLOG-MANAGED-SCHEMA.XML, SOLRCONFIG_PERF.XML, SCHEMA-SWEETSPOT.XML, SOLRCONFIG-SIMPLELOCK.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, SCHEMA-TINY.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, FRENCHARTICLES.TXT, SOLRCONFIG-LAZYWRITER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, SCHEMA-REPLICATION2.XML, SCHEMA-SNIPPET-TYPE.XML, SCHEMA-SPATIAL.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-XINCLUDE.XML, XSLT, SOLRCONFIG-WARMER.XML, SOLRCONFIG-DELPOLICY2.XML, KEEP-1.TXT, TRIVIAL.UPDATEPROCESSOR0.JS, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA-TRIE.XML, SOLRCONFIG-TLOG-MUTABLE-MANAGED-SCHEMA.XML, SCHEMA-BINARYFIELD.XML, SCHEMA-REST-LUCENE-MATCH-VERSION.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, SCHEMA-MINIMAL.XML, STOPTYPES-2.TXT, SCHEMA_CODEC.XML, STEMDICT.TXT, SCHEMA-SYNONYM-TOKENIZER.XML, ELEVATE.XML, SCHEMA-COLLATE.XML, PROTWORDS.TXT, SCHEMA-XINCLUDE.XML, SCHEMA-SNIPPET-FIELD.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMA-PHRASESUGGEST.XML, SCHEMA-DFR.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SOLRCONFIG-MASTER1.XML, SOLRCONFIG-FUNCTIONQUERY.XML, BAD-SOLRCONFIG-SCHEMA-MUTABLE-BUT-NOT-MANAGED.XML, SOLRCONFIG-MASTER3.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, SOLRCONFIG-ALTDIRECTORY.XML, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-SCHEMA-BOGUS-FIELD-PARAMETERS.XML]
[junit4:junit4] 2> 15196 T34 oass.SolrIndexSearcher.<init> Opening Searcher@123e787 main
[junit4:junit4] 2> 15197 T34 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/tlog
[junit4:junit4] 2> 15199 T34 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 15199 T34 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 15200 T34 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 15218 T34 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 15289 T35 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@123e787 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 15289 T34 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 15295 T34 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4] 2> 15446 T34 oas.SolrTestCaseJ4.setUp ###Starting testJmxUpdate
[junit4:junit4] 2> 15451 T34 oas.SolrTestCaseJ4.tearDown ###Ending testJmxUpdate
[junit4:junit4] IGNOR/A 0.52s J1 | TestJmxIntegration.testJmxUpdate
[junit4:junit4] > Assumption #1: got: <false>, expected: is <true>
[junit4:junit4] 2> 15824 T34 oas.SolrTestCaseJ4.setUp ###Starting testJmxRegistration
[junit4:junit4] 2> 15825 T34 oasc.TestJmxIntegration.testJmxRegistration Servers in testJmxRegistration: [com.sun.jmx.mbeanserver.JmxMBeanServer@b8e0be5b]
[junit4:junit4] 2> 15830 T34 oas.SolrTestCaseJ4.tearDown ###Ending testJmxRegistration
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestJmxIntegration -Dtests.method=testJmxRegistration -Dtests.seed=F74C7F0465E66990 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=gu -Dtests.timezone=America/Argentina/Salta -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] FAILURE 0.02s J1 | TestJmxIntegration.testJmxRegistration <<<
[junit4:junit4] > Throwable #1: java.lang.AssertionError: No SolrDynamicMBeans found
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990:799D1B3E08A731F5]:0)
[junit4:junit4] > at org.apache.solr.core.TestJmxIntegration.testJmxRegistration(TestJmxIntegration.java:94)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 15843 T34 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 15844 T34 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=200708685
[junit4:junit4] 2> 15845 T34 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@e67dc07c
[junit4:junit4] 2> 15845 T34 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 15846 T34 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 15847 T34 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 15847 T34 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 15850 T34 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 15851 T34 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 15852 T34 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index;done=false>>]
[junit4:junit4] 2> 15852 T34 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248/index
[junit4:junit4] 2> 15853 T34 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248;done=false>>]
[junit4:junit4] 2> 15854 T34 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/./solrtest-TestJmxIntegration-1370399895248
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=gu, timezone=America/Argentina/Salta
[junit4:junit4] 2> NOTE: Linux 3.2.0-45-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=2,free=9806592,total=35717120
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, TestJmxIntegration]
[junit4:junit4] Completed on J1 in 2.35s, 3 tests, 1 failure, 2 skipped <<< FAILURES!
[...truncated 336 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 832844 T2780 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4:junit4] 2> 832849 T2780 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533
[junit4:junit4] 2> 832850 T2780 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 832850 T2781 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 832950 T2780 oasc.ZkTestServer.run start zk server on port:43411
[junit4:junit4] 2> 832952 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 833271 T2787 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@139c1631 name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 833271 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 833272 T2780 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 833285 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 833286 T2789 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@48849961 name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 833286 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 833287 T2780 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 833292 T2780 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 833294 T2780 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 833296 T2780 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 833298 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 833299 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 833311 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 833311 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 833314 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 833315 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 833316 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 833317 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 833319 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 833320 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 833332 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 833333 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 833335 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 833336 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 833338 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 833339 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 833341 T2780 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 833342 T2780 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 833410 T2780 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 833431 T2780 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57523
[junit4:junit4] 2> 833432 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 833433 T2780 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 833433 T2780 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028
[junit4:junit4] 2> 833434 T2780 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/solr.xml
[junit4:junit4] 2> 833434 T2780 oasc.CoreContainer.<init> New CoreContainer -177181559
[junit4:junit4] 2> 833435 T2780 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/'
[junit4:junit4] 2> 833436 T2780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/'
[junit4:junit4] 2> 833471 T2780 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 833472 T2780 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 833473 T2780 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 833473 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 833474 T2780 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 833474 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 833475 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 833476 T2780 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 833476 T2780 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 833477 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 833482 T2780 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 833483 T2780 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43411/solr
[junit4:junit4] 2> 833483 T2780 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 833484 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 833486 T2800 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5f0e84b6 name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 833486 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 833488 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 833493 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 833494 T2802 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c2530487 name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 833494 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 833496 T2780 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 833499 T2780 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 833502 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 833504 T2780 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57523_
[junit4:junit4] 2> 833505 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57523_
[junit4:junit4] 2> 833507 T2780 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 833532 T2780 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 833535 T2780 oasc.Overseer.start Overseer (id=89810581227831299-127.0.0.1:57523_-n_0000000000) starting
[junit4:junit4] 2> 833538 T2780 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 833541 T2804 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 833541 T2780 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 833543 T2780 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 833545 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 833548 T2803 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 833550 T2805 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/collection1
[junit4:junit4] 2> 833550 T2805 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 833551 T2805 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 833551 T2805 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 833552 T2805 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/collection1/'
[junit4:junit4] 2> 833553 T2805 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/collection1/lib/README' to classloader
[junit4:junit4] 2> 833553 T2805 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 833576 T2805 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 833604 T2805 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 833606 T2805 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 833610 T2805 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 833926 T2805 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 833931 T2805 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 833933 T2805 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 833943 T2805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 833947 T2805 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 833951 T2805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 833952 T2805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 833952 T2805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 833953 T2805 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 833954 T2805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 833954 T2805 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 833954 T2805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 833955 T2805 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370400715028/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/
[junit4:junit4] 2> 833955 T2805 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 833956 T2805 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 833956 T2805 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data
[junit4:junit4] 2> 833957 T2805 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index/
[junit4:junit4] 2> 833957 T2805 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 833958 T2805 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index
[junit4:junit4] 2> 833959 T2805 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3c90d3e8 lockFactory=org.apache.lucene.store.NativeFSLockFactory@56947ab2),segFN=segments_1,generation=1}
[junit4:junit4] 2> 833959 T2805 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 833961 T2805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 833961 T2805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 833962 T2805 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 833962 T2805 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 833963 T2805 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 833963 T2805 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 833964 T2805 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 833964 T2805 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 833964 T2805 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 833966 T2805 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 833967 T2805 oass.SolrIndexSearcher.<init> Opening Searcher@315eb3c2 main
[junit4:junit4] 2> 833968 T2805 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/tlog
[junit4:junit4] 2> 833969 T2805 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 833969 T2805 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 833972 T2806 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@315eb3c2 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 833973 T2805 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 833973 T2805 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 835050 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 835051 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57523",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:57523_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 835052 T2803 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 835052 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 835054 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 835974 T2805 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 835975 T2805 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57523 collection:control_collection shard:shard1
[junit4:junit4] 2> 835976 T2805 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 835980 T2805 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 835981 T2805 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 835982 T2805 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 835982 T2805 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57523/collection1/
[junit4:junit4] 2> 835982 T2805 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 835983 T2805 oasc.SyncStrategy.syncToMe http://127.0.0.1:57523/collection1/ has no replicas
[junit4:junit4] 2> 835983 T2805 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57523/collection1/
[junit4:junit4] 2> 835983 T2805 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 836558 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 836565 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 836588 T2805 oasc.ZkController.register We are http://127.0.0.1:57523/collection1/ and leader is http://127.0.0.1:57523/collection1/
[junit4:junit4] 2> 836588 T2805 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57523
[junit4:junit4] 2> 836589 T2805 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 836589 T2805 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 836590 T2805 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 836591 T2805 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 836593 T2780 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 836593 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 836594 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 836598 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 836599 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 836600 T2809 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3116400 name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 836601 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 836602 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 836604 T2780 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 836670 T2780 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 836672 T2780 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59220
[junit4:junit4] 2> 836673 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 836674 T2780 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 836674 T2780 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289
[junit4:junit4] 2> 836675 T2780 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/solr.xml
[junit4:junit4] 2> 836676 T2780 oasc.CoreContainer.<init> New CoreContainer -1452147889
[junit4:junit4] 2> 836676 T2780 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/'
[junit4:junit4] 2> 836677 T2780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/'
[junit4:junit4] 2> 836712 T2780 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 836713 T2780 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 836713 T2780 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 836714 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 836715 T2780 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 836715 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 836716 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 836716 T2780 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 836717 T2780 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 836718 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 836722 T2780 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 836723 T2780 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43411/solr
[junit4:junit4] 2> 836724 T2780 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 836725 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 836726 T2820 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fdf2e500 name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 836727 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 836728 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 836734 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 836735 T2822 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ab48054c name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 836735 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 836738 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 837741 T2780 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59220_
[junit4:junit4] 2> 837742 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59220_
[junit4:junit4] 2> 837744 T2802 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 837744 T2809 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 837745 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 837744 T2822 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 837749 T2823 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/collection1
[junit4:junit4] 2> 837749 T2823 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 837750 T2823 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 837750 T2823 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 837751 T2823 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/collection1/'
[junit4:junit4] 2> 837752 T2823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/collection1/lib/README' to classloader
[junit4:junit4] 2> 837752 T2823 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 837775 T2823 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 837804 T2823 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 837805 T2823 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 837810 T2823 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 838068 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 838069 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57523",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57523__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57523_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 838072 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 838072 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 838072 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 838123 T2823 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 838128 T2823 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 838130 T2823 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 838140 T2823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 838144 T2823 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 838147 T2823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 838148 T2823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 838149 T2823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 838149 T2823 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 838150 T2823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 838150 T2823 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 838151 T2823 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 838151 T2823 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/
[junit4:junit4] 2> 838151 T2823 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 838152 T2823 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 838153 T2823 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1
[junit4:junit4] 2> 838153 T2823 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index/
[junit4:junit4] 2> 838153 T2823 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 838154 T2823 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index
[junit4:junit4] 2> 838155 T2823 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e69c38ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@e2cee8d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 838156 T2823 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 838157 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 838158 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 838158 T2823 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 838159 T2823 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 838159 T2823 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 838160 T2823 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 838160 T2823 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 838161 T2823 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 838161 T2823 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 838162 T2823 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 838164 T2823 oass.SolrIndexSearcher.<init> Opening Searcher@3d60f810 main
[junit4:junit4] 2> 838165 T2823 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/tlog
[junit4:junit4] 2> 838165 T2823 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 838166 T2823 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 838170 T2824 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3d60f810 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 838172 T2823 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 838172 T2823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 839576 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 839576 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 839577 T2803 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 839577 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 839581 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 839581 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 839581 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 840175 T2823 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 840175 T2823 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59220 collection:collection1 shard:shard1
[junit4:junit4] 2> 840176 T2823 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 840182 T2823 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 840185 T2823 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 840185 T2823 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 840186 T2823 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59220/collection1/
[junit4:junit4] 2> 840186 T2823 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 840187 T2823 oasc.SyncStrategy.syncToMe http://127.0.0.1:59220/collection1/ has no replicas
[junit4:junit4] 2> 840187 T2823 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59220/collection1/
[junit4:junit4] 2> 840188 T2823 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 841084 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 841090 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 841090 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 841090 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 841095 T2823 oasc.ZkController.register We are http://127.0.0.1:59220/collection1/ and leader is http://127.0.0.1:59220/collection1/
[junit4:junit4] 2> 841096 T2823 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59220
[junit4:junit4] 2> 841096 T2823 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 841096 T2823 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 841097 T2823 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 841098 T2823 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 841099 T2780 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 841100 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 841101 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 841180 T2780 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 841182 T2780 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43980
[junit4:junit4] 2> 841183 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 841184 T2780 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 841184 T2780 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793
[junit4:junit4] 2> 841185 T2780 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/solr.xml
[junit4:junit4] 2> 841186 T2780 oasc.CoreContainer.<init> New CoreContainer -1309726704
[junit4:junit4] 2> 841186 T2780 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/'
[junit4:junit4] 2> 841187 T2780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/'
[junit4:junit4] 2> 841222 T2780 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 841223 T2780 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 841223 T2780 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 841224 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 841225 T2780 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 841225 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 841226 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 841226 T2780 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 841227 T2780 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 841228 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 841232 T2780 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 841233 T2780 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43411/solr
[junit4:junit4] 2> 841234 T2780 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 841235 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 841236 T2836 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b675f5cb name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 841236 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 841238 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 841243 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 841244 T2838 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@75dcff8 name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 841244 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 841247 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 842250 T2780 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43980_
[junit4:junit4] 2> 842252 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43980_
[junit4:junit4] 2> 842254 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 842255 T2802 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 842255 T2822 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 842255 T2838 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 842256 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842255 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842257 T2809 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 842260 T2839 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/collection1
[junit4:junit4] 2> 842260 T2839 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 842261 T2839 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 842261 T2839 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 842263 T2839 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/collection1/'
[junit4:junit4] 2> 842263 T2839 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/collection1/lib/README' to classloader
[junit4:junit4] 2> 842264 T2839 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 842286 T2839 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 842314 T2839 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 842315 T2839 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 842320 T2839 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 842594 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 842595 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 842598 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842598 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842598 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842599 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 842625 T2839 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 842630 T2839 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 842632 T2839 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 842642 T2839 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 842645 T2839 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 842648 T2839 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 842650 T2839 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 842650 T2839 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 842650 T2839 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 842651 T2839 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 842652 T2839 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 842652 T2839 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 842652 T2839 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370400722793/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2/
[junit4:junit4] 2> 842653 T2839 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 842653 T2839 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 842654 T2839 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2
[junit4:junit4] 2> 842655 T2839 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2/index/
[junit4:junit4] 2> 842655 T2839 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 842655 T2839 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2/index
[junit4:junit4] 2> 842657 T2839 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@df5d6a1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@9b6c90c9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 842657 T2839 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 842659 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 842659 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 842660 T2839 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 842660 T2839 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 842661 T2839 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 842661 T2839 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 842662 T2839 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 842662 T2839 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 842662 T2839 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 842664 T2839 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 842665 T2839 oass.SolrIndexSearcher.<init> Opening Searcher@2a903851 main
[junit4:junit4] 2> 842666 T2839 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty2/tlog
[junit4:junit4] 2> 842667 T2839 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 842667 T2839 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 842671 T2840 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a903851 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 842672 T2839 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 842672 T2839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 844102 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 844103 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43980",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:43980_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 844104 T2803 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 844104 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 844107 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 844107 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 844107 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 844108 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 844674 T2839 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 844674 T2839 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43980 collection:collection1 shard:shard2
[junit4:junit4] 2> 844676 T2839 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 844681 T2839 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 844684 T2839 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 844685 T2839 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 844685 T2839 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43980/collection1/
[junit4:junit4] 2> 844685 T2839 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 844686 T2839 oasc.SyncStrategy.syncToMe http://127.0.0.1:43980/collection1/ has no replicas
[junit4:junit4] 2> 844686 T2839 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43980/collection1/
[junit4:junit4] 2> 844686 T2839 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 845611 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 845617 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 845617 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 845617 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 845617 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 845642 T2839 oasc.ZkController.register We are http://127.0.0.1:43980/collection1/ and leader is http://127.0.0.1:43980/collection1/
[junit4:junit4] 2> 845642 T2839 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43980
[junit4:junit4] 2> 845643 T2839 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 845643 T2839 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 845643 T2839 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 845645 T2839 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 845646 T2780 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 845647 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 845648 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 845723 T2780 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 845725 T2780 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:59097
[junit4:junit4] 2> 845725 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 845726 T2780 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 845727 T2780 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339
[junit4:junit4] 2> 845727 T2780 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/solr.xml
[junit4:junit4] 2> 845728 T2780 oasc.CoreContainer.<init> New CoreContainer 291813265
[junit4:junit4] 2> 845728 T2780 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/'
[junit4:junit4] 2> 845729 T2780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/'
[junit4:junit4] 2> 845764 T2780 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 845765 T2780 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 845766 T2780 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 845766 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 845767 T2780 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 845767 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 845768 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 845769 T2780 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 845769 T2780 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 845770 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 845775 T2780 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 845776 T2780 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43411/solr
[junit4:junit4] 2> 845777 T2780 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 845778 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 845779 T2852 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b83bbd9 name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 845779 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 845781 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 845786 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 845787 T2854 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@963b75a7 name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 845787 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 845790 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 846793 T2780 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59097_
[junit4:junit4] 2> 846795 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59097_
[junit4:junit4] 2> 846798 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 846798 T2822 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 846798 T2802 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 846799 T2838 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 846799 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 846799 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 846800 T2809 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 846799 T2854 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 846799 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 846805 T2855 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/collection1
[junit4:junit4] 2> 846805 T2855 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 846806 T2855 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 846806 T2855 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 846807 T2855 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/collection1/'
[junit4:junit4] 2> 846808 T2855 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/collection1/lib/README' to classloader
[junit4:junit4] 2> 846808 T2855 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 846830 T2855 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 846858 T2855 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 846860 T2855 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 846864 T2855 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 847122 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 847123 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:43980",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:43980__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:43980_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 847126 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 847126 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 847126 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 847126 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 847126 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 847158 T2855 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 847162 T2855 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 847176 T2855 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 847185 T2855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 847189 T2855 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 847193 T2855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 847194 T2855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 847194 T2855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 847195 T2855 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 847195 T2855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 847196 T2855 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 847196 T2855 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 847197 T2855 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370400727339/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/
[junit4:junit4] 2> 847197 T2855 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 847198 T2855 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 847198 T2855 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3
[junit4:junit4] 2> 847199 T2855 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index/
[junit4:junit4] 2> 847199 T2855 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 847200 T2855 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index
[junit4:junit4] 2> 847201 T2855 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73f969e2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a64f7555),segFN=segments_1,generation=1}
[junit4:junit4] 2> 847201 T2855 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 847203 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 847204 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 847204 T2855 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 847205 T2855 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 847205 T2855 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 847206 T2855 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 847206 T2855 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 847207 T2855 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 847207 T2855 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 847208 T2855 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 847210 T2855 oass.SolrIndexSearcher.<init> Opening Searcher@9e35ce83 main
[junit4:junit4] 2> 847211 T2855 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/tlog
[junit4:junit4] 2> 847211 T2855 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 847212 T2855 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 847217 T2856 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9e35ce83 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 847218 T2855 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 847219 T2855 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 848631 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 848631 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59097",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59097_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 848632 T2803 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 848632 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 848635 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 848635 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 848635 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 848635 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 848635 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 849220 T2855 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 849221 T2855 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59097 collection:collection1 shard:shard1
[junit4:junit4] 2> 849224 T2855 oasc.ZkController.register We are http://127.0.0.1:59097/collection1/ and leader is http://127.0.0.1:59220/collection1/
[junit4:junit4] 2> 849225 T2855 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59097
[junit4:junit4] 2> 849225 T2855 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 849225 T2855 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1310 name=collection1 org.apache.solr.core.SolrCore@7ecc5ebe url=http://127.0.0.1:59097/collection1 node=127.0.0.1:59097_ C1310_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:59097, state=down, node_name=127.0.0.1:59097_, collection=collection1, core=collection1}
[junit4:junit4] 2> 849226 T2857 C1310 P59097 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 849226 T2855 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 849226 T2857 C1310 P59097 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 849227 T2857 C1310 P59097 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 849227 T2857 C1310 P59097 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 849228 T2780 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 849228 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 849228 T2857 C1310 P59097 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 849229 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 849234 T2817 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:59097__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 849299 T2780 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 849302 T2780 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:38710
[junit4:junit4] 2> 849302 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 849303 T2780 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 849304 T2780 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918
[junit4:junit4] 2> 849304 T2780 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/solr.xml
[junit4:junit4] 2> 849305 T2780 oasc.CoreContainer.<init> New CoreContainer 476877908
[junit4:junit4] 2> 849305 T2780 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/'
[junit4:junit4] 2> 849306 T2780 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/'
[junit4:junit4] 2> 849341 T2780 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 849342 T2780 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 849342 T2780 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 849343 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 849344 T2780 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 849344 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 849345 T2780 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 849345 T2780 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 849346 T2780 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 849347 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 849351 T2780 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 849352 T2780 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43411/solr
[junit4:junit4] 2> 849353 T2780 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 849354 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 849355 T2869 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b2a80482 name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 849356 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 849357 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 849363 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 849364 T2871 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@880250ff name:ZooKeeperConnection Watcher:127.0.0.1:43411/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 849364 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 849367 T2780 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 850138 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 850139 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59097",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59097__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59097_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 850143 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850143 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850143 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850143 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850143 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850143 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850235 T2817 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:59097__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 850236 T2817 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:59097__collection1&wt=javabin&nodeName=127.0.0.1:59097_&core=collection1} status=0 QTime=1002
[junit4:junit4] 2> 850370 T2780 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38710_
[junit4:junit4] 2> 850371 T2780 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:38710_
[junit4:junit4] 2> 850373 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 850373 T2854 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850374 T2802 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850374 T2822 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850374 T2838 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850374 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 850374 T2871 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850374 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 850375 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 850376 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 850374 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 850375 T2809 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 850380 T2872 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/collection1
[junit4:junit4] 2> 850380 T2872 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 850381 T2872 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 850381 T2872 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 850382 T2872 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/collection1/'
[junit4:junit4] 2> 850383 T2872 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/collection1/lib/README' to classloader
[junit4:junit4] 2> 850383 T2872 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 850405 T2872 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 850433 T2872 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 850435 T2872 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 850439 T2872 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 850734 T2872 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 850738 T2872 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 850741 T2872 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 850750 T2872 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 850754 T2872 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 850770 T2872 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 850771 T2872 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 850771 T2872 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 850772 T2872 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 850773 T2872 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 850773 T2872 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 850774 T2872 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 850774 T2872 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370400730918/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/
[junit4:junit4] 2> 850774 T2872 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 850775 T2872 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 850776 T2872 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4
[junit4:junit4] 2> 850776 T2872 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index/
[junit4:junit4] 2> 850776 T2872 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 850777 T2872 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index
[junit4:junit4] 2> 850778 T2872 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b1acea5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6193c85),segFN=segments_1,generation=1}
[junit4:junit4] 2> 850778 T2872 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 850780 T2872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 850780 T2872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 850781 T2872 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 850782 T2872 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 850782 T2872 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 850783 T2872 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 850783 T2872 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 850783 T2872 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 850784 T2872 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 850785 T2872 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 850787 T2872 oass.SolrIndexSearcher.<init> Opening Searcher@2318d6e5 main
[junit4:junit4] 2> 850787 T2872 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/tlog
[junit4:junit4] 2> 850788 T2872 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 850788 T2872 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 850792 T2873 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2318d6e5 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 850794 T2872 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 850794 T2872 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 851647 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 851648 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38710",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:38710_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 851648 T2803 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 851648 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 851652 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851652 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851652 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851652 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851652 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851652 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 851796 T2872 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 851796 T2872 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:38710 collection:collection1 shard:shard2
[junit4:junit4] 2> 851799 T2872 oasc.ZkController.register We are http://127.0.0.1:38710/collection1/ and leader is http://127.0.0.1:43980/collection1/
[junit4:junit4] 2> 851799 T2872 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:38710
[junit4:junit4] 2> 851799 T2872 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 851800 T2872 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C1311 name=collection1 org.apache.solr.core.SolrCore@bce5931 url=http://127.0.0.1:38710/collection1 node=127.0.0.1:38710_ C1311_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:38710, state=down, node_name=127.0.0.1:38710_, collection=collection1, core=collection1}
[junit4:junit4] 2> 851800 T2874 C1311 P38710 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 851801 T2872 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 851801 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 851801 T2874 C1311 P38710 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 851802 T2874 C1311 P38710 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 851802 T2780 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 851803 T2780 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 851802 T2874 C1311 P38710 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 851803 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 851808 T2780 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 851809 T2834 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 127.0.0.1:38710__collection1, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 851810 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 851815 T2818 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/onenodecollectioncore
[junit4:junit4] 2> 851816 T2818 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 851817 T2818 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 851818 T2818 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 851819 T2818 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 851819 T2818 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 851821 T2818 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 851823 T2818 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/onenodecollectioncore/'
[junit4:junit4] 2> 851849 T2818 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 851880 T2818 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 851882 T2818 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 851887 T2818 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4] 2> 852201 T2818 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 852206 T2818 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 852209 T2818 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 852218 T2818 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 852222 T2818 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 852226 T2818 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 852227 T2818 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 852228 T2818 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 852228 T2818 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 852230 T2818 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 852231 T2818 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 852231 T2818 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 852232 T2818 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370400718289/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/
[junit4:junit4] 2> 852233 T2818 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@6c9a3814
[junit4:junit4] 2> 852233 T2818 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 852235 T2818 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection
[junit4:junit4] 2> 852235 T2818 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index/
[junit4:junit4] 2> 852236 T2818 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 852237 T2818 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index
[junit4:junit4] 2> ASYNC NEW_CORE C1312 name=collection1 org.apache.solr.core.SolrCore@7ecc5ebe url=http://127.0.0.1:59097/collection1 node=127.0.0.1:59097_ C1312_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:59097, state=recovering, node_name=127.0.0.1:59097_, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4] 2> 852237 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59220/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 852238 T2857 C1312 P59097 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59097 START replicas=[http://127.0.0.1:59220/collection1/] nUpdates=100
[junit4:junit4] 2> 852238 T2818 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@f87cfd42 lockFactory=org.apache.lucene.store.NativeFSLockFactory@311d6ea8),segFN=segments_1,generation=1}
[junit4:junit4] 2> 852239 T2818 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 852238 T2857 C1312 P59097 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 852240 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 852240 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 852241 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 852241 T2857 C1312 P59097 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 852241 T2857 C1312 P59097 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59220/collection1/. core=collection1
[junit4:junit4] 2> 852241 T2818 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 852241 T2857 C1312 P59097 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 852242 T2818 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 852243 T2818 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 852244 T2818 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> ASYNC NEW_CORE C1313 name=collection1 org.apache.solr.core.SolrCore@b1b38234 url=http://127.0.0.1:59220/collection1 node=127.0.0.1:59220_ C1313_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:59220, state=active, node_name=127.0.0.1:59220_, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 852244 T2815 C1313 P59220 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 852245 T2818 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 852246 T2818 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 852247 T2817 C1313 P59220 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 852247 T2818 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 852248 T2817 C1313 P59220 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e69c38ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@e2cee8d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 852249 T2817 C1313 P59220 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 852248 T2818 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 852250 T2817 C1313 P59220 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e69c38ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@e2cee8d9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e69c38ed lockFactory=org.apache.lucene.store.NativeFSLockFactory@e2cee8d9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 852251 T2817 C1313 P59220 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 852251 T2818 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 852252 T2817 C1313 P59220 oass.SolrIndexSearcher.<init> Opening Searcher@4cb68e47 realtime
[junit4:junit4] 2> 852253 T2817 C1313 P59220 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 852253 T2818 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 852254 T2817 C1313 P59220 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 7
[junit4:junit4] 2> 852256 T2857 C1312 P59097 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 852256 T2857 C1312 P59097 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 852256 T2818 oass.SolrIndexSearcher.<init> Opening Searcher@cb5de054 main
[junit4:junit4] 2> 852257 T2818 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/tlog
[junit4:junit4] 2> 852258 T2816 C1313 P59220 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 852259 T2818 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 852259 T2816 C1313 P59220 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=2
[junit4:junit4] 2> 852260 T2818 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 852260 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 852261 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 852261 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 852263 T2817 C1313 P59220 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 852264 T2877 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@cb5de054 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 852264 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 852265 T2818 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 852265 T2857 C1312 P59097 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index.20130604195213949
[junit4:junit4] 2> 852266 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@dcf56a42 lockFactory=org.apache.lucene.store.NativeFSLockFactory@f697f7a2) fullCopy=false
[junit4:junit4] 2> 852268 T2815 C1313 P59220 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 852270 T2857 C1312 P59097 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 852271 T2857 C1312 P59097 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 852271 T2857 C1312 P59097 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 852272 T2857 C1312 P59097 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73f969e2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a64f7555),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@73f969e2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a64f7555),segFN=segments_2,generation=2}
[junit4:junit4] 2> 852272 T2857 C1312 P59097 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 852272 T2857 C1312 P59097 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 852273 T2857 C1312 P59097 oass.SolrIndexSearcher.<init> Opening Searcher@6b9da0b5 main
[junit4:junit4] 2> 852274 T2856 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6b9da0b5 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 852274 T2857 C1312 P59097 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index.20130604195213949 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index.20130604195213949;done=true>>]
[junit4:junit4] 2> 852275 T2857 C1312 P59097 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index.20130604195213949
[junit4:junit4] 2> 852275 T2857 C1312 P59097 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty3/index.20130604195213949
[junit4:junit4] 2> 852275 T2857 C1312 P59097 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 852275 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 852276 T2857 C1312 P59097 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 852276 T2857 C1312 P59097 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 852277 T2857 C1312 P59097 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 853156 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 853156 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38710",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38710__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:38710_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 853159 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 853159 T2803 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 853160 T2803 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 853162 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59097",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59097__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59097_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 853165 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853165 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853165 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853165 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853165 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853165 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 853267 T2818 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 853268 T2818 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:59220 collection:onenodecollection shard:shard1
[junit4:junit4] 2> 853269 T2818 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 853276 T2818 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 853279 T2818 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 853280 T2818 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 853281 T2818 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59220/onenodecollectioncore/
[junit4:junit4] 2> 853282 T2818 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 853283 T2818 oasc.SyncStrategy.syncToMe http://127.0.0.1:59220/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 853284 T2818 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59220/onenodecollectioncore/
[junit4:junit4] 2> 853285 T2818 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 853810 T2834 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 127.0.0.1:38710__collection1, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 853811 T2834 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=127.0.0.1:38710__collection1&wt=javabin&nodeName=127.0.0.1:38710_&core=collection1} status=0 QTime=2002
[junit4:junit4] 2> 854672 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 854678 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854678 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854678 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854678 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854678 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854678 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 854694 T2818 oasc.ZkController.register We are http://127.0.0.1:59220/onenodecollectioncore/ and leader is http://127.0.0.1:59220/onenodecollectioncore/
[junit4:junit4] 2> 854695 T2818 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:59220
[junit4:junit4] 2> 854695 T2818 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 854696 T2818 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 854697 T2818 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 854698 T2818 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&wt=javabin&roles=none&collection=onenodecollection} status=0 QTime=2883
[junit4:junit4] 2> 854699 T2780 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 854700 T2780 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 855701 T2780 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C1311_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:38710, state=recovering, node_name=127.0.0.1:38710_, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 855812 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:43980/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 855813 T2874 C1311 P38710 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:38710 START replicas=[http://127.0.0.1:43980/collection1/] nUpdates=100
[junit4:junit4] 2> 855813 T2874 C1311 P38710 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 855813 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 855813 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 855814 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 855814 T2874 C1311 P38710 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 855814 T2874 C1311 P38710 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:43980/collection1/. core=collection1
[junit4:junit4] 2> 855814 T2874 C1311 P38710 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C1314 name=collection1 org.apache.solr.core.SolrCore@fd934ab5 url=http://127.0.0.1:43980/collection1 node=127.0.0.1:43980_ C1314_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:43980, state=active, node_name=127.0.0.1:43980_, collection=collection1, shard=shard2, core=collection1, leader=true}
[junit4:junit4] 2> 855817 T2832 C1314 P43980 oasc.SolrCore.execute [collection1] webapp= path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 855819 T2831 C1314 P43980 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 855821 T2831 C1314 P43980 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@df5d6a1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@9b6c90c9),segFN=segments_1,generation=1}
[junit4:junit4] 2> 855822 T2831 C1314 P43980 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 855822 T2831 C1314 P43980 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@df5d6a1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@9b6c90c9),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@df5d6a1a lockFactory=org.apache.lucene.store.NativeFSLockFactory@9b6c90c9),segFN=segments_2,generation=2}
[junit4:junit4] 2> 855823 T2831 C1314 P43980 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 855824 T2831 C1314 P43980 oass.SolrIndexSearcher.<init> Opening Searcher@94607b15 realtime
[junit4:junit4] 2> 855825 T2831 C1314 P43980 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 855826 T2831 C1314 P43980 oasup.LogUpdateProcessor.finish [collection1] webapp= path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 7
[junit4:junit4] 2> 855827 T2874 C1311 P38710 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 855827 T2874 C1311 P38710 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 855828 T2833 C1314 P43980 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 855829 T2833 C1314 P43980 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 855830 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 855830 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 855830 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 855832 T2832 C1314 P43980 oasc.SolrCore.execute [collection1] webapp= path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 855832 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 855833 T2874 C1311 P38710 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index.20130604195217517
[junit4:junit4] 2> 855833 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@b83e1264 lockFactory=org.apache.lucene.store.NativeFSLockFactory@73b23e72) fullCopy=false
[junit4:junit4] 2> 855835 T2831 C1314 P43980 oasc.SolrCore.execute [collection1] webapp= path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 855836 T2874 C1311 P38710 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 855837 T2874 C1311 P38710 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 855837 T2874 C1311 P38710 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 855838 T2874 C1311 P38710 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b1acea5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6193c85),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@9b1acea5 lockFactory=org.apache.lucene.store.NativeFSLockFactory@a6193c85),segFN=segments_2,generation=2}
[junit4:junit4] 2> 855838 T2874 C1311 P38710 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 855839 T2874 C1311 P38710 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 855839 T2874 C1311 P38710 oass.SolrIndexSearcher.<init> Opening Searcher@1b14a5e3 main
[junit4:junit4] 2> 855840 T2873 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1b14a5e3 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 855840 T2874 C1311 P38710 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index.20130604195217517 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index.20130604195217517;done=true>>]
[junit4:junit4] 2> 855841 T2874 C1311 P38710 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index.20130604195217517
[junit4:junit4] 2> 855841 T2874 C1311 P38710 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty4/index.20130604195217517
[junit4:junit4] 2> 855841 T2874 C1311 P38710 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 855842 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 855842 T2874 C1311 P38710 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 855842 T2874 C1311 P38710 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 855844 T2874 C1311 P38710 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 856183 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 856183 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 856186 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:38710",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:38710__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:38710_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 856189 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856189 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856189 T2809 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856189 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856189 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856189 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 856703 T2780 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 856705 T2780 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 856705 T2780 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 856727 T2780 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 856728 T2882 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f4e150c name:ZooKeeperConnection Watcher:127.0.0.1:43411 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 856728 T2780 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 856760 T2780 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 57523
[junit4:junit4] 2> 856760 T2780 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-177181559
[junit4:junit4] 2> 857694 T2803 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 857695 T2803 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57523",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57523__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57523_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 857698 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 857698 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 857698 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 857698 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 857698 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 858762 T2780 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 858762 T2780 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 858764 T2780 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@9ec11b0a
[junit4:junit4] 2> 858767 T2780 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 858767 T2780 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 858768 T2780 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 858768 T2780 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 858769 T2780 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 858770 T2780 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 858770 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index;done=false>>]
[junit4:junit4] 2> 858771 T2780 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data/index
[junit4:junit4] 2> 858771 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data;done=false>>]
[junit4:junit4] 2> 858772 T2780 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/control/data
[junit4:junit4] 2> 858773 T2803 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89810581227831299-127.0.0.1:57523_-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 858774 T2854 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 858774 T2838 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 858775 T2822 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 858775 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858775 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858775 T2871 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 858777 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858775 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858779 T2822 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 858780 T2822 oasc.Overseer.start Overseer (id=89810581227831302-127.0.0.1:59220_-n_0000000001) starting
[junit4:junit4] 2> 858784 T2884 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 858784 T2883 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 858785 T2883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 858786 T2883 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:57523",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:57523__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:57523_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 858788 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858788 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858788 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858788 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 858795 T2780 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 858847 T2780 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 59220
[junit4:junit4] 2> 858848 T2780 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-1452147889
[junit4:junit4] 2> 860074 T2802 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 860075 T2802 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 860075 T2802 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 860292 T2883 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 860293 T2883 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 860296 T2883 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 860299 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 860299 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 860299 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 860299 T2822 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 861851 T2780 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 861851 T2780 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 861855 T2780 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 861857 T2780 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b1b38234
[junit4:junit4] 2> 861860 T2780 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 861860 T2780 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 861861 T2780 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 861862 T2780 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 861863 T2780 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 861863 T2780 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 861864 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index;done=false>>]
[junit4:junit4] 2> 861864 T2780 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1/index
[junit4:junit4] 2> 861865 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1;done=false>>]
[junit4:junit4] 2> 861865 T2780 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370400714533/jetty1
[junit4:junit4] 2> 861866 T2780 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@e79f160a
[junit4:junit4] 2> 861870 T2780 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 861871 T2780 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 861871 T2780 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 861872 T2780 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 861872 T2780 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 861873 T2780 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 861874 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection;done=false>>]
[junit4:junit4] 2> 861874 T2780 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection
[junit4:junit4] 2> 861875 T2780 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index;done=false>>]
[junit4:junit4] 2> 861875 T2780 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370400714533/onenodecollection/index
[junit4:junit4] 2> 861876 T2883 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89810581227831302-127.0.0.1:59220_-n_0000000001) am no longer a leader.
[junit4:junit4] 2> 861877 T2854 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 861877 T2838 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 861877 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861877 T2871 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 861878 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861878 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861879 T2854 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 861880 T2838 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 861881 T2854 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 861882 T2854 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 861882 T2854 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 861882 T2838 oasc.Overseer.start Overseer (id=89810581227831304-127.0.0.1:43980_-n_0000000002) starting
[junit4:junit4] 2> 861882 T2854 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59097/collection1/
[junit4:junit4] 2> 861883 T2854 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 861883 T2854 oasc.SyncStrategy.syncToMe http://127.0.0.1:59097/collection1/ has no replicas
[junit4:junit4] 2> 861884 T2854 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59097/collection1/
[junit4:junit4] 2> 861884 T2854 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 861886 T2886 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 861887 T2885 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 861888 T2885 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 861889 T2885 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__collection1",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 861891 T2885 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59220",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:59220__onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:59220_",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 861897 T2780 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
[junit4:junit4] 2> 861898 T2838 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861898 T2871 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861898 T2854 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 861949 T2780 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 43980
[junit4:junit4] 2> 861950 T2780 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-1309726704
[junit4:junit4] 2> 862952 T2780 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 862952 T2780 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 862954 T2780 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@fd934ab5
[junit4:junit4] 2> 862957 T2780 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 862957 T2780 oa
[...truncated too long message...]
40116-679 Acceptor1 SelectChannelConnector@127.0.0.1:44782, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 65) Thread[id=686, name=TEST-ChaosMonkeySafeLeaderTest.testDistribSearch-seed#[F74C7F0465E66990]-SendThread(localhost.localdomain:42440), state=BLOCKED, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.security.AccessController.getProtectionDomains(Native Method)
[junit4:junit4] 2> at java.security.AccessController.checkPermission(AccessController.java:88)
[junit4:junit4] 2> at java.lang.SecurityManager.checkPermission(SecurityManager.java:560)
[junit4:junit4] 2> at javax.security.auth.login.Configuration.getConfiguration(Configuration.java:237)
[junit4:junit4] 2> at org.apache.zookeeper.client.ZooKeeperSaslClient.clientTunneledAuthenticationInProgress(ZooKeeperSaslClient.java:487)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.clientTunneledAuthenticationInProgress(ClientCnxn.java:1241)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:360)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 66) Thread[id=814, name=HashSessionScavenger-26, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.lang.Object.wait(Object.java:196)
[junit4:junit4] 2> at java.util.Timer$TimerImpl.run(Timer.java:250)
[junit4:junit4] 2> 67) Thread[id=912, name=Thread-500, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.lang.Object.wait(Object.java:167)
[junit4:junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:1255)
[junit4:junit4] 2> 68) Thread[id=833, name=Thread-451, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.lang.Object.wait(Native Method)
[junit4:junit4] 2> at java.lang.Object.wait(Object.java:167)
[junit4:junit4] 2> at org.apache.solr.core.CloserThread.run(CoreContainer.java:1255)
[junit4:junit4] 2> 69) Thread[id=888, name=Thread-437-SendThread(localhost.localdomain:42440), state=BLOCKED, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at java.security.Permissions.implies(Permissions.java:197)
[junit4:junit4] 2> at java.security.ProtectionDomain.implies(ProtectionDomain.java:287)
[junit4:junit4] 2> at java.security.AccessController.checkPermission(AccessController.java:118)
[junit4:junit4] 2> at java.lang.SecurityManager.checkPermission(SecurityManager.java:560)
[junit4:junit4] 2> at javax.security.auth.login.Configuration.getConfiguration(Configuration.java:237)
[junit4:junit4] 2> at org.apache.zookeeper.client.ZooKeeperSaslClient.clientTunneledAuthenticationInProgress(ZooKeeperSaslClient.java:487)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.clientTunneledAuthenticationInProgress(ClientCnxn.java:1241)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:360)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
[junit4:junit4] 2> 70) Thread[id=609, name=qtp-1078656163-609 Acceptor0 SelectChannelConnector@127.0.0.1:42452, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.accept(SelectChannelConnector.java:102)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:938)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 71) Thread[id=620, name=searcherExecutor-415-thread-1, state=WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4:junit4] 2> at java.util.concurrent.locks.LockSupport.park(LockSupport.java:197)
[junit4:junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2054)
[junit4:junit4] 2> at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:453)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
[junit4:junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:614)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 72) Thread[id=860, name=qtp999935349-860 Acceptor1 SelectChannelConnector@127.0.0.1:44553, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> at org.eclipse.jetty.server.nio.SelectChannelConnector.getConnection(SelectChannelConnector.java:160)
[junit4:junit4] 2> at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:608)
[junit4:junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:543)
[junit4:junit4] 2> at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {range_facet_si=MockFixedIntBlock(blockSize=872), range_facet_l=PostingsFormat(name=TestBloomFilteredLucene41Postings), range_facet_sl=Pulsing41(freqCutoff=5 minBlockSize=73 maxBlockSize=196), _version_=PostingsFormat(name=TestBloomFilteredLucene41Postings), multiDefault=MockFixedIntBlock(blockSize=872), other_tl1=PostingsFormat(name=TestBloomFilteredLucene41Postings), rnd_b=PostingsFormat(name=Memory doPackFST= true), text=Pulsing41(freqCutoff=5 minBlockSize=73 maxBlockSize=196), intDefault=PostingsFormat(name=TestBloomFilteredLucene41Postings), a_si=MockFixedIntBlock(blockSize=872), a_t=PostingsFormat(name=TestBloomFilteredLucene41Postings), timestamp=PostingsFormat(name=TestBloomFilteredLucene41Postings), id=PostingsFormat(name=Memory doPackFST= true)}, docValues:{timestamp=DocValuesFormat(name=CheapBastard)}, sim=DefaultSimilarity, locale=zh_CN, timezone=America/Moncton
[junit4:junit4] 2> NOTE: Linux 3.2.0-45-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=85,free=97962976,total=163577856
[junit4:junit4] 2> NOTE: All tests run in this JVM: [CurrencyFieldXmlFileTest, TestJmxIntegration, TestFieldTypeResource, SolrPluginUtilsTest, TestRangeQuery, DistanceFunctionTest, XmlUpdateRequestHandlerTest, SpellCheckComponentTest, TestDistributedSearch, TestShardHandlerFactory, CurrencyFieldOpenExchangeTest, TestNumberUtils, DefaultValueUpdateProcessorTest, IndexSchemaRuntimeFieldTest, DOMUtilTest, IndexBasedSpellCheckerTest, TestAnalyzedSuggestions, CachingDirectoryFactoryTest, HighlighterConfigTest, ConvertedLegacyTest, OpenCloseCoreStressTest, TestRTGBase, TestReload, TestQuerySenderNoQuery, TestCollationField, SolrIndexConfigTest, TestCSVLoader, TestBinaryResponseWriter, UpdateParamsTest, ChaosMonkeySafeLeaderTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=F74C7F0465E66990 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh_CN -Dtests.timezone=America/Moncton -Dtests.file.encoding=ISO-8859-1
[junit4:junit4] ERROR 0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
[junit4:junit4] > Throwable #1: java.lang.Exception: Suite timeout exceeded (>= 7200000 msec).
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([F74C7F0465E66990]:0)
[junit4:junit4] Completed on J1 in 7225.33s, 1 test, 2 errors <<< FAILURES!
[...truncated 139 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:380: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:373: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 296 suites, 1235 tests, 1 suite-level error, 2 errors, 1 failure, 174 ignored (7 assumptions)
Total time: 149 minutes 28 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-Linux (32bit/ibm-j9-jdk7) - Build #
5990 - Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/5990/
Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
1 tests failed.
FAILED: org.apache.solr.cloud.BasicDistributedZk2Test.testDistribSearch
Error Message:
Server at http://127.0.0.1:50373/yuf/v/onenodecollectioncore returned non ok status:404, message:Can not find: /yuf/v/onenodecollectioncore/update
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:50373/yuf/v/onenodecollectioncore returned non ok status:404, message:Can not find: /yuf/v/onenodecollectioncore/update
at __randomizedtesting.SeedInfo.seed([73BF5CAB17741375:F259D2B3602B7349]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:88)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:55)
at java.lang.reflect.Method.invoke(Method.java:613)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:780)
Build Log:
[...truncated 9581 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.BasicDistributedZk2Test
[junit4:junit4] 2> 659612 T3052 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /yuf/v
[junit4:junit4] 2> 659617 T3052 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425
[junit4:junit4] 2> 659618 T3052 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 659619 T3053 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 659719 T3052 oasc.ZkTestServer.run start zk server on port:41252
[junit4:junit4] 2> 659722 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659733 T3059 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55c1791a name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659733 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659733 T3052 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 659739 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659740 T3061 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@be054c26 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659741 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659741 T3052 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 659743 T3052 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 659745 T3052 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 659747 T3052 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 659748 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 659749 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 659751 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 659752 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 659755 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 659755 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 659757 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 659758 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 659760 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 659760 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 659762 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 659763 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 659764 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 659765 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 659767 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 659768 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 659769 T3052 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 659770 T3052 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 659837 T3052 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 659843 T3052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
[junit4:junit4] 2> 659843 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 659844 T3052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 659845 T3052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579
[junit4:junit4] 2> 659845 T3052 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/solr.xml
[junit4:junit4] 2> 659846 T3052 oasc.CoreContainer.<init> New CoreContainer -1500701346
[junit4:junit4] 2> 659846 T3052 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/'
[junit4:junit4] 2> 659847 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/'
[junit4:junit4] 2> 659899 T3052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 659900 T3052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 659900 T3052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 659901 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 659901 T3052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 659902 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 659903 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 659903 T3052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 659904 T3052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 659905 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 659909 T3052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 659910 T3052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41252/solr
[junit4:junit4] 2> 659910 T3052 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 659913 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659914 T3072 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@c64645a4 name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659915 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659916 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 659922 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 659923 T3074 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73686013 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 659924 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 659925 T3052 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 659927 T3052 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 659930 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 659931 T3052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51682_yuf%2Fv
[junit4:junit4] 2> 659932 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51682_yuf%2Fv
[junit4:junit4] 2> 659934 T3052 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 659938 T3052 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 659940 T3052 oasc.Overseer.start Overseer (id=89811303165394947-127.0.0.1:51682_yuf%2Fv-n_0000000000) starting
[junit4:junit4] 2> 659943 T3052 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 659945 T3076 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 659945 T3052 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 659947 T3052 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 659948 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 659950 T3075 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 659952 T3077 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/collection1
[junit4:junit4] 2> 659953 T3077 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 659953 T3077 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 659953 T3077 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 659955 T3077 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/collection1/'
[junit4:junit4] 2> 659956 T3077 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/collection1/lib/README' to classloader
[junit4:junit4] 2> 659956 T3077 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 659980 T3077 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 660010 T3077 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 660011 T3077 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 660016 T3077 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 660321 T3077 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 660326 T3077 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 660328 T3077 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 660339 T3077 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 660343 T3077 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 660348 T3077 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 660350 T3077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 660350 T3077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 660351 T3077 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 660352 T3077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 660352 T3077 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 660353 T3077 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 660353 T3077 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-controljetty-1370411730579/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/
[junit4:junit4] 2> 660354 T3077 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 660354 T3077 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 660355 T3077 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data
[junit4:junit4] 2> 660355 T3077 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index/
[junit4:junit4] 2> 660356 T3077 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 660357 T3077 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index
[junit4:junit4] 2> 660358 T3077 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@94559d1b lockFactory=org.apache.lucene.store.NativeFSLockFactory@3dc22f90),segFN=segments_1,generation=1}
[junit4:junit4] 2> 660359 T3077 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 660361 T3077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 660361 T3077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 660362 T3077 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 660363 T3077 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 660363 T3077 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 660364 T3077 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 660364 T3077 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 660365 T3077 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 660366 T3077 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 660367 T3077 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 660369 T3077 oass.SolrIndexSearcher.<init> Opening Searcher@eb86c97c main
[junit4:junit4] 2> 660370 T3077 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/tlog
[junit4:junit4] 2> 660371 T3077 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 660371 T3077 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 660375 T3078 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@eb86c97c main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 660376 T3077 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 660376 T3077 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 661454 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 661455 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 661456 T3075 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 661456 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 661461 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 662378 T3077 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 662379 T3077 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51682/yuf/v collection:control_collection shard:shard1
[junit4:junit4] 2> 662380 T3077 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 662384 T3077 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 662386 T3077 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 662386 T3077 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 662386 T3077 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51682/yuf/v/collection1/
[junit4:junit4] 2> 662387 T3077 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 662387 T3077 oasc.SyncStrategy.syncToMe http://127.0.0.1:51682/yuf/v/collection1/ has no replicas
[junit4:junit4] 2> 662388 T3077 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51682/yuf/v/collection1/
[junit4:junit4] 2> 662388 T3077 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 662965 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 662970 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 662993 T3077 oasc.ZkController.register We are http://127.0.0.1:51682/yuf/v/collection1/ and leader is http://127.0.0.1:51682/yuf/v/collection1/
[junit4:junit4] 2> 662993 T3077 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51682/yuf/v
[junit4:junit4] 2> 662994 T3077 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 662994 T3077 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 662994 T3077 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 662997 T3077 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 662998 T3052 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 662998 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 662999 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 663004 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 663007 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 663008 T3081 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b369da3 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 663008 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 663009 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 663012 T3052 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 663085 T3052 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 663090 T3052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
[junit4:junit4] 2> 663091 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 663091 T3052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 663092 T3052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819
[junit4:junit4] 2> 663092 T3052 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/solr.xml
[junit4:junit4] 2> 663093 T3052 oasc.CoreContainer.<init> New CoreContainer 1098941372
[junit4:junit4] 2> 663093 T3052 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/'
[junit4:junit4] 2> 663094 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/'
[junit4:junit4] 2> 663132 T3052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 663133 T3052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 663134 T3052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 663134 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 663135 T3052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 663135 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 663136 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 663136 T3052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 663137 T3052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 663138 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 663142 T3052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 663143 T3052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41252/solr
[junit4:junit4] 2> 663144 T3052 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 663146 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 663147 T3092 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@55d6eef8 name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 663148 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 663149 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 663155 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 663156 T3094 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2c2d3b43 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 663157 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 663160 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 664173 T3052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47550_yuf%2Fv
[junit4:junit4] 2> 664176 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:47550_yuf%2Fv
[junit4:junit4] 2> 664178 T3094 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 664178 T3074 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 664178 T3081 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 664178 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 664181 T3095 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/collection1
[junit4:junit4] 2> 664182 T3095 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 664183 T3095 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 664183 T3095 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 664184 T3095 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/collection1/'
[junit4:junit4] 2> 664185 T3095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/collection1/lib/README' to classloader
[junit4:junit4] 2> 664185 T3095 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 664210 T3095 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 664240 T3095 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 664242 T3095 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 664246 T3095 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 664475 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 664476 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 664478 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 664478 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 664482 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 664551 T3095 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 664555 T3095 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 664558 T3095 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 664568 T3095 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 664572 T3095 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 664576 T3095 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 664577 T3095 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 664577 T3095 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 664578 T3095 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 664579 T3095 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 664579 T3095 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 664579 T3095 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 664580 T3095 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/
[junit4:junit4] 2> 664580 T3095 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 664581 T3095 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 664582 T3095 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1
[junit4:junit4] 2> 664582 T3095 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index/
[junit4:junit4] 2> 664582 T3095 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 664583 T3095 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index
[junit4:junit4] 2> 664584 T3095 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e132cb2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@acfefa4d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 664585 T3095 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 664587 T3095 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 664587 T3095 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 664588 T3095 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 664588 T3095 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 664589 T3095 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 664589 T3095 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 664589 T3095 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 664590 T3095 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 664590 T3095 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 664592 T3095 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 664594 T3095 oass.SolrIndexSearcher.<init> Opening Searcher@40b4d43b main
[junit4:junit4] 2> 664594 T3095 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/tlog
[junit4:junit4] 2> 664595 T3095 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 664595 T3095 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 664599 T3096 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@40b4d43b main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 664600 T3095 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 664601 T3095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 665986 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 665988 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 665988 T3075 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 665989 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 665995 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 665995 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 665995 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 666602 T3095 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 666603 T3095 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:47550/yuf/v collection:collection1 shard:shard1
[junit4:junit4] 2> 666604 T3095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 666613 T3095 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 666617 T3095 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 666617 T3095 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 666618 T3095 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47550/yuf/v/collection1/
[junit4:junit4] 2> 666619 T3095 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 666619 T3095 oasc.SyncStrategy.syncToMe http://127.0.0.1:47550/yuf/v/collection1/ has no replicas
[junit4:junit4] 2> 666620 T3095 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47550/yuf/v/collection1/
[junit4:junit4] 2> 666621 T3095 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 667500 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 667505 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 667505 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 667505 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 667529 T3095 oasc.ZkController.register We are http://127.0.0.1:47550/yuf/v/collection1/ and leader is http://127.0.0.1:47550/yuf/v/collection1/
[junit4:junit4] 2> 667530 T3095 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:47550/yuf/v
[junit4:junit4] 2> 667530 T3095 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 667531 T3095 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 667531 T3095 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 667534 T3095 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 667535 T3052 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 667536 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 667537 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 667611 T3052 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 667617 T3052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
[junit4:junit4] 2> 667618 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 667618 T3052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 667619 T3052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351
[junit4:junit4] 2> 667619 T3052 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/solr.xml
[junit4:junit4] 2> 667620 T3052 oasc.CoreContainer.<init> New CoreContainer 882914814
[junit4:junit4] 2> 667620 T3052 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/'
[junit4:junit4] 2> 667621 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/'
[junit4:junit4] 2> 667659 T3052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 667660 T3052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 667660 T3052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 667661 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 667662 T3052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 667662 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 667663 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 667663 T3052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 667664 T3052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 667665 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 667670 T3052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 667670 T3052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41252/solr
[junit4:junit4] 2> 667671 T3052 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 667674 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 667676 T3108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32fca8b4 name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 667676 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 667677 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 667685 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 667686 T3110 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cf472909 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 667686 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 667689 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 668691 T3052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50373_yuf%2Fv
[junit4:junit4] 2> 668694 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50373_yuf%2Fv
[junit4:junit4] 2> 668697 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 668698 T3074 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 668698 T3094 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 668698 T3110 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 668698 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 668700 T3081 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 668699 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 668703 T3111 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/collection1
[junit4:junit4] 2> 668703 T3111 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 668704 T3111 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 668704 T3111 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 668705 T3111 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/collection1/'
[junit4:junit4] 2> 668706 T3111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/collection1/lib/README' to classloader
[junit4:junit4] 2> 668707 T3111 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 668742 T3111 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 668772 T3111 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 668773 T3111 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 668777 T3111 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 669009 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 669009 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 669012 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 669012 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 669012 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 669012 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 669094 T3111 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 669099 T3111 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 669101 T3111 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 669114 T3111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 669121 T3111 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 669125 T3111 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 669126 T3111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 669126 T3111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 669127 T3111 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 669128 T3111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 669128 T3111 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 669128 T3111 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 669129 T3111 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty2-1370411738351/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/
[junit4:junit4] 2> 669129 T3111 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 669130 T3111 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 669130 T3111 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2
[junit4:junit4] 2> 669131 T3111 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index/
[junit4:junit4] 2> 669131 T3111 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 669132 T3111 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index
[junit4:junit4] 2> 669133 T3111 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42129c81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fdda1546),segFN=segments_1,generation=1}
[junit4:junit4] 2> 669133 T3111 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 669135 T3111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 669136 T3111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 669136 T3111 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 669137 T3111 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 669137 T3111 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 669138 T3111 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 669138 T3111 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 669139 T3111 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 669139 T3111 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 669140 T3111 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 669142 T3111 oass.SolrIndexSearcher.<init> Opening Searcher@587722e1 main
[junit4:junit4] 2> 669143 T3111 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/tlog
[junit4:junit4] 2> 669143 T3111 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 669144 T3111 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 669148 T3112 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@587722e1 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 669150 T3111 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 669151 T3111 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 670516 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 670517 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 670518 T3075 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 670518 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 670523 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 670523 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 670523 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 670523 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 671152 T3111 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 671153 T3111 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:50373/yuf/v collection:collection1 shard:shard2
[junit4:junit4] 2> 671154 T3111 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 671159 T3111 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 671160 T3111 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 671161 T3111 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 671161 T3111 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:50373/yuf/v/collection1/
[junit4:junit4] 2> 671161 T3111 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 671162 T3111 oasc.SyncStrategy.syncToMe http://127.0.0.1:50373/yuf/v/collection1/ has no replicas
[junit4:junit4] 2> 671162 T3111 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:50373/yuf/v/collection1/
[junit4:junit4] 2> 671162 T3111 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 672029 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 672038 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 672038 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 672038 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 672038 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 672068 T3111 oasc.ZkController.register We are http://127.0.0.1:50373/yuf/v/collection1/ and leader is http://127.0.0.1:50373/yuf/v/collection1/
[junit4:junit4] 2> 672069 T3111 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:50373/yuf/v
[junit4:junit4] 2> 672069 T3111 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 672070 T3111 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 672071 T3111 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 672073 T3111 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 672074 T3052 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 672076 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 672077 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 672178 T3052 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 672183 T3052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
[junit4:junit4] 2> 672184 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 672184 T3052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 672185 T3052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894
[junit4:junit4] 2> 672186 T3052 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/solr.xml
[junit4:junit4] 2> 672186 T3052 oasc.CoreContainer.<init> New CoreContainer 1568612555
[junit4:junit4] 2> 672187 T3052 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/'
[junit4:junit4] 2> 672187 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/'
[junit4:junit4] 2> 672228 T3052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 672229 T3052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 672230 T3052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 672230 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 672231 T3052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 672232 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 672232 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 672233 T3052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 672233 T3052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 672234 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 672239 T3052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 672240 T3052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41252/solr
[junit4:junit4] 2> 672240 T3052 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 672243 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672244 T3124 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ff793c95 name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 672244 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 672246 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 672252 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 672253 T3126 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1e7bc388 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 672253 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 672256 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 673259 T3052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40781_yuf%2Fv
[junit4:junit4] 2> 673261 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:40781_yuf%2Fv
[junit4:junit4] 2> 673263 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 673263 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 673264 T3126 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 673265 T3094 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 673265 T3074 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 673265 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673265 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673265 T3081 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 673266 T3110 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 673269 T3127 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/collection1
[junit4:junit4] 2> 673269 T3127 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 673270 T3127 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 673270 T3127 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 673271 T3127 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/collection1/'
[junit4:junit4] 2> 673272 T3127 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/collection1/lib/README' to classloader
[junit4:junit4] 2> 673273 T3127 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 673351 T3127 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 673382 T3127 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 673384 T3127 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 673389 T3127 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 673544 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 673545 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 673548 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673548 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673548 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673549 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673548 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 673705 T3127 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 673711 T3127 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 673713 T3127 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 673727 T3127 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 673732 T3127 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 673737 T3127 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 673739 T3127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 673740 T3127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 673740 T3127 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 673742 T3127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 673742 T3127 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 673743 T3127 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 673743 T3127 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty3-1370411742894/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/
[junit4:junit4] 2> 673744 T3127 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 673745 T3127 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 673746 T3127 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3
[junit4:junit4] 2> 673747 T3127 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index/
[junit4:junit4] 2> 673748 T3127 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 673749 T3127 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index
[junit4:junit4] 2> 673751 T3127 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39cac026 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4653a9a3),segFN=segments_1,generation=1}
[junit4:junit4] 2> 673752 T3127 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 673755 T3127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 673756 T3127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 673757 T3127 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 673758 T3127 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 673759 T3127 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 673760 T3127 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 673761 T3127 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 673762 T3127 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 673762 T3127 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 673764 T3127 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 673766 T3127 oass.SolrIndexSearcher.<init> Opening Searcher@726ee289 main
[junit4:junit4] 2> 673766 T3127 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/tlog
[junit4:junit4] 2> 673767 T3127 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 673767 T3127 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 673774 T3128 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@726ee289 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 673776 T3127 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 673777 T3127 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 675053 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 675054 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 675055 T3075 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 675056 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 675060 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 675060 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 675060 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 675061 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 675060 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 675780 T3127 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 675781 T3127 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:40781/yuf/v collection:collection1 shard:shard1
[junit4:junit4] 2> 675806 T3127 oasc.ZkController.register We are http://127.0.0.1:40781/yuf/v/collection1/ and leader is http://127.0.0.1:47550/yuf/v/collection1/
[junit4:junit4] 2> 675806 T3127 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:40781/yuf/v
[junit4:junit4] 2> 675807 T3127 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 675807 T3127 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C955 name=collection1 org.apache.solr.core.SolrCore@ad115204 url=http://127.0.0.1:40781/yuf/v/collection1 node=127.0.0.1:40781_yuf%2Fv C955_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:40781/yuf/v, state=down, node_name=127.0.0.1:40781_yuf%2Fv, collection=collection1, core=collection1}
[junit4:junit4] 2> 675808 T3129 C955 P40781 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 675809 T3127 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 675809 T3129 C955 P40781 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 675811 T3129 C955 P40781 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 675811 T3129 C955 P40781 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 675811 T3052 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 675813 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 675814 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 675823 T3129 C955 P40781 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 675828 T3089 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 675887 T3052 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 675892 T3052 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:?????
[junit4:junit4] 2> 675893 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 675893 T3052 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 675894 T3052 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630
[junit4:junit4] 2> 675894 T3052 oasc.CoreContainer$Initializer.initialize looking for solr config file: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/solr.xml
[junit4:junit4] 2> 675895 T3052 oasc.CoreContainer.<init> New CoreContainer 1460132615
[junit4:junit4] 2> 675896 T3052 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/'
[junit4:junit4] 2> 675896 T3052 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/'
[junit4:junit4] 2> 675937 T3052 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 675938 T3052 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 675938 T3052 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 675939 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 675939 T3052 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 675940 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 675940 T3052 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 675941 T3052 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 675942 T3052 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 675942 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 675947 T3052 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 675948 T3052 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41252/solr
[junit4:junit4] 2> 675948 T3052 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 675951 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 675952 T3141 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@9a488718 name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 675953 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 675954 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 675960 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 675961 T3143 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@fa4cd6d5 name:ZooKeeperConnection Watcher:127.0.0.1:41252/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 675962 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 675966 T3052 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 676564 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 676565 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 676663 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676663 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676663 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676663 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676663 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676663 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676829 T3089 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 676829 T3089 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=4&wt=javabin&nodeName=127.0.0.1:40781_yuf%252Fv&core=collection1} status=0 QTime=1001
[junit4:junit4] 2> 676968 T3052 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60986_yuf%2Fv
[junit4:junit4] 2> 676970 T3052 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:60986_yuf%2Fv
[junit4:junit4] 2> 676972 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676972 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676973 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676973 T3094 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676973 T3110 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676973 T3074 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676974 T3126 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676973 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 676975 T3143 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676975 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 676974 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 676978 T3144 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/collection1
[junit4:junit4] 2> 676978 T3081 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 676978 T3144 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 676979 T3144 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 676980 T3144 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 676980 T3144 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/collection1/'
[junit4:junit4] 2> 676981 T3144 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/collection1/lib/README' to classloader
[junit4:junit4] 2> 676981 T3144 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 677005 T3144 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 677043 T3144 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 677045 T3144 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 677049 T3144 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 677373 T3144 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> 677378 T3144 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 677380 T3144 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 677390 T3144 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 677393 T3144 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 677397 T3144 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 677397 T3144 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 677398 T3144 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 677398 T3144 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 677399 T3144 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 677399 T3144 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 677400 T3144 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 677400 T3144 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty4-1370411746630/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/
[junit4:junit4] 2> 677400 T3144 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 677401 T3144 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 677402 T3144 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4
[junit4:junit4] 2> 677402 T3144 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index/
[junit4:junit4] 2> 677402 T3144 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 677403 T3144 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index
[junit4:junit4] 2> 677404 T3144 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6fa51399 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef8ed41b),segFN=segments_1,generation=1}
[junit4:junit4] 2> 677405 T3144 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 677406 T3144 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 677406 T3144 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 677407 T3144 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 677408 T3144 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 677408 T3144 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 677408 T3144 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 677409 T3144 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 677409 T3144 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 677410 T3144 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 677411 T3144 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 677414 T3144 oass.SolrIndexSearcher.<init> Opening Searcher@b53a4016 main
[junit4:junit4] 2> 677414 T3144 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/tlog
[junit4:junit4] 2> 677415 T3144 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 677415 T3144 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 677419 T3145 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b53a4016 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 677420 T3144 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 677420 T3144 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 678167 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 678167 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60986/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:60986_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 678168 T3075 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 678168 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 678171 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678171 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678171 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678171 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678171 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678171 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 678421 T3144 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 678422 T3144 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:60986/yuf/v collection:collection1 shard:shard2
[junit4:junit4] 2> 678424 T3144 oasc.ZkController.register We are http://127.0.0.1:60986/yuf/v/collection1/ and leader is http://127.0.0.1:50373/yuf/v/collection1/
[junit4:junit4] 2> 678425 T3144 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60986/yuf/v
[junit4:junit4] 2> 678425 T3144 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 678425 T3144 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C956 name=collection1 org.apache.solr.core.SolrCore@223abfa2 url=http://127.0.0.1:60986/yuf/v/collection1 node=127.0.0.1:60986_yuf%2Fv C956_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:60986/yuf/v, state=down, node_name=127.0.0.1:60986_yuf%2Fv, collection=collection1, core=collection1}
[junit4:junit4] 2> 678426 T3146 C956 P60986 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 678426 T3144 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 678426 T3146 C956 P60986 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 678427 T3146 C956 P60986 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 678427 T3146 C956 P60986 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 678427 T3052 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
[junit4:junit4] 2> 678428 T3052 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 678428 T3146 C956 P60986 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 678429 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 678433 T3052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 678434 T3104 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 678434 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 678440 T3089 oasc.CoreContainer.create Creating SolrCore 'onenodecollectioncore' using instanceDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/onenodecollectioncore
[junit4:junit4] 2> 678441 T3089 oasc.ZkController.createCollectionZkNode Check for collection zkNode:onenodecollection
[junit4:junit4] 2> 678442 T3089 oasc.ZkController.createCollectionZkNode Creating collection in ZooKeeper:onenodecollection
[junit4:junit4] 2> 678442 T3089 oasc.ZkController.getConfName Looking for collection configName
[junit4:junit4] 2> 678443 T3089 oasc.ZkController.getConfName Only one config set found in zk - using it:conf1
[junit4:junit4] 2> 678444 T3089 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection
[junit4:junit4] 2> 678445 T3089 oasc.ZkController.readConfigName Load collection config from:/collections/onenodecollection
[junit4:junit4] 2> 678447 T3089 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/onenodecollectioncore/'
[junit4:junit4] 2> 678470 T3089 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 678500 T3089 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 678502 T3089 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 678506 T3089 oass.IndexSchema.readSchema [onenodecollectioncore] Schema name=test
[junit4:junit4] 2> 678830 T3089 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4:junit4] 2> ASYNC NEW_CORE C957 name=collection1 org.apache.solr.core.SolrCore@ad115204 url=http://127.0.0.1:40781/yuf/v/collection1 node=127.0.0.1:40781_yuf%2Fv C957_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:40781/yuf/v, state=recovering, node_name=127.0.0.1:40781_yuf%2Fv, collection=collection1, shard=shard1, core=collection1}
[junit4:junit4] 2> 678830 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:47550/yuf/v/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 678831 T3129 C957 P40781 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:40781/yuf/v START replicas=[http://127.0.0.1:47550/yuf/v/collection1/] nUpdates=100
[junit4:junit4] 2> 678831 T3129 C957 P40781 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 678832 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 678832 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 678832 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 678832 T3129 C957 P40781 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 678833 T3129 C957 P40781 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:47550/yuf/v/collection1/. core=collection1
[junit4:junit4] 2> 678833 T3129 C957 P40781 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C958 name=collection1 org.apache.solr.core.SolrCore@b780d6c4 url=http://127.0.0.1:47550/yuf/v/collection1 node=127.0.0.1:47550_yuf%2Fv C958_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:47550/yuf/v, state=active, node_name=127.0.0.1:47550_yuf%2Fv, collection=collection1, shard=shard1, core=collection1, leader=true}
[junit4:junit4] 2> 678836 T3090 C958 P47550 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 678836 T3089 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 678838 T3088 C958 P47550 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 678839 T3089 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 678839 T3088 C958 P47550 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e132cb2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@acfefa4d),segFN=segments_1,generation=1}
[junit4:junit4] 2> 678841 T3088 C958 P47550 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 678841 T3088 C958 P47550 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e132cb2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@acfefa4d),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@e132cb2 lockFactory=org.apache.lucene.store.NativeFSLockFactory@acfefa4d),segFN=segments_2,generation=2}
[junit4:junit4] 2> 678842 T3088 C958 P47550 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 678843 T3088 C958 P47550 oass.SolrIndexSearcher.<init> Opening Searcher@44c8b9ee realtime
[junit4:junit4] 2> 678843 T3088 C958 P47550 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 678844 T3088 C958 P47550 oasup.LogUpdateProcessor.finish [collection1] webapp=/yuf/v path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 6
[junit4:junit4] 2> 678845 T3129 C957 P40781 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 678845 T3129 C957 P40781 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 678846 T3087 C958 P47550 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 678847 T3087 C958 P47550 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 678848 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 678849 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 678849 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 678850 T3089 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 678851 T3088 C958 P47550 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=0
[junit4:junit4] 2> 678852 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 678852 T3129 C957 P40781 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index.20130605165549659
[junit4:junit4] 2> 678852 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@e9838002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@149d815e) fullCopy=false
[junit4:junit4] 2> 678854 T3090 C958 P47550 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 678854 T3089 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 678855 T3129 C957 P40781 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 678856 T3129 C957 P40781 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 678856 T3129 C957 P40781 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 678857 T3129 C957 P40781 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39cac026 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4653a9a3),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@39cac026 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4653a9a3),segFN=segments_2,generation=2}
[junit4:junit4] 2> 678857 T3129 C957 P40781 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 678858 T3129 C957 P40781 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 678858 T3129 C957 P40781 oass.SolrIndexSearcher.<init> Opening Searcher@a792d9f6 main
[junit4:junit4] 2> 678859 T3128 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@a792d9f6 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 678859 T3129 C957 P40781 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index.20130605165549659 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index.20130605165549659;done=true>>]
[junit4:junit4] 2> 678860 T3129 C957 P40781 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index.20130605165549659
[junit4:junit4] 2> 678860 T3129 C957 P40781 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index.20130605165549659
[junit4:junit4] 2> 678860 T3089 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 678860 T3129 C957 P40781 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 678861 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 678862 T3129 C957 P40781 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 678862 T3129 C957 P40781 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 678862 T3089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 678863 T3089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 678863 T3129 C957 P40781 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 678863 T3089 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4:junit4] 2> 678865 T3089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4:junit4] 2> 678865 T3089 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4:junit4] 2> 678866 T3089 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 678867 T3089 oasc.SolrCore.<init> [onenodecollectioncore] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZk2Test-jetty1-1370411733819/onenodecollectioncore/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/
[junit4:junit4] 2> 678867 T3089 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5cc50aa0
[junit4:junit4] 2> 678868 T3089 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 678869 T3089 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection
[junit4:junit4] 2> 678870 T3089 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index/
[junit4:junit4] 2> 678870 T3089 oasc.SolrCore.initIndex WARN [onenodecollectioncore] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 678871 T3089 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index
[junit4:junit4] 2> 678873 T3089 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@4bb05537 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4ed8aaa),segFN=segments_1,generation=1}
[junit4:junit4] 2> 678874 T3089 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 678876 T3089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 678877 T3089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 678877 T3089 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 678878 T3089 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 678879 T3089 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 678880 T3089 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 678880 T3089 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 678881 T3089 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 678882 T3089 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 678883 T3089 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 678885 T3089 oass.SolrIndexSearcher.<init> Opening Searcher@3d004d8e main
[junit4:junit4] 2> 678886 T3089 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/tlog
[junit4:junit4] 2> 678887 T3089 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 678888 T3089 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 678891 T3150 oasc.SolrCore.registerSearcher [onenodecollectioncore] Registered new searcher Searcher@3d004d8e main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 678893 T3089 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 679674 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 679675 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60986/yuf/v",
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:60986_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 679678 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 679680 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 679680 T3075 oasc.Overseer$ClusterStateUpdater.createCollection Create collection onenodecollection with numShards 1
[junit4:junit4] 2> 679680 T3075 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 679783 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679783 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679783 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679783 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679783 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679783 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 679894 T3089 oasc.CoreContainer.registerCore registering core: onenodecollectioncore
[junit4:junit4] 2> 679895 T3089 oasc.ZkController.register Register replica - core:onenodecollectioncore address:http://127.0.0.1:47550/yuf/v collection:onenodecollection shard:shard1
[junit4:junit4] 2> 679896 T3089 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leader_elect/shard1/election
[junit4:junit4] 2> 679900 T3089 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 679902 T3089 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 679902 T3089 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 679903 T3089 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:47550/yuf/v/onenodecollectioncore/
[junit4:junit4] 2> 679903 T3089 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 679904 T3089 oasc.SyncStrategy.syncToMe http://127.0.0.1:47550/yuf/v/onenodecollectioncore/ has no replicas
[junit4:junit4] 2> 679904 T3089 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:47550/yuf/v/onenodecollectioncore/
[junit4:junit4] 2> 679905 T3089 oascc.SolrZkClient.makePath makePath: /collections/onenodecollection/leaders/shard1
[junit4:junit4] 2> 680435 T3104 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 680436 T3104 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={state=recovering&onlyIfLeader=true&checkLive=true&action=PREPRECOVERY&version=2&coreNodeName=5&wt=javabin&nodeName=127.0.0.1:60986_yuf%252Fv&core=collection1} status=0 QTime=2002
[junit4:junit4] 2> 681288 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 681318 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681318 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681319 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681319 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681318 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681318 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 681364 T3089 oasc.ZkController.register We are http://127.0.0.1:47550/yuf/v/onenodecollectioncore/ and leader is http://127.0.0.1:47550/yuf/v/onenodecollectioncore/
[junit4:junit4] 2> 681364 T3089 oasc.ZkController.register No LogReplay needed for core=onenodecollectioncore baseURL=http://127.0.0.1:47550/yuf/v
[junit4:junit4] 2> 681365 T3089 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 681366 T3089 oasc.ZkController.publish publishing core=onenodecollectioncore state=active
[junit4:junit4] 2> 681367 T3089 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 681368 T3089 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection&action=CREATE&version=2&numShards=1&name=onenodecollectioncore&wt=javabin&roles=none&collection=onenodecollection} status=0 QTime=2928
[junit4:junit4] 2> 681369 T3052 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: onenodecollection failOnTimeout:true timeout (sec):230
[junit4:junit4] 2> 681370 T3052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682372 T3052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> ASYNC NEW_CORE C959 name=collection1 org.apache.solr.core.SolrCore@223abfa2 url=http://127.0.0.1:60986/yuf/v/collection1 node=127.0.0.1:60986_yuf%2Fv C959_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:60986/yuf/v, state=recovering, node_name=127.0.0.1:60986_yuf%2Fv, collection=collection1, shard=shard2, core=collection1}
[junit4:junit4] 2> 682437 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:50373/yuf/v/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 682438 T3146 C959 P60986 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60986/yuf/v START replicas=[http://127.0.0.1:50373/yuf/v/collection1/] nUpdates=100
[junit4:junit4] 2> 682438 T3146 C959 P60986 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 682438 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 682439 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 682439 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 682439 T3146 C959 P60986 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 682440 T3146 C959 P60986 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:50373/yuf/v/collection1/. core=collection1
[junit4:junit4] 2> 682440 T3146 C959 P60986 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C960 name=collection1 org.apache.solr.core.SolrCore@8c35287 url=http://127.0.0.1:50373/yuf/v/collection1 node=127.0.0.1:50373_yuf%2Fv C960_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:50373/yuf/v, state=active, node_name=127.0.0.1:50373_yuf%2Fv, collection=collection1, shard=shard2, core=collection1, leader=true}
[junit4:junit4] 2> 682446 T3103 C960 P50373 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/get params={getVersions=100&qt=/get&distrib=false&version=2&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 682450 T3104 C960 P50373 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 682452 T3104 C960 P50373 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42129c81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fdda1546),segFN=segments_1,generation=1}
[junit4:junit4] 2> 682452 T3104 C960 P50373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 682453 T3104 C960 P50373 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42129c81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fdda1546),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@42129c81 lockFactory=org.apache.lucene.store.NativeFSLockFactory@fdda1546),segFN=segments_2,generation=2}
[junit4:junit4] 2> 682454 T3104 C960 P50373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 682455 T3104 C960 P50373 oass.SolrIndexSearcher.<init> Opening Searcher@fea59d69 realtime
[junit4:junit4] 2> 682456 T3104 C960 P50373 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 682456 T3104 C960 P50373 oasup.LogUpdateProcessor.finish [collection1] webapp=/yuf/v path=/update params={softCommit=false&commit_end_point=true&commit=true&version=2&waitSearcher=true&wt=javabin&openSearcher=false} {commit=} 0 6
[junit4:junit4] 2> 682457 T3146 C959 P60986 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 682457 T3146 C959 P60986 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 682459 T3103 C960 P50373 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 682460 T3103 C960 P50373 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={qt=/replication&version=2&command=indexversion&wt=javabin} status=0 QTime=2
[junit4:junit4] 2> 682460 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 682460 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 682461 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 682463 T3106 C960 P50373 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={qt=/replication&version=2&generation=2&command=filelist&wt=javabin} status=0 QTime=1
[junit4:junit4] 2> 682463 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 682464 T3146 C959 P60986 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index.20130605165553271
[junit4:junit4] 2> 682464 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@8f440d9c lockFactory=org.apache.lucene.store.NativeFSLockFactory@e13eb384) fullCopy=false
[junit4:junit4] 2> 682466 T3104 C960 P50373 oasc.SolrCore.execute [collection1] webapp=/yuf/v path=/replication params={checksum=true&qt=/replication&generation=2&command=filecontent&file=segments_2&wt=filestream} status=0 QTime=0
[junit4:junit4] 2> 682467 T3146 C959 P60986 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 682468 T3146 C959 P60986 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 682468 T3146 C959 P60986 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 682469 T3146 C959 P60986 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6fa51399 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef8ed41b),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6fa51399 lockFactory=org.apache.lucene.store.NativeFSLockFactory@ef8ed41b),segFN=segments_2,generation=2}
[junit4:junit4] 2> 682470 T3146 C959 P60986 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 682470 T3146 C959 P60986 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 682470 T3146 C959 P60986 oass.SolrIndexSearcher.<init> Opening Searcher@e2699f41 main
[junit4:junit4] 2> 682471 T3145 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@e2699f41 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 682472 T3146 C959 P60986 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index.20130605165553271 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index.20130605165553271;done=true>>]
[junit4:junit4] 2> 682472 T3146 C959 P60986 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index.20130605165553271
[junit4:junit4] 2> 682472 T3146 C959 P60986 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index.20130605165553271
[junit4:junit4] 2> 682472 T3146 C959 P60986 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 682473 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 682473 T3146 C959 P60986 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 682473 T3146 C959 P60986 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 682475 T3146 C959 P60986 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 682824 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 682825 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47550_yuf%2Fv_onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 682828 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:60986/yuf/v",
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "node_name":"127.0.0.1:60986_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 682831 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682831 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682831 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682832 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682831 T3081 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 682831 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 683373 T3052 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 683374 T3052 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: onenodecollection
[junit4:junit4] 2> 683375 T3052 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 683384 T3052 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 683385 T3154 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30eeb15d name:ZooKeeperConnection Watcher:127.0.0.1:41252 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 683386 T3052 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 683428 T3052 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 51682
[junit4:junit4] 2> 683428 T3052 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=-1500701346
[junit4:junit4] 2> 684337 T3075 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 684338 T3075 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 684342 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684343 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684342 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684343 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 684342 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685430 T3052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 685431 T3052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 685433 T3052 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@c1f41ee0
[junit4:junit4] 2> 685441 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 685442 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 685443 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 685443 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 685444 T3052 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 685444 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 685445 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index;done=false>>]
[junit4:junit4] 2> 685445 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data/index
[junit4:junit4] 2> 685446 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data;done=false>>]
[junit4:junit4] 2> 685447 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/control/data
[junit4:junit4] 2> 685448 T3075 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89811303165394947-127.0.0.1:51682_yuf%2Fv-n_0000000000) am no longer a leader.
[junit4:junit4] 2> 685449 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685449 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685449 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685449 T3074 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 685450 T3126 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 685450 T3074 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 685451 T3110 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 685451 T3143 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 685451 T3074 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 685454 T3094 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 685456 T3094 oasc.Overseer.start Overseer (id=89811303165394950-127.0.0.1:47550_yuf%2Fv-n_0000000001) starting
[junit4:junit4] 2> 685459 T3094 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 685460 T3156 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 685460 T3155 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 685460 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 685461 T3155 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 685462 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 685465 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 685465 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 685465 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 685467 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 685469 T3052 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/yuf/v,null}
[junit4:junit4] 2> 685522 T3052 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 47550
[junit4:junit4] 2> 685524 T3052 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1098941372
[junit4:junit4] 2> 686969 T3155 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 686971 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47550_yuf%2Fv_onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 686975 T3155 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 686982 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 686983 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 686983 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 686982 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 688527 T3052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 688528 T3052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 688531 T3052 oasc.ZkController.publish publishing core=onenodecollectioncore state=down
[junit4:junit4] 2> 688533 T3052 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@b780d6c4
[junit4:junit4] 2> 688541 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 688542 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 688544 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 688545 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 688548 T3052 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 688549 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 688550 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index;done=false>>]
[junit4:junit4] 2> 688552 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1/index
[junit4:junit4] 2> 688554 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1;done=false>>]
[junit4:junit4] 2> 688555 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty1
[junit4:junit4] 2> 688556 T3052 oasc.SolrCore.close [onenodecollectioncore] CLOSING SolrCore org.apache.solr.core.SolrCore@df01af5c
[junit4:junit4] 2> 688564 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 688565 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 688565 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 688566 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 688567 T3052 oasc.SolrCore.closeSearcher [onenodecollectioncore] Closing main searcher on request.
[junit4:junit4] 2> 688567 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 688568 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection;done=false>>]
[junit4:junit4] 2> 688569 T3052 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection
[junit4:junit4] 2> 688569 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index;done=false>>]
[junit4:junit4] 2> 688570 T3052 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZk2Test-1370411730425/onenodecollection/index
[junit4:junit4] 2> 688571 T3155 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89811303165394950-127.0.0.1:47550_yuf%2Fv-n_0000000001) am no longer a leader.
[junit4:junit4] 2> 688571 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 688572 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 688572 T3094 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 688573 T3094 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 688573 T3094 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 688573 T3143 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 688573 T3110 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 688574 T3126 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 688576 T3126 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 688576 T3110 oasc.Overseer.start Overseer (id=89811303165394952-127.0.0.1:50373_yuf%2Fv-n_0000000002) starting
[junit4:junit4] 2> 688578 T3126 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 688578 T3126 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 688579 T3126 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 688579 T3126 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:40781/yuf/v/collection1/
[junit4:junit4] 2> 688579 T3126 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 688580 T3126 oasc.SyncStrategy.syncToMe http://127.0.0.1:40781/yuf/v/collection1/ has no replicas
[junit4:junit4] 2> 688580 T3126 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:40781/yuf/v/collection1/
[junit4:junit4] 2> 688580 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 688580 T3158 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 688580 T3126 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 688582 T3110 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 688583 T3157 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 688584 T3157 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 688585 T3052 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/yuf/v,null}
[junit4:junit4] 2> 688586 T3157 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 688589 T3157 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"127.0.0.1:47550_yuf%2Fv_onenodecollectioncore",
[junit4:junit4] 2> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":"none",
[junit4:junit4] 2> "collection":"onenodecollection",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"onenodecollectioncore"}
[junit4:junit4] 2> 688598 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 688598 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 688598 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 688636 T3052 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 50373
[junit4:junit4] 2> 688637 T3052 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=882914814
[junit4:junit4] 2> 689639 T3052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 689640 T3052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 689641 T3052 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@8c35287
[junit4:junit4] 2> 689645 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 689645 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 689646 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 689647 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 689648 T3052 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 689648 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 689649 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2;done=false>>]
[junit4:junit4] 2> 689649 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2
[junit4:junit4] 2> 689650 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index;done=false>>]
[junit4:junit4] 2> 689650 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty2/index
[junit4:junit4] 2> 689651 T3157 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89811303165394952-127.0.0.1:50373_yuf%2Fv-n_0000000002) am no longer a leader.
[junit4:junit4] 2> 689652 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 689652 T3110 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 689653 T3110 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 689653 T3143 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 689653 T3110 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 689654 T3126 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 689655 T3143 oasc.ShardLeaderElectionContext.shouldIBeLeader Checking if I should try and be the leader.
[junit4:junit4] 2> 689655 T3126 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 689655 T3143 oasc.ShardLeaderElectionContext.shouldIBeLeader My last published State was Active, it's okay to be the leader.
[junit4:junit4] 2> 689656 T3143 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 689656 T3143 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:60986/yuf/v/collection1/
[junit4:junit4] 2> 689657 T3126 oasc.Overseer.start Overseer (id=89811303165394954-127.0.0.1:40781_yuf%2Fv-n_0000000003) starting
[junit4:junit4] 2> 689657 T3143 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60986/yuf/v START replicas=[http://127.0.0.1:50373/yuf/v/collection1/] nUpdates=100
[junit4:junit4] 2> 689657 T3143 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:60986/yuf/v DONE. We have no versions. sync failed.
[junit4:junit4] 2> 689658 T3143 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next canidate
[junit4:junit4] 2> 689659 T3143 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4:junit4] 2> 689659 T3143 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:60986/yuf/v/collection1/
[junit4:junit4] 2> 689659 T3143 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 689660 T3161 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 689660 T3160 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 689662 T3160 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 689663 T3160 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 689664 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 689665 T3052 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/yuf/v,null}
[junit4:junit4] 2> 689665 T3143 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 689668 T3160 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 689675 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 689676 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 689716 T3052 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 40781
[junit4:junit4] 2> 689717 T3052 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1568612555
[junit4:junit4] 2> 690719 T3052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 690719 T3052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 690722 T3052 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@ad115204
[junit4:junit4] 2> 690726 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 690727 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 690728 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 690729 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 690730 T3052 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 690730 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 690731 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index;done=false>>]
[junit4:junit4] 2> 690732 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3/index
[junit4:junit4] 2> 690732 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3;done=false>>]
[junit4:junit4] 2> 690733 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty3
[junit4:junit4] 2> 690734 T3160 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89811303165394954-127.0.0.1:40781_yuf%2Fv-n_0000000003) am no longer a leader.
[junit4:junit4] 2> 690734 T3126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 690735 T3126 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 690735 T3126 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 690735 T3143 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 690737 T3143 oasc.Overseer.start Overseer (id=89811303165394956-127.0.0.1:60986_yuf%2Fv-n_0000000004) starting
[junit4:junit4] 2> 690740 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 690740 T3163 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 690742 T3162 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 690742 T3143 oascc.ZkStateReader$3.process Updating live nodes... (1)
[junit4:junit4] 2> 690744 T3162 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 690744 T3162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=null message={
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 690747 T3162 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "core":"collection1"}
[junit4:junit4] 2> 690750 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 690755 T3052 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/yuf/v,null}
[junit4:junit4] 2> 690807 T3052 oasc.ChaosMonkey.monkeyLog monkey: stop shard! 60986
[junit4:junit4] 2> 690808 T3052 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=1460132615
[junit4:junit4] 2> 691809 T3052 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 691810 T3052 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 691812 T3052 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@223abfa2
[junit4:junit4] 2> 691818 T3052 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 691818 T3052 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 691819 T3052 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 691819 T3052 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 691820 T3052 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 691821 T3052 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 691821 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4;done=false>>]
[junit4:junit4] 2> 691822 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4
[junit4:junit4] 2> 691823 T3052 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index;done=false>>]
[junit4:junit4] 2> 691823 T3052 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.BasicDistributedZk2Test-1370411730425/jetty4/index
[junit4:junit4] 2> 691824 T3162 oasc.Overseer$ClusterStateUpdater.amILeader According to ZK I (id=89811303165394956-127.0.0.1:60986_yuf%2Fv-n_0000000004) am no longer a leader.
[junit4:junit4] 2> 691825 T3143 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 691825 T3143 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 691825 T3143 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 691845 T3052 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/yuf/v,null}
[junit4:junit4] 2> 691902 T3052 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
[junit4:junit4] 2> 691903 T3052 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41252 41252
[junit4:junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4:junit4] 1> / (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr (7)
[junit4:junit4] 1> /solr/configs (1)
[junit4:junit4] 1> /solr/configs/conf1 (9)
[junit4:junit4] 1> /solr/configs/conf1/old_synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/protwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/stopwords.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/synonyms.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/schema.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/currency.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/open-exchange-rates.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "disclaimer": "This data is not real, it was synthetically created to match currency.xml. It is modeled after the data format available from openexchangerates.org. See https://openexchangerates.org/documentation for details",
[junit4:junit4] 1> "license": "http://www.apache.org/licenses/LICENSE-2.0",
[junit4:junit4] 1> "timestamp": 1332070464,
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "IMPORTANT NOTE": "In order for tests to work, this data must be kept in sync with ./currency.xml",
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 1> "base": "USD",
[junit4:junit4] 1> "rates": {
[junit4:junit4] 1> "USD": 1,
[junit4:junit4] 1> "JPY": 81.29,
[junit4:junit4] 1> "EUR": 2.5,
[junit4:junit4] 1> "GBP": 0.5,
[junit4:junit4] 1> "MXN": 2.0
[junit4:junit4] 1> }
[junit4:junit4] 1> }
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/configs/conf1/solrconfig.xml (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/configs/conf1/mapping-ISOLatin1Accent.txt (0)
[junit4:junit4] 1> DATA: ...supressed...
[junit4:junit4] 1> /solr/overseer (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1> /solr/overseer/queue (0)
[junit4:junit4] 1> /solr/overseer/collection-queue-work (0)
[junit4:junit4] 1> /solr/overseer/queue-work (0)
[junit4:junit4] 1> /solr/overseer_elect (2)
[junit4:junit4] 1> /solr/overseer_elect/leader (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"id":"89811303165394947-127.0.0.1:51682_yuf%2Fv-n_0000000000"}
[junit4:junit4] 1> /solr/overseer_elect/election (5)
[junit4:junit4] 1> /solr/overseer_elect/election/89811303165394956-127.0.0.1:60986_yuf%2Fv-n_0000000004 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89811303165394954-127.0.0.1:40781_yuf%2Fv-n_0000000003 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89811303165394952-127.0.0.1:50373_yuf%2Fv-n_0000000002 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89811303165394950-127.0.0.1:47550_yuf%2Fv-n_0000000001 (0)
[junit4:junit4] 1> /solr/overseer_elect/election/89811303165394947-127.0.0.1:51682_yuf%2Fv-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections (3)
[junit4:junit4] 1> /solr/collections/control_collection (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/control_collection/leader_elect/shard1/election/89811303165394947-1-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/control_collection/leaders (1)
[junit4:junit4] 1> /solr/collections/control_collection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 1> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/control_collection/shards (0)
[junit4:junit4] 1> /solr/collections/collection1 (3)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {"configName":"conf1"}
[junit4:junit4] 1> /solr/collections/collection1/leader_elect (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89811303165394950-2-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard1/election/89811303165394954-4-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2 (1)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election (2)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89811303165394956-5-n_0000000001 (0)
[junit4:junit4] 1> /solr/collections/collection1/leader_elect/shard2/election/89811303165394952-3-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/collection1/leaders (2)
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 1> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/collection1/leaders/shard2 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 1> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 1> "core":"collection1"}
[junit4:junit4] 1> /solr/collections/collection1/shards (0)
[junit4:junit4] 1> /solr/collections/onenodecollection (2)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "router":"compositeId",
[junit4:junit4] 1> "configName":"conf1"}
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1 (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leader_elect/shard1/election/89811303165394950-127.0.0.1:47550_yuf%2Fv_onenodecollectioncore-n_0000000000 (0)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders (1)
[junit4:junit4] 1> /solr/collections/onenodecollection/leaders/shard1 (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 1> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 1> "core":"onenodecollectioncore"}
[junit4:junit4] 1> /solr/aliases.json (0)
[junit4:junit4] 1> /solr/live_nodes (5)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:60986_yuf%2Fv (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:47550_yuf%2Fv (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:40781_yuf%2Fv (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:50373_yuf%2Fv (0)
[junit4:junit4] 1> /solr/live_nodes/127.0.0.1:51682_yuf%2Fv (0)
[junit4:junit4] 1> /solr/clusterstate.json (0)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1> {
[junit4:junit4] 1> "control_collection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"1":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:51682/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:51682_yuf%2Fv",
[junit4:junit4] 1> "collection":"control_collection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "onenodecollection":{
[junit4:junit4] 1> "shards":{"shard1":{
[junit4:junit4] 1> "range":"80000000-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{"127.0.0.1:47550_yuf%2Fv_onenodecollectioncore":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 1> "roles":"none",
[junit4:junit4] 1> "collection":"onenodecollection",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"onenodecollectioncore",
[junit4:junit4] 1> "leader":"true"}}}},
[junit4:junit4] 1> "router":"compositeId"},
[junit4:junit4] 1> "collection1":{
[junit4:junit4] 1> "shards":{
[junit4:junit4] 1> "shard1":{
[junit4:junit4] 1> "range":"80000000-ffffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "2":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:47550/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:47550_yuf%2Fv",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "4":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:40781/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:40781_yuf%2Fv",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard1",
[junit4:junit4] 1> "core":"collection1"}}},
[junit4:junit4] 1> "shard2":{
[junit4:junit4] 1> "range":"0-7fffffff",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "replicas":{
[junit4:junit4] 1> "3":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:50373/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:50373_yuf%2Fv",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1",
[junit4:junit4] 1> "leader":"true"},
[junit4:junit4] 1> "5":{
[junit4:junit4] 1> "base_url":"http://127.0.0.1:60986/yuf/v",
[junit4:junit4] 1> "state":"active",
[junit4:junit4] 1> "node_name":"127.0.0.1:60986_yuf%2Fv",
[junit4:junit4] 1> "collection":"collection1",
[junit4:junit4] 1> "shard":"shard2",
[junit4:junit4] 1> "core":"collection1"}}}},
[junit4:junit4] 1> "router":"compositeId"}}
[junit4:junit4] 1> /zookeeper (1)
[junit4:junit4] 1> DATA:
[junit4:junit4] 1>
[junit4:junit4] 1>
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=BasicDistributedZk2Test -Dtests.method=testDistribSearch -Dtests.seed=73BF5CAB17741375 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mr_IN -Dtests.timezone=Asia/Sakhalin -Dtests.file.encoding=US-ASCII
[junit4:junit4] ERROR 32.3s J0 | BasicDistributedZk2Test.testDistribSearch <<<
[junit4:junit4] > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:50373/yuf/v/onenodecollectioncore returned non ok status:404, message:Can not find: /yuf/v/onenodecollectioncore/update
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([73BF5CAB17741375:F259D2B3602B7349]:0)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
[junit4:junit4] > at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
[junit4:junit4] > at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:116)
[junit4:junit4] > at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:102)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.testNodeWithoutCollectionForwarding(BasicDistributedZk2Test.java:198)
[junit4:junit4] > at org.apache.solr.cloud.BasicDistributedZk2Test.doTest(BasicDistributedZk2Test.java:90)
[junit4:junit4] > at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:780)
[junit4:junit4] 2> 691927 T3052 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 32319 T3051 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=mr_IN, timezone=Asia/Sakhalin
[junit4:junit4] 2> NOTE: Linux 3.2.0-45-generic x86/IBM Corporation 1.7.0 (32-bit)/cpus=8,threads=2,free=41852448,total=203292672
[junit4:junit4] 2> NOTE: All tests run in this JVM: [PolyFieldTest, TestPluginEnable, TestGroupingSearch, TestUniqueKeyFieldResource, TestClassNameShortening, TestCharFilters, OverseerTest, TestStressVersions, UnloadDistributedZkTest, TestFieldCollectionResource, ChaosMonkeyNothingIsSafeTest, LoggingHandlerTest, DistributedTermsComponentTest, BinaryUpdateRequestHandlerTest, SliceStateTest, SolrCoreTest, TestTrie, TestSearchPerf, SyncSliceTest, TestExtendedDismaxParser, TestLRUCache, TestFunctionQuery, WordBreakSolrSpellCheckerTest, SuggesterFSTTest, DirectSolrConnectionTest, TestFuzzyAnalyzedSuggestions, TestSolrQueryParser, IndexSchemaTest, TestXIncludeConfig, UUIDFieldTest, TestFastLRUCache, PrimUtilsTest, FieldMutatingUpdateProcessorTest, PreAnalyzedFieldTest, TestPerFieldSimilarity, TestPseudoReturnFields, LeaderElectionTest, TestSchemaResource, SpellingQueryConverterTest, TestSolrIndexConfig, ReturnFieldsTest, StatelessScriptUpdateProcessorFactoryTest, CoreAdminHandlerTest, BadCopyFieldTest, UpdateRequestProcessorFactoryTest, TestWriterPerf, SearchHandlerTest, MBeansHandlerTest, ShowFileRequestHandlerTest, SoftAutoCommitTest, CacheHeaderTest, ZkCLITest, OverseerCollectionProcessorTest, TestRandomDVFaceting, TestSweetSpotSimilarityFactory, SOLR749Test, LukeRequestHandlerTest, TestSolrDeletionPolicy1, FileBasedSpellCheckerTest, RAMDirectoryFactoryTest, SpatialFilterTest, DistributedSpellCheckComponentTest, CircularListTest, DateFieldTest, TestReversedWildcardFilterFactory, SolrTestCaseJ4Test, PluginInfoTest, TestRealTimeGet, TestReplicationHandler, ResourceLoaderTest, BadComponentTest, TestValueSourceCache, BasicDistributedZkTest, BasicDistributedZk2Test]
[junit4:junit4] Completed on J0 in 32.84s, 1 test, 1 error <<< FAILURES!
[...truncated 466 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:380: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:373: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:181: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:437: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1240: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:884: There were test failures: 296 suites, 1235 tests, 1 error, 14 ignored (8 assumptions)
Total time: 41 minutes 23 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 32bit/ibm-j9-jdk7 -Xjit:exclude={org/apache/lucene/util/fst/FST.pack(IIF)Lorg/apache/lucene/util/fst/FST;}
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure