You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/05/16 02:37:06 UTC
[JENKINS] Lucene-Solr-Tests-trunk-java7 - Build # 3987 - Failure
Build: https://builds.apache.org/job/Lucene-Solr-Tests-trunk-java7/3987/
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeyShardSplitTest.testDistribSearch
Error Message:
Server at http://127.0.0.1:59007/jo returned non ok status:500, message:Server Error
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Server at http://127.0.0.1:59007/jo returned non ok status:500, message:Server Error
at __randomizedtesting.SeedInfo.seed([3832A98CE78B5505:B9D4279490D43539]:0)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:385)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:180)
at org.apache.solr.cloud.ShardSplitTest.splitShard(ShardSplitTest.java:208)
at org.apache.solr.cloud.ChaosMonkeyShardSplitTest.doTest(ChaosMonkeyShardSplitTest.java:136)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:815)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
FAILED: junit.framework.TestSuite.org.apache.solr.update.processor.RegexBoostProcessorTest
Error Message:
Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 11,679,792 bytes (threshold is 10,485,760). Field reference sizes (counted individually): - 12,209,504 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser - 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory - 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor - 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters - 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules - 256 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome - 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp - 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
Stack Trace:
junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 11,679,792 bytes (threshold is 10,485,760). Field reference sizes (counted individually):
- 12,209,504 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser
- 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory
- 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor
- 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters
- 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules
- 256 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome
- 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp
- 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
at __randomizedtesting.SeedInfo.seed([3832A98CE78B5505]:0)
at com.carrotsearch.randomizedtesting.rules.StaticFieldsInvariantRule$1.afterAlways(StaticFieldsInvariantRule.java:127)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:43)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:722)
Build Log:
[...truncated 9328 lines...]
[junit4:junit4] Suite: org.apache.solr.update.processor.RegexBoostProcessorTest
[junit4:junit4] 2> 264075 T1130 oas.SolrTestCaseJ4.initCore ####initCore
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355
[junit4:junit4] 2> 264076 T1130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/'
[junit4:junit4] 2> 264077 T1130 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 264077 T1130 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/lib/README' to classloader
[junit4:junit4] 2> 264135 T1130 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 264188 T1130 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 264189 T1130 oass.IndexSchema.readSchema Reading Solr Schema from schema12.xml
[junit4:junit4] 2> 264194 T1130 oass.IndexSchema.readSchema [null] Schema name=test
[junit4:junit4] 2> 264595 T1130 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 264598 T1130 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 264599 T1130 oass.IndexSchema.readSchema WARN Field text is not multivalued and destination for multiple copyFields (2)
[junit4:junit4] 2> 264610 T1130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 264614 T1130 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 264617 T1130 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 264617 T1130 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr
[junit4:junit4] 2> 264618 T1130 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/'
[junit4:junit4] 2> 264628 T1130 oasc.CoreContainer.<init> New CoreContainer 624811523
[junit4:junit4] 2> 264667 T1130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 264667 T1130 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/, dataDir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/
[junit4:junit4] 2> 264667 T1130 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 264668 T1130 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 264668 T1130 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355
[junit4:junit4] 2> 264669 T1130 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index/
[junit4:junit4] 2> 264669 T1130 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 264669 T1130 oasc.CachingDirectoryFactory.get return new directory for /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index
[junit4:junit4] 2> 264671 T1130 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=RateLimitedDirectoryWrapper(MockDirWrapper(org.apache.lucene.store.RAMDirectory@272880ea lockFactory=org.apache.lucene.store.NativeFSLockFactory@6ccf0fd2)),segFN=segments_1,generation=1}
[junit4:junit4] 2> 264672 T1130 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 264672 T1130 oasc.SolrCore.initWriters created xml: solr.XMLResponseWriter
[junit4:junit4] 2> 264674 T1130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 264675 T1130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe-allfields"
[junit4:junit4] 2> 264675 T1130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 264675 T1130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "uniq-fields"
[junit4:junit4] 2> 264676 T1130 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 264676 T1130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 264676 T1130 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 264677 T1130 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 264677 T1130 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 264678 T1130 oasc.RequestHandlers.initHandlersFromConfig created dismax: solr.SearchHandler
[junit4:junit4] 2> 264678 T1130 oasc.RequestHandlers.initHandlersFromConfig created mock: org.apache.solr.core.MockQuerySenderListenerReqHandler
[junit4:junit4] 2> 264679 T1130 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 264679 T1130 oasc.RequestHandlers.initHandlersFromConfig created defaults: solr.StandardRequestHandler
[junit4:junit4] 2> 264679 T1130 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.StandardRequestHandler
[junit4:junit4] 2> 264680 T1130 oasc.RequestHandlers.initHandlersFromConfig created lazy: solr.StandardRequestHandler
[junit4:junit4] 2> 264680 T1130 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 264681 T1130 oasc.RequestHandlers.initHandlersFromConfig created /terms: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264681 T1130 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264682 T1130 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264682 T1130 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264683 T1130 oasc.RequestHandlers.initHandlersFromConfig created spellCheckWithWordbreak_Direct: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264683 T1130 oasc.RequestHandlers.initHandlersFromConfig created spellCheckCompRH1: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264683 T1130 oasc.RequestHandlers.initHandlersFromConfig created mltrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264684 T1130 oasc.RequestHandlers.initHandlersFromConfig created tvrh: org.apache.solr.handler.component.SearchHandler
[junit4:junit4] 2> 264684 T1130 oasc.RequestHandlers.initHandlersFromConfig created /mlt: solr.MoreLikeThisHandler
[junit4:junit4] 2> 264685 T1130 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
[junit4:junit4] 2> 264694 T1130 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 264698 T1130 oasc.SolrCore.initDeprecatedSupport WARN solrconfig.xml uses deprecated <admin/gettableFiles>, Please update your config to use the ShowFileRequestHandler.
[junit4:junit4] 2> 264699 T1130 oasc.SolrCore.initDeprecatedSupport WARN adding ShowFileRequestHandler with hidden files: [THROW.ERROR.ON.ADD.UPDATEPROCESSOR.JS, SOLRCONFIG-HIGHLIGHT.XML, SCHEMA-REQUIRED-FIELDS.XML, BAD-SCHEMA-DOCVALUES-NOT-REQUIRED-NO-DEFAULT.XML, SCHEMA-REPLICATION2.XML, SCHEMA-MINIMAL.XML, TRIVIAL.UPDATEPROCESSOR1.JS, BAD-SCHEMA-DUP-DYNAMICFIELD.XML, SOLRCONFIG-CACHING.XML, BAD-SOLRCONFIG-UNEXPECTED-SCHEMA-ATTRIBUTE.XML, SCHEMA-POSTINGSHIGHLIGHT.XML, SOLRCONFIG-REPEATER.XML, REGEX-BOOST-PROCESSOR-TEST.TXT, BAD-SCHEMA-NONTEXT-ANALYZER.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-CODE-IN-XML.XML, SOLRCONFIG-MERGEPOLICY.XML, CURRENCY.XML, SOLRCONFIG-TLOG.XML, SOLRCONFIG-MASTER.XML, SOLRCONFIG-COMPONENTS-NAME.XML, BAD-SCHEMA-UNIQUEKEY-MULTIVALUED.XML, SCHEMA11.XML, SOLRCONFIG-BASIC.XML, DA_COMPOUNDDICTIONARY.TXT, MISSLEADING.EXTENSION.UPDATEPROCESSOR.JS.TXT, SCHEMA-COPYFIELD-TEST.XML, SOLRCONFIG-SLAVE.XML, ELEVATE.XML, SOLRCONFIG-PROPINJECT-INDEXDEFAULT.XML, TRIVIAL.UPDATEPROCESSOR0.JS, SCHEMA-SWEETSPOT.XML, BAD-SOLRCONFIG-BOGUS-SCRIPTENGINE-NAME.XML, SCHEMA-CHARFILTERS.XML, SCHEMA-IB.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SOLRCONFIG-QUERYSENDER.XML, SCHEMA-REPLICATION1.XML, SOLRCONFIG-SNIPPET-PROCESSOR.XML, DA_UTF8.XML, BAD-SCHEMA-NON-GLOB-COPYFIELD-SOURCE-MATCHING-NOTHING-SHOULD-FAIL-TEST.XML, SCHEMA-TINY.XML, CONDITIONAL.UPDATEPROCESSOR.JS, MISSING.FUNCTIONS.UPDATEPROCESSOR.JS, HYPHENATION.DTD, SOLRCONFIG-ENABLEPLUGIN.XML, BAD-SOLRCONFIG-SCHEMA-MUTABLE-BUT-NOT-MANAGED.XML, SCHEMA-PHRASESUGGEST.XML, STEMDICT.TXT, SCHEMA-ID-AND-VERSION-FIELDS-ONLY.XML, HUNSPELL-TEST.AFF, BAD-SCHEMA-CURRENCY-FT-OER-NORATES.XML, SCHEMA-SNIPPET-TYPE.XML, STOPTYPES-1.TXT, STOPWORDSWRONGENCODING.TXT, SCHEMA-NUMERIC.XML, SOLRCONFIG-TRANSFORMERS.XML, SOLRCONFIG-PROPINJECT.XML, BAD-SCHEMA-NOT-INDEXED-BUT-TF.XML, SOLRCONFIG-SIMPLELOCK.XML, SOLRCONFIG-TLOG-MUTABLE-MANAGED-SCHEMA.XML, SCHEMA-DOCVALUES.XML, WDFTYPES.TXT, SCHEMA-REVERSED.XML, STOPTYPES-2.TXT, BAD-SCHEMA-CURRENCY-FT-MULTIVALUED.XML, BAD-SCHEMA-BOGUS-ANALYSIS-PARAMETERS.XML, SOLRCONFIG-SPELLCHECKCOMPONENT.XML, SOLRCONFIG-PHRASESUGGEST.XML, BAD-SCHEMA-CURRENCY-MULTIVALUED.XML, SCHEMA-DFR.XML, BAD-SCHEMA-NOT-INDEXED-BUT-POS.XML, KEEP-1.TXT, SCHEMA-SPATIAL.XML, OPEN-EXCHANGE-RATES.JSON, STOPWITHBOM.TXT, SOLRCONFIG-SPELLCHECKER.XML, SOLRCONFIG-POSTINGSHIGHLIGHT.XML, SCHEMA-BINARYFIELD.XML, SOLRCONFIG-UPDATE-PROCESSOR-CHAINS.XML, SOLRCONFIG-WARMER.XML, BAD-SCHEMA-OMIT-TF-BUT-NOT-POS.XML, BAD-SCHEMA-DUP-FIELDTYPE.XML, SCHEMA-XINCLUDE.XML, SOLRCONFIG-MASTER1.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-SOURCE-SHOULD-FAIL-TEST.XML, SCHEMA-BEHAVIOR.XML, SYNONYMS.TXT, SOLRCONFIG-MINIMAL.XML, SCHEMA-DOCVALUESMULTI.XML, BAD-SCHEMA-UNSUPPORTED-DOCVALUES.XML, BAD-SCHEMA-CURRENCY-DYNAMIC-MULTIVALUED.XML, SCHEMA_CODEC.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-HYPERBOLIC.XML, SOLRCONFIG-SOLR-749.XML, SOLRCONFIG-MASTER1-KEEPONEBACKUP.XML, SCHEMA-EFF.XML, STOP-2.TXT, SOLRCONFIG-FUNCTIONQUERY.XML, SOLRCONFIG-TERMINDEX.XML, SCHEMA-LMDIRICHLET.XML, SCHEMA-ONE-FIELD-NO-DYNAMIC-FIELD.XML, SOLRCONFIG-ELEVATE.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-NORMS.XML, BAD-SCHEMA-SWEETSPOT-PARTIAL-BASELINE.XML, SCHEMA-FOLDING.XML, STOPWORDS.TXT, SCHEMA-STOP-KEEP.XML, BAD-SCHEMA-BOGUS-FIELD-PARAMETERS.XML, FUZZYSUGGEST.TXT, BAD-SOLRCONFIG-MANAGED-SCHEMA-NAMED-SCHEMA.XML.XML, BAD-SCHEMA-NOT-INDEXED-BUT-NORMS.XML, SCHEMA-REST.XML, SOLRCONFIG-TLOG-MANAGED-SCHEMA.XML, SOLRCONFIG-SOLCOREPROPERTIES.XML, STOP-1.TXT, SOLRCONFIG-MANAGED-SCHEMA.XML, SOLRCONFIG-MASTER2.XML, SCHEMA-SPELLCHECKER.XML, SOLRCONFIG-RESPONSE-LOG-COMPONENT.XML, BAD-SCHEMA-MISPLACED-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, SOLRCONFIG-LAZYWRITER.XML, SCHEMA-LUCENEMATCHVERSION.XML, SCHEMA-CLASS-NAME-SHORTENING-ON-SERIALIZATION.XML, BAD-MP-SOLRCONFIG.XML, FRENCHARTICLES.TXT, SCHEMA15.XML, SOLRCONFIG-REQHANDLER.INCL, SCHEMASURROUND.XML, SOLRCONFIG-MASTER3.XML, BAD-SCHEMA-MULTIPLE-ASTERISK-COPYFIELD-DEST-SHOULD-FAIL-TEST.XML, HUNSPELL-TEST.DIC, BAD-SCHEMA-CODEC-GLOBAL-VS-FT-MISMATCH.XML, SOLRCONFIG-XINCLUDE.XML, SOLRCONFIG-DELPOLICY1.XML, SOLRCONFIG-SLAVE1.XML, SCHEMA-SIM.XML, SCHEMA-SNIPPET-FIELD.XML, SCHEMA-COLLATE.XML, STOP-SNOWBALL.TXT, BAD-SCHEMA-SIM-GLOBAL-VS-FT-MISMATCH.XML, PROTWORDS.TXT, SCHEMA-TRIE.XML, SOLRCONFIG_CODEC.XML, SCHEMA-SYNONYM-TOKENIZER.XML, BAD-SOLRCONFIG-INVALID-SCRIPTFILE.XML, JASUGGEST.TXT, SCHEMA-REST-LUCENE-MATCH-VERSION.XML, SCHEMA-DOCVALUESFACETING.XML, SCHEMA-TFIDF.XML, SOLRCONFIG-SCRIPT-UPDATEPROCESSOR.XML, SCHEMA-LMJELINEKMERCER.XML, PHRASESUGGEST.TXT, BAD-SOLRCONFIG-MISSING-SCRIPTFILE.XML, BAD-SCHEMA-UNIQUEKEY-USES-DEFAULT.XML, OLD_SYNONYMS.TXT, SOLRCONFIG-DELPOLICY2.XML, SOLRCONFIG-NATIVELOCK.XML, XSLT, SOLRCONFIG-MUTABLE-MANAGED-SCHEMA.XML, BAD-SCHEMA-DUP-FIELD.XML, SOLRCONFIG-NOCACHE.XML, SCHEMA-BM25.XML, BAD-SCHEMA-SWEETSPOT-BOTH-TF.XML, ADDFIELDS.UPDATEPROCESSOR.JS, SOLRCONFIG-ALTDIRECTORY.XML, SOLRCONFIG-QUERYSENDER-NOQUERY.XML, COMPOUNDDICTIONARY.TXT, SOLRCONFIG-INDEXCONFIG.XML, BAD-SCHEMA-CURRENCY-FT-BOGUS-DEFAULT-CODE.XML, BAD-CURRENCY.XML, SOLRCONFIG_PERF.XML, BAD-SCHEMA-ANALYZER-CLASS-AND-NESTED.XML, SCHEMA-NOT-REQUIRED-UNIQUE-KEY.XML, KEEP-2.TXT, SCHEMA12.XML, BAD-SCHEMA-UNIQUEKEY-IS-COPYFIELD-DEST.XML, MAPPING-ISOLATIN1ACCENT.TXT, BAD_SOLRCONFIG.XML, BAD-SCHEMA-EXTERNAL-FILEFIELD.XML]
[junit4:junit4] 2> 264702 T1130 oass.SolrIndexSearcher.<init> Opening Searcher@6073c094 main
[junit4:junit4] 2> 264702 T1130 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 264702 T1130 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 264703 T1130 oashc.SpellCheckComponent.inform Initializing spell checkers
[junit4:junit4] 2> 264709 T1130 oass.DirectSolrSpellChecker.init init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4:junit4] 2> 264755 T1131 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6073c094 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 264759 T1130 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 264768 T1130 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4:junit4] 2> 264778 T1130 oas.SolrTestCaseJ4.setUp ###Starting testNoBoost
[junit4:junit4] 2> 264778 T1130 oas.SolrTestCaseJ4.tearDown ###Ending testNoBoost
[junit4:junit4] 2> 264783 T1130 oas.SolrTestCaseJ4.setUp ###Starting testBoostGood
[junit4:junit4] 2> 264783 T1130 oas.SolrTestCaseJ4.tearDown ###Ending testBoostGood
[junit4:junit4] 2> 264788 T1130 oas.SolrTestCaseJ4.setUp ###Starting testDeboostOld
[junit4:junit4] 2> 264788 T1130 oas.SolrTestCaseJ4.tearDown ###Ending testDeboostOld
[junit4:junit4] 2> 264792 T1130 oas.SolrTestCaseJ4.setUp ###Starting testTwoRules
[junit4:junit4] 2> 264792 T1130 oas.SolrTestCaseJ4.tearDown ###Ending testTwoRules
[junit4:junit4] 2> 264793 T1130 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4:junit4] 2> 264793 T1130 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=624811523
[junit4:junit4] 2> 264794 T1130 oasc.SolrCore.close [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@baaa0f
[junit4:junit4] 2> 264804 T1130 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
[junit4:junit4] 2> 264804 T1130 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
[junit4:junit4] 2> 264804 T1130 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 264804 T1130 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 264805 T1130 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 264805 T1130 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 264805 T1130 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index;done=false>>]
[junit4:junit4] 2> 264805 T1130 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355/index
[junit4:junit4] 2> 264806 T1130 oasc.CachingDirectoryFactory.closeCacheValue looking to close /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355 [CachedDir<<refCount=0;path=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355;done=false>>]
[junit4:junit4] 2> 264806 T1130 oasc.CachingDirectoryFactory.close Closing directory: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-RegexBoostProcessorTest-1368662916355
[junit4:junit4] 2> NOTE: test params are: codec=Lucene42: {}, docValues:{}, sim=DefaultSimilarity, locale=en_IN, timezone=EAT
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=1,free=141111928,total=400556032
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestClassNameShortening, TestBadConfig, PrimitiveFieldTypeTest, TestUniqueKeyFieldResource, TestFastWriter, TestQuerySenderListener, PluginInfoTest, SchemaVersionSpecificBehaviorTest, SolrInfoMBeanTest, ClusterStateUpdateTest, TermsComponentTest, SpatialFilterTest, QueryResultKeyTest, UnloadDistributedZkTest, AnalysisAfterCoreReloadTest, TestManagedSchema, QueryParsingTest, SuggesterTest, CSVRequestHandlerTest, SearchHandlerTest, UUIDFieldTest, TestSolrDeletionPolicy1, TestSearchPerf, TestFieldTypeCollectionResource, PrimUtilsTest, OverseerCollectionProcessorTest, OverseerTest, DistributedSpellCheckComponentTest, CoreAdminHandlerTest, PeerSyncTest, TestSolrCoreProperties, ResponseLogComponentTest, JsonLoaderTest, DocumentBuilderTest, RegexBoostProcessorTest]
[junit4:junit4] 2> NOTE: reproduce with: ant test -Dtestcase=RegexBoostProcessorTest -Dtests.seed=3832A98CE78B5505 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IN -Dtests.timezone=EAT -Dtests.file.encoding=UTF-8
[junit4:junit4] ERROR 0.00s J0 | RegexBoostProcessorTest (suite) <<<
[junit4:junit4] > Throwable #1: junit.framework.AssertionFailedError: Clean up static fields (in @AfterClass?), your test seems to hang on to approximately 11,679,792 bytes (threshold is 10,485,760). Field reference sizes (counted individually):
[junit4:junit4] > - 12,209,504 bytes, protected static org.apache.solr.servlet.SolrRequestParsers org.apache.solr.update.processor.RegexBoostProcessorTest._parser
[junit4:junit4] > - 5,192 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessorFactory org.apache.solr.update.processor.RegexBoostProcessorTest.factory
[junit4:junit4] > - 4,520 bytes, private static org.apache.solr.update.processor.RegexpBoostProcessor org.apache.solr.update.processor.RegexBoostProcessorTest.reProcessor
[junit4:junit4] > - 816 bytes, protected static org.apache.solr.common.params.ModifiableSolrParams org.apache.solr.update.processor.RegexBoostProcessorTest.parameters
[junit4:junit4] > - 280 bytes, public static org.junit.rules.TestRule org.apache.solr.SolrTestCaseJ4.solrClassRules
[junit4:junit4] > - 256 bytes, protected static java.lang.String org.apache.solr.SolrTestCaseJ4.testSolrHome
[junit4:junit4] > - 128 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.factoryProp
[junit4:junit4] > - 64 bytes, private static java.lang.String org.apache.solr.SolrTestCaseJ4.coreName
[junit4:junit4] > at __randomizedtesting.SeedInfo.seed([3832A98CE78B5505]:0)
[junit4:junit4] > at java.lang.Thread.run(Thread.java:722)
[junit4:junit4] Completed on J0 in 1.34s, 4 tests, 1 failure <<< FAILURES!
[...truncated 737 lines...]
[junit4:junit4] Suite: org.apache.solr.cloud.ChaosMonkeyShardSplitTest
[junit4:junit4] 2> 1607694 T4341 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /jo/
[junit4:junit4] 2> 1607700 T4341 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4:junit4] 2> Creating dataDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeyShardSplitTest-1368664259987
[junit4:junit4] 2> 1607718 T4341 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4:junit4] 2> 1607719 T4342 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4:junit4] 2> 1607820 T4341 oasc.ZkTestServer.run start zk server on port:35446
[junit4:junit4] 2> 1607821 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1607826 T4348 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3afc630f name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1607826 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1607826 T4341 oascc.SolrZkClient.makePath makePath: /solr
[junit4:junit4] 2> 1607837 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1607839 T4350 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@64742028 name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1607840 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1607840 T4341 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4:junit4] 2> 1607850 T4341 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4:junit4] 2> 1607853 T4341 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4:junit4] 2> 1607856 T4341 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4:junit4] 2> 1607865 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1607865 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4:junit4] 2> 1607878 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4:junit4] 2> 1607879 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4:junit4] 2> 1607982 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1607983 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4:junit4] 2> 1607987 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4:junit4] 2> 1607988 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4:junit4] 2> 1607990 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4:junit4] 2> 1607991 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4:junit4] 2> 1607994 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1607995 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4:junit4] 2> 1607998 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1607999 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4:junit4] 2> 1608002 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1608002 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4:junit4] 2> 1608010 T4341 oasc.AbstractZkTestCase.putConfig put /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1608011 T4341 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4:junit4] 2> 1608222 T4341 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1608227 T4341 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:16418
[junit4:junit4] 2> 1608228 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1608229 T4341 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1608229 T4341 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296
[junit4:junit4] 2> 1608230 T4341 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/solr.xml
[junit4:junit4] 2> 1608230 T4341 oasc.CoreContainer.<init> New CoreContainer 897856455
[junit4:junit4] 2> 1608231 T4341 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/'
[junit4:junit4] 2> 1608232 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/'
[junit4:junit4] 2> 1608346 T4341 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1608347 T4341 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1608348 T4341 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1608349 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1608349 T4341 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1608350 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1608350 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1608351 T4341 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1608351 T4341 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1608352 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1608366 T4341 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1608367 T4341 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35446/solr
[junit4:junit4] 2> 1608367 T4341 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1608368 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1608371 T4361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@61253aef name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1608372 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1608374 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1608384 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1608386 T4363 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3de44cad name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1608386 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1608388 T4341 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4:junit4] 2> 1608399 T4341 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4:junit4] 2> 1608402 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4:junit4] 2> 1608404 T4341 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:16418_jo
[junit4:junit4] 2> 1608408 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:16418_jo
[junit4:junit4] 2> 1608417 T4341 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4:junit4] 2> 1608432 T4341 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4:junit4] 2> 1608435 T4341 oasc.Overseer.start Overseer (id=89696780943556611-127.0.0.1:16418_jo-n_0000000000) starting
[junit4:junit4] 2> 1608446 T4341 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4:junit4] 2> 1608458 T4365 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4:junit4] 2> 1608458 T4341 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4:junit4] 2> 1608461 T4341 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4:junit4] 2> 1608463 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1608466 T4364 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4:junit4] 2> 1608470 T4366 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/collection1
[junit4:junit4] 2> 1608470 T4366 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4:junit4] 2> 1608471 T4366 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1608471 T4366 oasc.ZkController.readConfigName Load collection config from:/collections/control_collection
[junit4:junit4] 2> 1608473 T4366 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/collection1/'
[junit4:junit4] 2> 1608474 T4366 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/collection1/lib/README' to classloader
[junit4:junit4] 2> 1608475 T4366 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1608523 T4366 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1608581 T4366 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1608683 T4366 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1608689 T4366 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1609233 T4366 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1609237 T4366 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1609239 T4366 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1609244 T4366 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1609269 T4366 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1609269 T4366 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-controljetty-1368664260296/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data/
[junit4:junit4] 2> 1609270 T4366 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 1609270 T4366 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1609271 T4366 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data
[junit4:junit4] 2> 1609271 T4366 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data/index/
[junit4:junit4] 2> 1609271 T4366 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1609272 T4366 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data/index
[junit4:junit4] 2> 1609275 T4366 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@493c5378 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e55b676),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1609276 T4366 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1609278 T4366 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1609278 T4366 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1609279 T4366 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1609280 T4366 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1609280 T4366 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1609280 T4366 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1609281 T4366 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1609281 T4366 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1609282 T4366 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1609293 T4366 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1609298 T4366 oass.SolrIndexSearcher.<init> Opening Searcher@4d0dc978 main
[junit4:junit4] 2> 1609299 T4366 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/control/data/tlog
[junit4:junit4] 2> 1609300 T4366 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1609300 T4366 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1609303 T4367 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4d0dc978 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1609304 T4366 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1609304 T4366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1609969 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1609970 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:16418_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:16418/jo"}
[junit4:junit4] 2> 1609971 T4364 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with numShards 1
[junit4:junit4] 2> 1609971 T4364 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1609983 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1610307 T4366 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1610307 T4366 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:16418/jo collection:control_collection shard:shard1
[junit4:junit4] 2> 1610308 T4366 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4:junit4] 2> 1610328 T4366 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1610331 T4366 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1610331 T4366 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1610331 T4366 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:16418/jo/collection1/
[junit4:junit4] 2> 1610332 T4366 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1610332 T4366 oasc.SyncStrategy.syncToMe http://127.0.0.1:16418/jo/collection1/ has no replicas
[junit4:junit4] 2> 1610332 T4366 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:16418/jo/collection1/
[junit4:junit4] 2> 1610332 T4366 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4:junit4] 2> 1611487 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1611504 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4:junit4] 2> 1611563 T4366 oasc.ZkController.register We are http://127.0.0.1:16418/jo/collection1/ and leader is http://127.0.0.1:16418/jo/collection1/
[junit4:junit4] 2> 1611563 T4366 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:16418/jo
[junit4:junit4] 2> 1611563 T4366 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1611564 T4366 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1611564 T4366 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1611566 T4366 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1611567 T4341 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1611568 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1611568 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1611582 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:
[junit4:junit4] 2> 1611583 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1611585 T4370 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c540fa6 name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1611585 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1611586 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1611589 T4341 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:true cause connection loss:true
[junit4:junit4] 2> 1611784 T4341 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1611788 T4341 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59007
[junit4:junit4] 2> 1611788 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1611789 T4341 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1611789 T4341 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869
[junit4:junit4] 2> 1611790 T4341 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/solr.xml
[junit4:junit4] 2> 1611790 T4341 oasc.CoreContainer.<init> New CoreContainer 926551520
[junit4:junit4] 2> 1611791 T4341 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/'
[junit4:junit4] 2> 1611792 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/'
[junit4:junit4] 2> 1611914 T4341 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1611915 T4341 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1611916 T4341 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1611916 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1611917 T4341 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1611917 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1611918 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1611918 T4341 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1611919 T4341 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1611919 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1611933 T4341 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1611934 T4341 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35446/solr
[junit4:junit4] 2> 1611934 T4341 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1611935 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1611939 T4381 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a0d7524 name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1611940 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1611945 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1611955 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1611964 T4383 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@e653bd name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1611964 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1611980 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1612984 T4341 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59007_jo
[junit4:junit4] 2> 1612987 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59007_jo
[junit4:junit4] 2> 1612989 T4370 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1612989 T4383 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1612989 T4363 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4:junit4] 2> 1612990 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1613003 T4384 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/collection1
[junit4:junit4] 2> 1613004 T4384 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1613004 T4384 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1613005 T4384 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1613006 T4384 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/collection1/'
[junit4:junit4] 2> 1613008 T4384 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1613008 T4384 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/collection1/lib/README' to classloader
[junit4:junit4] 2> 1613017 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1613018 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"1",
[junit4:junit4] 2> "numShards":"1",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"control_collection",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:16418_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:16418/jo"}
[junit4:junit4] 2> 1613030 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1613030 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1613030 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1613063 T4384 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1613126 T4384 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1613228 T4384 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1613234 T4384 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1613810 T4384 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1613814 T4384 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1613816 T4384 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1613822 T4384 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1613846 T4384 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1613846 T4384 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty1-1368664263869/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1/
[junit4:junit4] 2> 1613847 T4384 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 1613847 T4384 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1613848 T4384 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1
[junit4:junit4] 2> 1613848 T4384 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1/index/
[junit4:junit4] 2> 1613849 T4384 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1613849 T4384 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1/index
[junit4:junit4] 2> 1613852 T4384 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1613852 T4384 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1613855 T4384 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1613856 T4384 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1613856 T4384 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1613857 T4384 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1613858 T4384 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1613858 T4384 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1613858 T4384 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1613859 T4384 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1613860 T4384 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1613872 T4384 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1613879 T4384 oass.SolrIndexSearcher.<init> Opening Searcher@21d85727 main
[junit4:junit4] 2> 1613880 T4384 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty1/tlog
[junit4:junit4] 2> 1613881 T4384 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1613881 T4384 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1613885 T4385 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21d85727 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1613887 T4384 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1613888 T4384 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1614535 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1614536 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59007_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59007/jo"}
[junit4:junit4] 2> 1614537 T4364 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with numShards 2
[junit4:junit4] 2> 1614537 T4364 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1614550 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1614550 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1614550 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1614916 T4384 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1614916 T4384 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59007/jo collection:collection1 shard:shard1
[junit4:junit4] 2> 1614917 T4384 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4:junit4] 2> 1614934 T4384 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1614944 T4384 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1614944 T4384 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1614945 T4384 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59007/jo/collection1/
[junit4:junit4] 2> 1614945 T4384 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1614945 T4384 oasc.SyncStrategy.syncToMe http://127.0.0.1:59007/jo/collection1/ has no replicas
[junit4:junit4] 2> 1614946 T4384 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59007/jo/collection1/
[junit4:junit4] 2> 1614946 T4384 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4:junit4] 2> 1616054 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1616067 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1616067 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1616067 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4:junit4] 2> 1616074 T4384 oasc.ZkController.register We are http://127.0.0.1:59007/jo/collection1/ and leader is http://127.0.0.1:59007/jo/collection1/
[junit4:junit4] 2> 1616074 T4384 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59007/jo
[junit4:junit4] 2> 1616074 T4384 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1616075 T4384 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1616075 T4384 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1616076 T4384 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1616078 T4341 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1616078 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1616079 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1616302 T4341 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1616305 T4341 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59048
[junit4:junit4] 2> 1616306 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1616307 T4341 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1616307 T4341 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373
[junit4:junit4] 2> 1616308 T4341 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/solr.xml
[junit4:junit4] 2> 1616308 T4341 oasc.CoreContainer.<init> New CoreContainer 1494224326
[junit4:junit4] 2> 1616309 T4341 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/'
[junit4:junit4] 2> 1616310 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/'
[junit4:junit4] 2> 1616449 T4341 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1616450 T4341 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1616450 T4341 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1616451 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1616451 T4341 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1616452 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1616452 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1616453 T4341 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1616453 T4341 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1616454 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1616468 T4341 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1616469 T4341 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35446/solr
[junit4:junit4] 2> 1616469 T4341 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1616471 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1616473 T4397 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3ab5d3fc name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1616474 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1616476 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1616487 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1616489 T4399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5bff7604 name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1616489 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1616501 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1617504 T4341 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59048_jo
[junit4:junit4] 2> 1617507 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59048_jo
[junit4:junit4] 2> 1617510 T4363 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1617510 T4399 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1617511 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617510 T4383 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1617510 T4370 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4:junit4] 2> 1617511 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617512 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617525 T4400 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/collection1
[junit4:junit4] 2> 1617526 T4400 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1617526 T4400 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1617527 T4400 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1617528 T4400 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/collection1/'
[junit4:junit4] 2> 1617530 T4400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/collection1/lib/README' to classloader
[junit4:junit4] 2> 1617530 T4400 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1617574 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1617575 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"2",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59007_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59007/jo"}
[junit4:junit4] 2> 1617582 T4400 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1617606 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617606 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617606 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617606 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1617646 T4400 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1617747 T4400 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1617753 T4400 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1618340 T4400 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1618344 T4400 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1618347 T4400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1618352 T4400 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1618377 T4400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1618378 T4400 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty2-1368664268373/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2/
[junit4:junit4] 2> 1618378 T4400 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 1618379 T4400 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1618380 T4400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2
[junit4:junit4] 2> 1618380 T4400 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2/index/
[junit4:junit4] 2> 1618381 T4400 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1618381 T4400 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2/index
[junit4:junit4] 2> 1618384 T4400 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1618384 T4400 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1618388 T4400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1618389 T4400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1618389 T4400 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1618390 T4400 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1618391 T4400 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1618391 T4400 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1618392 T4400 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1618393 T4400 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1618394 T4400 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1618413 T4400 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1618421 T4400 oass.SolrIndexSearcher.<init> Opening Searcher@f8c4550 main
[junit4:junit4] 2> 1618422 T4400 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty2/tlog
[junit4:junit4] 2> 1618423 T4400 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1618424 T4400 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1618430 T4401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f8c4550 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1618433 T4400 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1618434 T4400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1619136 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1619136 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59048_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59048/jo"}
[junit4:junit4] 2> 1619137 T4364 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1619137 T4364 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1619158 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1619158 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1619158 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1619158 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1619436 T4400 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1619436 T4400 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59048/jo collection:collection1 shard:shard2
[junit4:junit4] 2> 1619437 T4400 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4:junit4] 2> 1619458 T4400 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process.
[junit4:junit4] 2> 1619468 T4400 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4:junit4] 2> 1619469 T4400 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4:junit4] 2> 1619469 T4400 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:59048/jo/collection1/
[junit4:junit4] 2> 1619469 T4400 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4:junit4] 2> 1619470 T4400 oasc.SyncStrategy.syncToMe http://127.0.0.1:59048/jo/collection1/ has no replicas
[junit4:junit4] 2> 1619470 T4400 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:59048/jo/collection1/
[junit4:junit4] 2> 1619470 T4400 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1620663 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1620819 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1620820 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1620819 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1620819 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1620864 T4400 oasc.ZkController.register We are http://127.0.0.1:59048/jo/collection1/ and leader is http://127.0.0.1:59048/jo/collection1/
[junit4:junit4] 2> 1620864 T4400 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59048/jo
[junit4:junit4] 2> 1620864 T4400 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4:junit4] 2> 1620865 T4400 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1620865 T4400 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1620867 T4400 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1620868 T4341 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1620869 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1620870 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1621098 T4341 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1621101 T4341 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59057
[junit4:junit4] 2> 1621102 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1621103 T4341 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1621103 T4341 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164
[junit4:junit4] 2> 1621104 T4341 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/solr.xml
[junit4:junit4] 2> 1621104 T4341 oasc.CoreContainer.<init> New CoreContainer 1855548587
[junit4:junit4] 2> 1621105 T4341 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/'
[junit4:junit4] 2> 1621106 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/'
[junit4:junit4] 2> 1621222 T4341 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1621223 T4341 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1621224 T4341 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1621224 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1621225 T4341 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1621225 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1621226 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1621226 T4341 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1621227 T4341 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1621227 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1621242 T4341 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1621242 T4341 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35446/solr
[junit4:junit4] 2> 1621243 T4341 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1621244 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1621251 T4413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@aefd042 name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1621252 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1621270 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1621281 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1621283 T4415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6de8932a name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1621284 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1621293 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1622297 T4341 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59057_jo
[junit4:junit4] 2> 1622300 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59057_jo
[junit4:junit4] 2> 1622303 T4370 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1622303 T4415 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1622303 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622303 T4383 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1622303 T4363 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1622303 T4399 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4:junit4] 2> 1622304 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622304 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622305 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622323 T4416 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/collection1
[junit4:junit4] 2> 1622323 T4416 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1622324 T4416 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1622324 T4416 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1622326 T4416 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/collection1/'
[junit4:junit4] 2> 1622326 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1622327 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"3",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59048_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59048/jo"}
[junit4:junit4] 2> 1622327 T4416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/collection1/lib/README' to classloader
[junit4:junit4] 2> 1622328 T4416 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1622337 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622337 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622337 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622337 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622337 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1622377 T4416 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1622436 T4416 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1622537 T4416 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1622543 T4416 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1623178 T4416 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1623182 T4416 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1623185 T4416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1623190 T4416 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1623213 T4416 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1623214 T4416 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty3-1368664273164/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/
[junit4:junit4] 2> 1623214 T4416 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 1623215 T4416 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1623216 T4416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3
[junit4:junit4] 2> 1623216 T4416 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index/
[junit4:junit4] 2> 1623217 T4416 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1623217 T4416 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index
[junit4:junit4] 2> 1623220 T4416 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fe59259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e01a2ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1623221 T4416 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1623223 T4416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1623224 T4416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1623224 T4416 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1623225 T4416 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1623226 T4416 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1623226 T4416 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1623227 T4416 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1623227 T4416 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1623228 T4416 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1623240 T4416 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1623247 T4416 oass.SolrIndexSearcher.<init> Opening Searcher@69d658f7 main
[junit4:junit4] 2> 1623247 T4416 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/tlog
[junit4:junit4] 2> 1623248 T4416 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1623248 T4416 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1623252 T4417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@69d658f7 main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1623255 T4416 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1623255 T4416 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1623842 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1623843 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59057_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59057/jo"}
[junit4:junit4] 2> 1623844 T4364 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1623844 T4364 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard1
[junit4:junit4] 2> 1623859 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1623860 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1623860 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1623860 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1623859 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1624257 T4416 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1624257 T4416 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59057/jo collection:collection1 shard:shard1
[junit4:junit4] 2> 1624261 T4416 oasc.ZkController.register We are http://127.0.0.1:59057/jo/collection1/ and leader is http://127.0.0.1:59007/jo/collection1/
[junit4:junit4] 2> 1624261 T4416 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59057/jo
[junit4:junit4] 2> 1624261 T4416 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1624262 T4416 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C197 name=collection1 org.apache.solr.core.SolrCore@1c148687 url=http://127.0.0.1:59057/jo/collection1 node=127.0.0.1:59057_jo C197_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:59057_jo, base_url=http://127.0.0.1:59057/jo}
[junit4:junit4] 2> 1624263 T4418 C197 P59057 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1624264 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1624264 T4418 C197 P59057 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1624264 T4416 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1624264 T4418 C197 P59057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1624265 T4341 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1624266 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1624266 T4418 C197 P59057 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1624267 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1624284 T4373 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> 1624493 T4341 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4:junit4] 2> 1624496 T4341 oejs.AbstractConnector.doStart Started SocketConnector@127.0.0.1:59062
[junit4:junit4] 2> 1624497 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4:junit4] 2> 1624498 T4341 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4:junit4] 2> 1624498 T4341 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563
[junit4:junit4] 2> 1624499 T4341 oasc.CoreContainer$Initializer.initialize looking for solr config file: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/solr.xml
[junit4:junit4] 2> 1624499 T4341 oasc.CoreContainer.<init> New CoreContainer 1362421077
[junit4:junit4] 2> 1624500 T4341 oasc.CoreContainer.load Loading CoreContainer using Solr Home: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/'
[junit4:junit4] 2> 1624501 T4341 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/'
[junit4:junit4] 2> 1624615 T4341 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4:junit4] 2> 1624616 T4341 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4:junit4] 2> 1624616 T4341 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4:junit4] 2> 1624617 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4:junit4] 2> 1624618 T4341 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4:junit4] 2> 1624618 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4:junit4] 2> 1624619 T4341 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4:junit4] 2> 1624619 T4341 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4:junit4] 2> 1624620 T4341 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4:junit4] 2> 1624620 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnectionsPerHost=20&maxConnections=10000&socketTimeout=120000&connTimeout=15000&retry=false
[junit4:junit4] 2> 1624634 T4341 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener
[junit4:junit4] 2> 1624635 T4341 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:35446/solr
[junit4:junit4] 2> 1624636 T4341 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4:junit4] 2> 1624637 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1624640 T4430 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d1460fc name:ZooKeeperConnection Watcher:127.0.0.1:35446 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1624641 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1624643 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=500&maxConnectionsPerHost=16&socketTimeout=120000&connTimeout=15000
[junit4:junit4] 2> 1624653 T4341 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4:junit4] 2> 1624655 T4432 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7a7e24eb name:ZooKeeperConnection Watcher:127.0.0.1:35446/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4:junit4] 2> 1624656 T4341 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4:junit4] 2> 1624667 T4341 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4:junit4] 2> 1625364 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1625365 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59057_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59057/jo"}
[junit4:junit4] 2> 1625379 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625379 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625379 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625379 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625379 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625379 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4:junit4] 2> 1625671 T4341 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:59062_jo
[junit4:junit4] 2> 1625674 T4341 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:59062_jo
[junit4:junit4] 2> 1625677 T4363 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625677 T4432 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625677 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625677 T4399 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625677 T4370 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625677 T4415 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625677 T4383 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4:junit4] 2> 1625678 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625678 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625678 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625677 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625679 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1625699 T4433 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/collection1
[junit4:junit4] 2> 1625699 T4433 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4:junit4] 2> 1625700 T4433 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4:junit4] 2> 1625700 T4433 oasc.ZkController.readConfigName Load collection config from:/collections/collection1
[junit4:junit4] 2> 1625702 T4433 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/collection1/'
[junit4:junit4] 2> 1625703 T4433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/collection1/lib/README' to classloader
[junit4:junit4] 2> 1625704 T4433 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/collection1/lib/classes/' to classloader
[junit4:junit4] 2> 1625755 T4433 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4:junit4] 2> 1625817 T4433 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4:junit4] 2> 1625919 T4433 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4:junit4] 2> 1625925 T4433 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4:junit4] 2> 1626287 T4373 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 4, state: recovering, checkLive: true, onlyIfLeader: true for: 2 seconds.
[junit4:junit4] 2> 1626287 T4373 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=4&state=recovering&nodeName=127.0.0.1:59057_jo&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=2003
[junit4:junit4] 2> 1626343 T4433 oass.IndexSchema.readSchema default search field in schema is text
[junit4:junit4] 2> 1626345 T4433 oass.IndexSchema.readSchema unique key field: id
[junit4:junit4] 2> 1626347 T4433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1626351 T4433 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4:junit4] 2> 1626370 T4433 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1626371 T4433 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-jetty4-1368664276563/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/
[junit4:junit4] 2> 1626371 T4433 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@478b7093
[junit4:junit4] 2> 1626371 T4433 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4:junit4] 2> 1626372 T4433 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4
[junit4:junit4] 2> 1626372 T4433 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index/
[junit4:junit4] 2> 1626372 T4433 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index' doesn't exist. Creating new index...
[junit4:junit4] 2> 1626373 T4433 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index
[junit4:junit4] 2> 1626375 T4433 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d6792b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad8f623),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1626375 T4433 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1626377 T4433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4:junit4] 2> 1626377 T4433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4:junit4] 2> 1626378 T4433 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4:junit4] 2> 1626378 T4433 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4:junit4] 2> 1626379 T4433 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4:junit4] 2> 1626379 T4433 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4:junit4] 2> 1626379 T4433 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4:junit4] 2> 1626379 T4433 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4:junit4] 2> 1626380 T4433 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4:junit4] 2> 1626388 T4433 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4:junit4] 2> 1626392 T4433 oass.SolrIndexSearcher.<init> Opening Searcher@7908b0cf main
[junit4:junit4] 2> 1626392 T4433 oasu.UpdateHandler.clearLog Clearing tlog files, tlogDir=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/tlog
[junit4:junit4] 2> 1626393 T4433 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4:junit4] 2> 1626393 T4433 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4:junit4] 2> 1626396 T4434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7908b0cf main{StandardDirectoryReader(segments_1:1)}
[junit4:junit4] 2> 1626398 T4433 oasc.ZkController.publish publishing core=collection1 state=down
[junit4:junit4] 2> 1626398 T4433 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1626884 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1626885 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":null,
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"down",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59062_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59062/jo"}
[junit4:junit4] 2> 1626886 T4364 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4:junit4] 2> 1626886 T4364 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard=shard2
[junit4:junit4] 2> 1626904 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1626904 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1626904 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1626904 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1626904 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1626904 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1627401 T4433 oasc.CoreContainer.registerCore registering core: collection1
[junit4:junit4] 2> 1627401 T4433 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:59062/jo collection:collection1 shard:shard2
[junit4:junit4] 2> 1627405 T4433 oasc.ZkController.register We are http://127.0.0.1:59062/jo/collection1/ and leader is http://127.0.0.1:59048/jo/collection1/
[junit4:junit4] 2> 1627406 T4433 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:59062/jo
[junit4:junit4] 2> 1627406 T4433 oasc.ZkController.checkRecovery Core needs to recover:collection1
[junit4:junit4] 2> 1627406 T4433 oasu.DefaultSolrCoreState.doRecovery Running recovery - first canceling any ongoing recovery
[junit4:junit4] 2> ASYNC NEW_CORE C198 name=collection1 org.apache.solr.core.SolrCore@2654ba1 url=http://127.0.0.1:59062/jo/collection1 node=127.0.0.1:59062_jo C198_STATE=coll:collection1 core:collection1 props:{state=down, core=collection1, collection=collection1, node_name=127.0.0.1:59062_jo, base_url=http://127.0.0.1:59062/jo}
[junit4:junit4] 2> 1627407 T4435 C198 P59062 oasc.RecoveryStrategy.run Starting recovery process. core=collection1 recoveringAfterStartup=true
[junit4:junit4] 2> 1627408 T4433 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1627408 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery ###### startupVersions=[]
[junit4:junit4] 2> 1627408 T4435 C198 P59062 oasc.ZkController.publish publishing core=collection1 state=recovering
[junit4:junit4] 2> 1627409 T4435 C198 P59062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1627409 T4341 oass.SolrDispatchFilter.init user.dir=/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build/solr-core/test/J0
[junit4:junit4] 2> 1627410 T4341 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4:junit4] 2> 1627411 T4341 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1627427 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1627427 T4435 C198 P59062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> 1627428 T4341 oasc.AbstractFullDistribZkTestBase.waitForThingsToLevelOut Wait for recoveries to finish - wait 15 for each attempt
[junit4:junit4] 2> 1627429 T4341 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):15
[junit4:junit4] 2> 1627430 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1627440 T4389 oasha.CoreAdminHandler.handleWaitForStateAction Going to wait for coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true
[junit4:junit4] 2> C197_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59057_jo, base_url=http://127.0.0.1:59057/jo}
[junit4:junit4] 2> 1628289 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59007/jo/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1628289 T4418 C197 P59057 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59057/jo START replicas=[http://127.0.0.1:59007/jo/collection1/] nUpdates=100
[junit4:junit4] 2> 1628290 T4418 C197 P59057 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1628290 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1628290 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1628290 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1628291 T4418 C197 P59057 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1628291 T4418 C197 P59057 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59007/jo/collection1/. core=collection1
[junit4:junit4] 2> 1628291 T4418 C197 P59057 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C199 name=collection1 org.apache.solr.core.SolrCore@6c004fcc url=http://127.0.0.1:59007/jo/collection1 node=127.0.0.1:59007_jo C199_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59007_jo, base_url=http://127.0.0.1:59007/jo, leader=true}
[junit4:junit4] 2> 1628298 T4374 C199 P59007 oasc.SolrCore.execute [collection1] webapp=/jo path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1628302 T4375 C199 P59007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1628304 T4375 C199 P59007 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1628305 T4375 C199 P59007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1628305 T4375 C199 P59007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1628306 T4375 C199 P59007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1628306 T4375 C199 P59007 oass.SolrIndexSearcher.<init> Opening Searcher@242a9138 realtime
[junit4:junit4] 2> 1628307 T4375 C199 P59007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1628307 T4375 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1628308 T4418 C197 P59057 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1628308 T4418 C197 P59057 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1628310 T4376 C199 P59007 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1628310 T4376 C199 P59007 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=1
[junit4:junit4] 2> 1628311 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1628311 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1628312 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1628314 T4376 C199 P59007 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1628315 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1628316 T4418 C197 P59057 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index.20130516033824595
[junit4:junit4] 2> 1628316 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@48432814 lockFactory=org.apache.lucene.store.NativeFSLockFactory@3cc0789b) fullCopy=false
[junit4:junit4] 2> 1628319 T4376 C199 P59007 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1628320 T4418 C197 P59057 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1628321 T4418 C197 P59057 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1628321 T4418 C197 P59057 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1628323 T4418 C197 P59057 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fe59259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e01a2ea),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fe59259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e01a2ea),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1628324 T4418 C197 P59057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1628324 T4418 C197 P59057 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1628325 T4418 C197 P59057 oass.SolrIndexSearcher.<init> Opening Searcher@1894c05d main
[junit4:junit4] 2> 1628326 T4417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1894c05d main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1628326 T4418 C197 P59057 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index.20130516033824595 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index.20130516033824595;done=true>>]
[junit4:junit4] 2> 1628326 T4418 C197 P59057 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index.20130516033824595
[junit4:junit4] 2> 1628327 T4418 C197 P59057 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty3/index.20130516033824595
[junit4:junit4] 2> 1628327 T4418 C197 P59057 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1628327 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1628327 T4418 C197 P59057 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1628327 T4418 C197 P59057 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1628329 T4418 C197 P59057 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1628414 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1628415 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"recovering",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59062_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59062/jo"}
[junit4:junit4] 2> 1628418 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"4",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard1",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59057_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59057/jo"}
[junit4:junit4] 2> 1628429 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628429 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628429 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628429 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628429 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628429 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1628437 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1628441 T4389 oasha.CoreAdminHandler.handleWaitForStateAction Waited coreNodeName: 5, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
[junit4:junit4] 2> 1628441 T4389 oass.SolrDispatchFilter.handleAdminRequest [admin] webapp=null path=/admin/cores params={coreNodeName=5&state=recovering&nodeName=127.0.0.1:59062_jo&action=PREPRECOVERY&checkLive=true&core=collection1&wt=javabin&onlyIfLeader=true&version=2} status=0 QTime=1001
[junit4:junit4] 2> 1629439 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1630442 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> C198_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=recovering, core=collection1, collection=collection1, node_name=127.0.0.1:59062_jo, base_url=http://127.0.0.1:59062/jo}
[junit4:junit4] 2> 1630443 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery Attempting to PeerSync from http://127.0.0.1:59048/jo/collection1/ core=collection1 - recoveringAfterStartup=true
[junit4:junit4] 2> 1630443 T4435 C198 P59062 oasu.PeerSync.sync PeerSync: core=collection1 url=http://127.0.0.1:59062/jo START replicas=[http://127.0.0.1:59048/jo/collection1/] nUpdates=100
[junit4:junit4] 2> 1630444 T4435 C198 P59062 oasu.PeerSync.sync WARN no frame of reference to tell of we've missed updates
[junit4:junit4] 2> 1630444 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery PeerSync Recovery was not successful - trying replication. core=collection1
[junit4:junit4] 2> 1630444 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery Starting Replication Recovery. core=collection1
[junit4:junit4] 2> 1630444 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery Begin buffering updates. core=collection1
[junit4:junit4] 2> 1630445 T4435 C198 P59062 oasu.UpdateLog.bufferUpdates Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4:junit4] 2> 1630445 T4435 C198 P59062 oasc.RecoveryStrategy.replicate Attempting to replicate from http://127.0.0.1:59048/jo/collection1/. core=collection1
[junit4:junit4] 2> 1630445 T4435 C198 P59062 oascsi.HttpClientUtil.createClient Creating new http client, config:maxConnections=128&maxConnectionsPerHost=32&followRedirects=false
[junit4:junit4] 2> ASYNC NEW_CORE C200 name=collection1 org.apache.solr.core.SolrCore@752cbea url=http://127.0.0.1:59048/jo/collection1 node=127.0.0.1:59048_jo C200_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59048_jo, base_url=http://127.0.0.1:59048/jo, leader=true}
[junit4:junit4] 2> 1630453 T4390 C200 P59048 oasc.SolrCore.execute [collection1] webapp=/jo path=/get params={getVersions=100&distrib=false&wt=javabin&qt=/get&version=2} status=0 QTime=1
[junit4:junit4] 2> 1630454 T4391 C200 P59048 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1630456 T4391 C200 P59048 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1630456 T4391 C200 P59048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1630457 T4391 C200 P59048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1630457 T4391 C200 P59048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1630457 T4391 C200 P59048 oass.SolrIndexSearcher.<init> Opening Searcher@1e5a15ce realtime
[junit4:junit4] 2> 1630458 T4391 C200 P59048 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1630458 T4391 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&openSearcher=false&commit=true&wt=javabin&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 1630459 T4435 C198 P59062 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1630459 T4435 C198 P59062 oash.SnapPuller.<init> No value set for 'pollInterval'. Timer Task not started.
[junit4:junit4] 2> 1630461 T4392 C200 P59048 oash.ReplicationHandler.inform Commits will be reserved for 10000
[junit4:junit4] 2> 1630462 T4392 C200 P59048 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={command=indexversion&qt=/replication&wt=javabin&version=2} status=0 QTime=2
[junit4:junit4] 2> 1630462 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Master's generation: 2
[junit4:junit4] 2> 1630463 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Slave's generation: 1
[junit4:junit4] 2> 1630463 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Starting replication process
[junit4:junit4] 2> 1630465 T4392 C200 P59048 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={command=filelist&qt=/replication&wt=javabin&generation=2&version=2} status=0 QTime=0
[junit4:junit4] 2> 1630466 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Number of files in latest index in master: 1
[junit4:junit4] 2> 1630467 T4435 C198 P59062 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index.20130516033826746
[junit4:junit4] 2> 1630468 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Starting download to MockDirWrapper(org.apache.lucene.store.RAMDirectory@568e3439 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5fc66bac) fullCopy=false
[junit4:junit4] 2> 1630470 T4392 C200 P59048 oasc.SolrCore.execute [collection1] webapp=/jo path=/replication params={file=segments_2&command=filecontent&checksum=true&wt=filestream&qt=/replication&generation=2} status=0 QTime=0
[junit4:junit4] 2> 1630472 T4435 C198 P59062 oash.SnapPuller.fetchLatestIndex Total time taken for download : 0 secs
[junit4:junit4] 2> 1630472 T4435 C198 P59062 oasu.DefaultSolrCoreState.newIndexWriter Creating new IndexWriter...
[junit4:junit4] 2> 1630473 T4435 C198 P59062 oasu.DefaultSolrCoreState.newIndexWriter Waiting until IndexWriter is unused... core=collection1
[junit4:junit4] 2> 1630474 T4435 C198 P59062 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d6792b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad8f623),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d6792b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad8f623),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1630475 T4435 C198 P59062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1630475 T4435 C198 P59062 oasu.DefaultSolrCoreState.newIndexWriter New IndexWriter is ready to be used.
[junit4:junit4] 2> 1630475 T4435 C198 P59062 oass.SolrIndexSearcher.<init> Opening Searcher@7926ef45 main
[junit4:junit4] 2> 1630476 T4434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7926ef45 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1630477 T4435 C198 P59062 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index.20130516033826746 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index.20130516033826746;done=true>>]
[junit4:junit4] 2> 1630477 T4435 C198 P59062 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index.20130516033826746
[junit4:junit4] 2> 1630477 T4435 C198 P59062 oasc.CachingDirectoryFactory.closeCacheValue Removing directory before core close: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index.20130516033826746
[junit4:junit4] 2> 1630478 T4435 C198 P59062 oasc.RecoveryStrategy.replay No replay needed. core=collection1
[junit4:junit4] 2> 1630478 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery Replication Recovery was successful - registering as Active. core=collection1
[junit4:junit4] 2> 1630478 T4435 C198 P59062 oasc.ZkController.publish publishing core=collection1 state=active
[junit4:junit4] 2> 1630478 T4435 C198 P59062 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4:junit4] 2> 1630506 T4435 C198 P59062 oasc.RecoveryStrategy.doRecovery Finished recovery process. core=collection1
[junit4:junit4] 2> 1631443 T4364 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1631444 T4364 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4:junit4] 2> "operation":"state",
[junit4:junit4] 2> "core_node_name":"5",
[junit4:junit4] 2> "numShards":"2",
[junit4:junit4] 2> "shard":"shard2",
[junit4:junit4] 2> "roles":null,
[junit4:junit4] 2> "state":"active",
[junit4:junit4] 2> "shard_state":"active",
[junit4:junit4] 2> "core":"collection1",
[junit4:junit4] 2> "collection":"collection1",
[junit4:junit4] 2> "shard_range":null,
[junit4:junit4] 2> "node_name":"127.0.0.1:59062_jo",
[junit4:junit4] 2> "base_url":"http://127.0.0.1:59062/jo"}
[junit4:junit4] 2> 1631445 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1631482 T4383 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1631482 T4399 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1631482 T4415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1631482 T4363 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1631482 T4370 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1631482 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4:junit4] 2> 1632472 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1632474 T4341 oasc.AbstractDistribZkTestBase.waitForRecoveriesToFinish Recoveries finished - collection: collection1
[junit4:junit4] 2> ASYNC NEW_CORE C201 name=collection1 org.apache.solr.core.SolrCore@a457b94 url=http://127.0.0.1:16418/jo/collection1 node=127.0.0.1:16418_jo C201_STATE=coll:control_collection core:collection1 props:{shard=shard1, state=active, core=collection1, collection=control_collection, node_name=127.0.0.1:16418_jo, base_url=http://127.0.0.1:16418/jo, leader=true}
[junit4:junit4] 2> 1632482 T4353 C201 P16418 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1632485 T4353 C201 P16418 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@493c5378 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e55b676),segFN=segments_1,generation=1}
[junit4:junit4] 2> 1632486 T4353 C201 P16418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4:junit4] 2> 1632487 T4353 C201 P16418 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@493c5378 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e55b676),segFN=segments_1,generation=1}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@493c5378 lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e55b676),segFN=segments_2,generation=2}
[junit4:junit4] 2> 1632487 T4353 C201 P16418 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
[junit4:junit4] 2> 1632488 T4353 C201 P16418 oass.SolrIndexSearcher.<init> Opening Searcher@485b481b main
[junit4:junit4] 2> 1632488 T4353 C201 P16418 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1632489 T4367 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@485b481b main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1632489 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 7
[junit4:junit4] 2> 1632497 T4377 C199 P59007 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1632499 T4377 C199 P59007 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@6a9fe971 lockFactory=org.apache.lucene.store.NativeFSLockFactory@62bcbc79),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1632499 T4377 C199 P59007 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1632500 T4377 C199 P59007 oass.SolrIndexSearcher.<init> Opening Searcher@43604b31 main
[junit4:junit4] 2> 1632500 T4377 C199 P59007 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1632501 T4385 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@43604b31 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1632501 T4377 C199 P59007 oasu.SolrCmdDistributor.distribCommit Distrib commit to:[StdNode: http://127.0.0.1:59057/jo/collection1/, StdNode: http://127.0.0.1:59048/jo/collection1/, StdNode: http://127.0.0.1:59062/jo/collection1/] params:commit_end_point=true&commit=true&softCommit=false&waitSearcher=true&expungeDeletes=false
[junit4:junit4] 2> 1632504 T4393 C200 P59048 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1632504 T4393 C200 P59048 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@1b6b13d1 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e32df22),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1632505 T4393 C200 P59048 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1632506 T4393 C200 P59048 oass.SolrIndexSearcher.<init> Opening Searcher@21cf2a52 main
[junit4:junit4] 2> 1632506 T4393 C200 P59048 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1632507 T4401 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@21cf2a52 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1632507 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 3
[junit4:junit4] 2> C197_STATE=coll:collection1 core:collection1 props:{shard=shard1, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59057_jo, base_url=http://127.0.0.1:59057/jo}
[junit4:junit4] 2> 1632509 T4405 C197 P59057 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> C198_STATE=coll:collection1 core:collection1 props:{shard=shard2, state=active, core=collection1, collection=collection1, node_name=127.0.0.1:59062_jo, base_url=http://127.0.0.1:59062/jo}
[junit4:junit4] 2> 1632509 T4422 C198 P59062 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4:junit4] 2> 1632510 T4405 C197 P59057 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fe59259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e01a2ea),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@5fe59259 lockFactory=org.apache.lucene.store.NativeFSLockFactory@4e01a2ea),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1632510 T4422 C198 P59062 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d6792b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad8f623),segFN=segments_2,generation=2}
[junit4:junit4] 2> commit{dir=MockDirWrapper(org.apache.lucene.store.RAMDirectory@3d6792b lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ad8f623),segFN=segments_3,generation=3}
[junit4:junit4] 2> 1632510 T4405 C197 P59057 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1632511 T4422 C198 P59062 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
[junit4:junit4] 2> 1632511 T4405 C197 P59057 oass.SolrIndexSearcher.<init> Opening Searcher@421aee93 main
[junit4:junit4] 2> 1632512 T4422 C198 P59062 oass.SolrIndexSearcher.<init> Opening Searcher@7e270d4e main
[junit4:junit4] 2> 1632512 T4405 C197 P59057 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1632513 T4417 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@421aee93 main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1632513 T4422 C198 P59062 oasu.DirectUpdateHandler2.commit end_commit_flush
[junit4:junit4] 2> 1632513 T4434 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@7e270d4e main{StandardDirectoryReader(segments_2:1:nrt)}
[junit4:junit4] 2> 1632513 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 4
[junit4:junit4] 2> 1632514 T4422 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&commit=true&wt=javabin&expungeDeletes=false&commit_end_point=true&version=2&softCommit=false} {commit=} 0 5
[junit4:junit4] 2> 1632514 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={waitSearcher=true&commit=true&wt=javabin&version=2&softCommit=false} {commit=} 0 17
[junit4:junit4] 2> 1632515 T4341 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4:junit4] 2> 1632518 T4378 C199 P59007 oasc.SolrCore.execute [collection1] webapp=/jo path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=1
[junit4:junit4] 2> 1632519 T4406 C197 P59057 oasc.SolrCore.execute [collection1] webapp=/jo path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1632520 T4394 C200 P59048 oasc.SolrCore.execute [collection1] webapp=/jo path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1632522 T4423 C198 P59062 oasc.SolrCore.execute [collection1] webapp=/jo path=/select params={tests=checkShardConsistency&q=*:*&distrib=false&wt=javabin&version=2&rows=0} hits=0 status=0 QTime=0
[junit4:junit4] 2> 1634527 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435148523200839680)} 0 2
[junit4:junit4] 2> 1634534 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={update.distrib=FROMLEADER&_version_=-1435148523203985408&update.from=http://127.0.0.1:59048/jo/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435148523203985408)} 0 2
[junit4:junit4] 2> 1634537 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={update.distrib=FROMLEADER&_version_=-1435148523208179712&update.from=http://127.0.0.1:59007/jo/collection1/&wt=javabin&version=2} {deleteByQuery=*:* (-1435148523208179712)} 0 1
[junit4:junit4] 2> 1634538 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={update.distrib=TOLEADER&wt=javabin&version=2} {deleteByQuery=*:* (-1435148523208179712)} 0 6
[junit4:junit4] 2> 1634538 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1435148523203985408)} 0 10
[junit4:junit4] 2> 1634542 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[0 (1435148523217616896)]} 0 1
[junit4:junit4] 2> 1634548 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[0 (1435148523221811200)]} 0 0
[junit4:junit4] 2> 1634549 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[0 (1435148523221811200)]} 0 4
[junit4:junit4] 2> 1634552 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[1 (1435148523229151232)]} 0 0
[junit4:junit4] 2> 1634558 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[1 (1435148523232296960)]} 0 0
[junit4:junit4] 2> 1634559 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[1 (1435148523232296960)]} 0 4
[junit4:junit4] 2> 1634562 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[2 (1435148523239636992)]} 0 0
[junit4:junit4] 2> 1634572 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[2 (1435148523245928448)]} 0 1
[junit4:junit4] 2> 1634572 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[2 (1435148523245928448)]} 0 4
[junit4:junit4] 2> 1634573 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[2]} 0 8
[junit4:junit4] 2> 1634576 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[3 (1435148523254317056)]} 0 0
[junit4:junit4] 2> 1634583 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[3 (1435148523259559936)]} 0 0
[junit4:junit4] 2> 1634584 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[3 (1435148523259559936)]} 0 3
[junit4:junit4] 2> 1634584 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[3]} 0 5
[junit4:junit4] 2> 1634587 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[4 (1435148523265851392)]} 0 0
[junit4:junit4] 2> 1634593 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[4 (1435148523268997120)]} 0 0
[junit4:junit4] 2> 1634594 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[4 (1435148523268997120)]} 0 4
[junit4:junit4] 2> 1634596 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[5 (1435148523275288576)]} 0 0
[junit4:junit4] 2> 1634601 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[5 (1435148523278434304)]} 0 0
[junit4:junit4] 2> 1634602 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[5 (1435148523278434304)]} 0 3
[junit4:junit4] 2> 1634604 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[6 (1435148523283677184)]} 0 0
[junit4:junit4] 2> 1634611 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[6 (1435148523288920064)]} 0 0
[junit4:junit4] 2> 1634612 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[6 (1435148523288920064)]} 0 3
[junit4:junit4] 2> 1634612 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[6]} 0 5
[junit4:junit4] 2> 1634615 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[7 (1435148523295211520)]} 0 0
[junit4:junit4] 2> 1634620 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[7 (1435148523298357248)]} 0 0
[junit4:junit4] 2> 1634621 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[7 (1435148523298357248)]} 0 3
[junit4:junit4] 2> 1634623 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[8 (1435148523303600128)]} 0 0
[junit4:junit4] 2> 1634630 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[8 (1435148523308843008)]} 0 0
[junit4:junit4] 2> 1634631 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[8 (1435148523308843008)]} 0 3
[junit4:junit4] 2> 1634631 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[8]} 0 5
[junit4:junit4] 2> 1634634 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[9 (1435148523315134464)]} 0 0
[junit4:junit4] 2> 1634639 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[9 (1435148523318280192)]} 0 0
[junit4:junit4] 2> 1634640 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[9 (1435148523318280192)]} 0 3
[junit4:junit4] 2> 1634642 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[10 (1435148523323523072)]} 0 0
[junit4:junit4] 2> 1634647 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[10 (1435148523326668800)]} 0 0
[junit4:junit4] 2> 1634648 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[10 (1435148523326668800)]} 0 3
[junit4:junit4] 2> 1634650 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[11 (1435148523331911680)]} 0 0
[junit4:junit4] 2> 1634657 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[11 (1435148523337154560)]} 0 0
[junit4:junit4] 2> 1634658 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[11 (1435148523337154560)]} 0 3
[junit4:junit4] 2> 1634658 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[11]} 0 5
[junit4:junit4] 2> 1634661 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[12 (1435148523343446016)]} 0 0
[junit4:junit4] 2> 1634668 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[12 (1435148523348688896)]} 0 0
[junit4:junit4] 2> 1634669 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[12 (1435148523348688896)]} 0 3
[junit4:junit4] 2> 1634669 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[12]} 0 5
[junit4:junit4] 2> 1634672 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[13 (1435148523354980352)]} 0 0
[junit4:junit4] 2> 1634677 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[13 (1435148523358126080)]} 0 0
[junit4:junit4] 2> 1634678 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[13 (1435148523358126080)]} 0 3
[junit4:junit4] 2> 1634680 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[14 (1435148523363368960)]} 0 0
[junit4:junit4] 2> 1634687 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[14 (1435148523368611840)]} 0 0
[junit4:junit4] 2> 1634688 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[14 (1435148523368611840)]} 0 3
[junit4:junit4] 2> 1634688 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[14]} 0 5
[junit4:junit4] 2> 1634691 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[15 (1435148523374903296)]} 0 0
[junit4:junit4] 2> 1634696 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[15 (1435148523378049024)]} 0 0
[junit4:junit4] 2> 1634697 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[15 (1435148523378049024)]} 0 3
[junit4:junit4] 2> 1634699 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[16 (1435148523383291904)]} 0 0
[junit4:junit4] 2> 1634704 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[16 (1435148523386437632)]} 0 0
[junit4:junit4] 2> 1634705 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[16 (1435148523386437632)]} 0 3
[junit4:junit4] 2> 1634707 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[17 (1435148523391680512)]} 0 0
[junit4:junit4] 2> 1634714 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[17 (1435148523396923392)]} 0 0
[junit4:junit4] 2> 1634715 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[17 (1435148523396923392)]} 0 3
[junit4:junit4] 2> 1634715 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[17]} 0 5
[junit4:junit4] 2> 1634718 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[18 (1435148523403214848)]} 0 0
[junit4:junit4] 2> 1634725 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[18 (1435148523408457728)]} 0 0
[junit4:junit4] 2> 1634726 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[18 (1435148523408457728)]} 0 3
[junit4:junit4] 2> 1634726 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[18]} 0 5
[junit4:junit4] 2> 1634729 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[19 (1435148523414749184)]} 0 0
[junit4:junit4] 2> 1634737 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[19 (1435148523419992064)]} 0 0
[junit4:junit4] 2> 1634738 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[19 (1435148523419992064)]} 0 4
[junit4:junit4] 2> 1634738 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[19]} 0 6
[junit4:junit4] 2> 1634741 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[20 (1435148523427332096)]} 0 0
[junit4:junit4] 2> 1634746 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[20 (1435148523430477824)]} 0 0
[junit4:junit4] 2> 1634747 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[20 (1435148523430477824)]} 0 3
[junit4:junit4] 2> 1634749 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[21 (1435148523435720704)]} 0 0
[junit4:junit4] 2> 1634754 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[21 (1435148523438866432)]} 0 0
[junit4:junit4] 2> 1634755 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[21 (1435148523438866432)]} 0 3
[junit4:junit4] 2> 1634757 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[22 (1435148523444109312)]} 0 0
[junit4:junit4] 2> 1634762 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[22 (1435148523447255040)]} 0 0
[junit4:junit4] 2> 1634763 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[22 (1435148523447255040)]} 0 3
[junit4:junit4] 2> 1634765 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[23 (1435148523452497920)]} 0 0
[junit4:junit4] 2> 1634772 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[23 (1435148523457740800)]} 0 0
[junit4:junit4] 2> 1634773 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[23 (1435148523457740800)]} 0 3
[junit4:junit4] 2> 1634773 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[23]} 0 5
[junit4:junit4] 2> 1634776 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[24 (1435148523464032256)]} 0 0
[junit4:junit4] 2> 1634781 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[24 (1435148523467177984)]} 0 0
[junit4:junit4] 2> 1634782 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[24 (1435148523467177984)]} 0 3
[junit4:junit4] 2> 1634784 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[25 (1435148523472420864)]} 0 0
[junit4:junit4] 2> 1634791 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[25 (1435148523477663744)]} 0 0
[junit4:junit4] 2> 1634792 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[25 (1435148523477663744)]} 0 3
[junit4:junit4] 2> 1634792 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[25]} 0 5
[junit4:junit4] 2> 1634795 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[26 (1435148523483955200)]} 0 0
[junit4:junit4] 2> 1634800 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[26 (1435148523487100928)]} 0 0
[junit4:junit4] 2> 1634801 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[26 (1435148523487100928)]} 0 3
[junit4:junit4] 2> 1634803 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[27 (1435148523492343808)]} 0 0
[junit4:junit4] 2> 1634808 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[27 (1435148523495489536)]} 0 0
[junit4:junit4] 2> 1634809 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[27 (1435148523495489536)]} 0 3
[junit4:junit4] 2> 1634811 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[28 (1435148523500732416)]} 0 0
[junit4:junit4] 2> 1634816 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[28 (1435148523503878144)]} 0 0
[junit4:junit4] 2> 1634817 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[28 (1435148523503878144)]} 0 3
[junit4:junit4] 2> 1634819 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[29 (1435148523509121024)]} 0 0
[junit4:junit4] 2> 1634826 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[29 (1435148523514363904)]} 0 0
[junit4:junit4] 2> 1634827 T4393 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[29 (1435148523514363904)]} 0 3
[junit4:junit4] 2> 1634827 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[29]} 0 5
[junit4:junit4] 2> 1634830 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[30 (1435148523520655360)]} 0 0
[junit4:junit4] 2> 1634835 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[30 (1435148523523801088)]} 0 0
[junit4:junit4] 2> 1634836 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[30 (1435148523523801088)]} 0 3
[junit4:junit4] 2> 1634838 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[31 (1435148523529043968)]} 0 0
[junit4:junit4] 2> 1634843 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[31 (1435148523532189696)]} 0 0
[junit4:junit4] 2> 1634844 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[31 (1435148523532189696)]} 0 3
[junit4:junit4] 2> 1634846 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[32 (1435148523537432576)]} 0 0
[junit4:junit4] 2> 1634851 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[32 (1435148523540578304)]} 0 0
[junit4:junit4] 2> 1634852 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[32 (1435148523540578304)]} 0 3
[junit4:junit4] 2> 1634855 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[33 (1435148523546869760)]} 0 0
[junit4:junit4] 2> 1634860 T4424 C198 P59062 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[33 (1435148523550015488)]} 0 0
[junit4:junit4] 2> 1634861 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[33 (1435148523550015488)]} 0 3
[junit4:junit4] 2> 1634863 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[34 (1435148523555258368)]} 0 0
[junit4:junit4] 2> 1634869 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[34 (1435148523558404096)]} 0 0
[junit4:junit4] 2> 1634870 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[34 (1435148523558404096)]} 0 4
[junit4:junit4] 2> 1634872 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[35 (1435148523564695552)]} 0 0
[junit4:junit4] 2> 1634878 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[35 (1435148523567841280)]} 0 0
[junit4:junit4] 2> 1634879 T4377 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[35 (1435148523567841280)]} 0 4
[junit4:junit4] 2> 1634882 T4353 C201 P16418 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[36 (1435148523575181312)]} 0 0
[junit4:junit4] 2> 1634890 T4405 C197 P59057 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59007/jo/collection1/&update.distrib=FROMLEADER&wt=javabin&version=2} {add=[36 (1435148523580424192)]} 0 0
[junit4:junit4] 2> 1634891 T4379 C199 P59007 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={distrib.from=http://127.0.0.1:59048/jo/collection1/&update.distrib=TOLEADER&wt=javabin&version=2} {add=[36 (1435148523580424192)]} 0 4
[junit4:junit4] 2> 1634891 T4395 C200 P59048 oasup.LogUpdateProcessor.finish [collection1] webapp=/jo path=/update params={wt=javabin&version=2} {add=[36]} 0 6
[junit4:junit4] 2> 1634894 T4353 C201 P1
[...truncated too long message...]
te.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
[junit4:junit4] 2> 1886704 T4432 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
[junit4:junit4] 2> 1886704 T4432 C198 P59062 oasu.TransactionLog.forceClose ERROR Error: Forcing close of tlog{file=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/tlog/tlog.0000000000000000003 refcount=1}
[junit4:junit4] 2> 1886707 T4432 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
[junit4:junit4] 2> 1886708 T4432 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
[junit4:junit4] 2> 1886708 T4432 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4 [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4;done=false>>]
[junit4:junit4] 2> 1886708 T4432 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4
[junit4:junit4] 2> 1886709 T4432 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index;done=false>>]
[junit4:junit4] 2> 1886709 T4432 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.ChaosMonkeyShardSplitTest-1368664259980/jetty4/index
[junit4:junit4] 2> 1886709 T4432 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4:junit4] 2> 1886709 T4432 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/collection1/leader_elect/shard2/election/89696780943556620-5-n_0000000001
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:152)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:149)
[junit4:junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:63)
[junit4:junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:246)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:156)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:100)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> 1886710 T4432 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1886711 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1886711 T4432 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1886711 T4432 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4:junit4] 2> 1886711 T4432 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4:junit4] 2> 1886712 T4432 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/election
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4:junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4:junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:235)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:65)
[junit4:junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:232)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:84)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4:junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:129)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4:junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4:junit4] 2>
[junit4:junit4] 2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=41), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=41)), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=ar_AE, timezone=Mideast/Riyadh88
[junit4:junit4] 2> NOTE: FreeBSD 9.0-RELEASE amd64/Oracle Corporation 1.7.0_17 (64-bit)/cpus=16,threads=3,free=216067000,total=446693376
[junit4:junit4] 2> NOTE: All tests run in this JVM: [TestClassNameShortening, TestBadConfig, PrimitiveFieldTypeTest, TestUniqueKeyFieldResource, TestFastWriter, TestQuerySenderListener, PluginInfoTest, SchemaVersionSpecificBehaviorTest, SolrInfoMBeanTest, ClusterStateUpdateTest, TermsComponentTest, SpatialFilterTest, QueryResultKeyTest, UnloadDistributedZkTest, AnalysisAfterCoreReloadTest, TestManagedSchema, QueryParsingTest, SuggesterTest, CSVRequestHandlerTest, SearchHandlerTest, UUIDFieldTest, TestSolrDeletionPolicy1, TestSearchPerf, TestFieldTypeCollectionResource, PrimUtilsTest, OverseerCollectionProcessorTest, OverseerTest, DistributedSpellCheckComponentTest, CoreAdminHandlerTest, PeerSyncTest, TestSolrCoreProperties, ResponseLogComponentTest, JsonLoaderTest, DocumentBuilderTest, RegexBoostProcessorTest, ScriptEngineTest, IndexSchemaTest, MBeansHandlerTest, MoreLikeThisHandlerTest, FastVectorHighlighterTest, TestSolrIndexConfig, SynonymTokenizerTest, StatelessScriptUpdateProcessorFactoryTest, ResourceLoaderTest, TestReversedWildcardFilterFactory, AutoCommitTest, FileBasedSpellCheckerTest, SuggesterFSTTest, WordBreakSolrSpellCheckerTest, TestFunctionQuery, TestPHPSerializedResponseWriter, MinimalSchemaTest, PreAnalyzedFieldTest, DateFieldTest, TestCloudManagedSchema, FieldMutatingUpdateProcessorTest, QueryEqualityTest, TestFastLRUCache, TestStressVersions, TestLRUCache, TestPseudoReturnFields, TestValueSourceCache, TestGroupingSearch, ReturnFieldsTest, TestRealTimeGet, LegacyHTMLStripCharFilterTest, TestPerFieldSimilarity, TestConfig, SOLR749Test, PreAnalyzedUpdateProcessorTest, SliceStateUpdateTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, LeaderElectionTest, ZkSolrClientTest, TestRandomDVFaceting, TestHashPartitioner, TestJoin, SolrCmdDistributorTest, BadIndexSchemaTest, TestFiltering, SimplePostToolTest, TestCoreDiscovery, SolrRequestParserTest, SuggesterTSTTest, SuggesterWFSTTest, PolyFieldTest, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, DistanceFunctionTest, IndexBasedSpellCheckerTest, TestQueryUtils, StandardRequestHandlerTest, TestWriterPerf, TermVectorComponentTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, LoggingHandlerTest, TestAnalyzedSuggestions, BinaryUpdateRequestHandlerTest, TestLFUCache, TestPropInjectDefaults, UpdateParamsTest, SolrIndexConfigTest, TestStressRecovery, ChaosMonkeyShardSplitTest]
[junit4:junit4] Completed on J0 in 279.46s, 1 test, 1 error <<< FAILURES!
[...truncated 54 lines...]
BUILD FAILED
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:377: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:357: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/build.xml:39: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/build.xml:181: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/solr/common-build.xml:437: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:1240: The following error occurred while executing this line:
/usr/home/hudson/hudson-slave/workspace/Lucene-Solr-Tests-trunk-java7/lucene/common-build.xml:884: There were test failures: 295 suites, 1231 tests, 1 suite-level error, 1 error, 27 ignored (8 assumptions)
Total time: 52 minutes 51 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure